-- Logs begin at Tue 2022-02-08 17:03:52 UTC, end at Tue 2022-02-08 18:29:39 UTC. -- Feb 08 18:03:58.355797 dv-cinder-773985-21-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Feb 08 18:04:01.353146 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.common.config [-] Logging enabled! Feb 08 18:04:01.353726 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev486 Feb 08 18:04:01.353812 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102452) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Feb 08 18:04:01.357137 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.common.config [-] Logging enabled! Feb 08 18:04:01.357391 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev486 Feb 08 18:04:01.357698 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102452) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Feb 08 18:04:01.358665 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 08 18:04:01.358923 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 08 18:04:01.359292 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 08 18:04:01.359542 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 08 18:04:01.359763 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 08 18:04:01.360237 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.360658 dv-cinder-773985-21-iscsi neutron-server[102452]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Feb 08 18:04:01.360964 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.361266 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.361549 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.361838 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.362112 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.362391 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.362671 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.362992 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.363276 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.363551 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.363832 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.364119 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.364396 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] config_source = [] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.364660 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.364939 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.365214 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] debug = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.365491 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.366065 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.366604 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.366903 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.367192 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.367474 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.367742 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.368014 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.368293 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.368614 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] host = dv-cinder-773985-21-iscsi {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.368891 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.369173 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.369455 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.369734 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.370005 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.370276 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.370555 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.370853 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] log_dir = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.371126 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] log_file = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.371398 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.371681 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.371964 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.372248 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.372469 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.372688 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.372972 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.373252 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.373524 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.373791 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.374060 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.374423 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.374694 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.374984 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.375267 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.375547 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.375835 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.376102 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.376370 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.376637 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.376906 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.377194 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.377464 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.377734 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.378005 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.378286 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.378552 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.378847 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.379149 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.379433 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.379714 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.379996 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.380264 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.380541 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.380806 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.381075 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] use_journal = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.381342 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] use_json = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.381609 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.381874 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.382148 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.382415 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.382682 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.382980 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.383251 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.383534 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.383804 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] wsgi_server_debug = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:01.384098 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.384390 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.384689 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.384982 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.385271 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.385546 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.385832 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.386107 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.386391 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.386675 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.386985 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.387266 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.387561 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.387857 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.388151 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.388451 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.388740 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.389028 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.389301 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.389573 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.389867 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.390149 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.390428 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.390704 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.391028 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.391319 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.391601 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.391897 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.392181 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.392468 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.392754 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.393026 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.393303 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.393591 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.393867 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.394137 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.394412 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.394697 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.395000 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.395276 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.395557 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.395834 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.396106 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.396376 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.396651 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.396945 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.397380 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.397655 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.397926 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.398205 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.398474 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.398754 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.399053 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.399326 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.399597 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.399872 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.400143 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.400411 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.400685 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.400955 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.401229 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.401498 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.401765 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.402034 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.402302 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.402569 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.402863 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.403136 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.403409 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.403686 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.403950 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.404220 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.404490 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.404757 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.405039 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.405331 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.405657 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.405933 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.406209 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.406485 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.406758 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.407061 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.407337 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.407612 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.407881 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.408167 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.408445 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.408728 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.409026 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.409302 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.409593 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.409866 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.410144 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.410416 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.410688 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.410993 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.411273 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.411562 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.411851 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.412138 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.412424 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.412709 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.412986 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.413296 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.413573 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:01.413788 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 08 18:04:01.414020 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=102452) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Feb 08 18:04:01.782891 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=102452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 18:04:01.783129 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=102452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 18:04:01.783453 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=102452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Feb 08 18:04:01.783784 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.manager [-] Loading core plugin: ml2 Feb 08 18:04:02.113013 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.113247 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.113525 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.114816 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.115110 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.115371 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.172984 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.173259 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.173526 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.189251 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.189530 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.189800 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.218687 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.218989 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.219267 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.255390 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.255656 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.255919 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.601967 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.602652 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.602652 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.602840 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.603472 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.701855 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.702175 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.702481 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.702805 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.703104 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.703404 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.703664 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.703929 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.704180 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.704446 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.704714 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.704976 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.705232 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.705486 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.705739 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.706001 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.706239 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.706506 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.706790 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.707066 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.707338 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.707592 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.707872 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.708248 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.708498 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.708744 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.709146 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=102452) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Feb 08 18:04:02.709388 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=102452) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Feb 08 18:04:02.709630 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=102452) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Feb 08 18:04:02.709868 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=102452) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Feb 08 18:04:02.710104 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=102452) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Feb 08 18:04:02.710341 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=102452) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Feb 08 18:04:02.710727 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Feb 08 18:04:02.713973 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Feb 08 18:04:02.718186 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Feb 08 18:04:02.721961 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(1050, 1099)])]) Feb 08 18:04:02.723628 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Feb 08 18:04:02.724096 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Feb 08 18:04:02.724440 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Feb 08 18:04:02.724821 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Feb 08 18:04:02.727718 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Feb 08 18:04:02.727961 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Feb 08 18:04:02.728303 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Feb 08 18:04:02.733213 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Feb 08 18:04:02.756079 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Feb 08 18:04:02.756692 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.756992 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=102452) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:88}} Feb 08 18:04:02.757356 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.758791 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=102452) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Feb 08 18:04:02.759069 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Feb 08 18:04:02.759322 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Feb 08 18:04:02.762625 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.762937 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:02.826032 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Feb 08 18:04:02.826266 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Feb 08 18:04:02.826503 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Feb 08 18:04:02.827033 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Feb 08 18:04:02.848964 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_db.sqlalchemy.engines [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102452) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Feb 08 18:04:03.299299 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.managers [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Initializing driver for type 'gre' Feb 08 18:04:03.299752 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] gre ID ranges: [(1, 1000)] Feb 08 18:04:03.351544 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.managers [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Initializing driver for type 'local' Feb 08 18:04:03.351883 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.managers [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Initializing driver for type 'vlan' Feb 08 18:04:03.365846 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] VlanTypeDriver initialization complete Feb 08 18:04:03.366177 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.managers [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Initializing driver for type 'vxlan' Feb 08 18:04:03.366688 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] vxlan ID ranges: [(1, 1000)] Feb 08 18:04:03.416992 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.managers [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Initializing extension driver 'port_security' Feb 08 18:04:03.417360 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.extensions.port_security [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] PortSecurityExtensionDriver initialization complete Feb 08 18:04:03.417766 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.managers [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Initializing mechanism driver 'openvswitch' Feb 08 18:04:03.418090 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.managers [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Initializing mechanism driver 'hyperv' Feb 08 18:04:03.424995 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.plugins.ml2.plugin [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=102452) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:04:03.425834 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > port after_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.426211 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > port after_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.426566 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > port after_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.427125 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=102452) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:111}} Feb 08 18:04:03.427552 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > subnet after_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.427912 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > subnet after_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.428264 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > subnet after_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.428660 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=102452) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:111}} Feb 08 18:04:03.429072 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > network after_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.429423 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > network after_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.429763 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > network after_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.430162 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=102452) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:111}} Feb 08 18:04:03.430567 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > security_group after_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.430955 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > security_group after_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.431295 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > security_group after_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.431692 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=102452) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:111}} Feb 08 18:04:03.432114 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.432448 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.432784 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.433179 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=102452) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:111}} Feb 08 18:04:03.433591 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > address_group after_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.433936 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > address_group after_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.434274 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > address_group after_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.434667 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=102452) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:111}} Feb 08 18:04:03.435141 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] ML2 OVO RPC backend initialized. {{(pid=102452) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:161}} Feb 08 18:04:03.435850 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router_interface after_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.436209 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.436627 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > network before_response 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.437019 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > networks before_response 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.437372 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > port before_response 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.437718 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > ports before_response 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.438045 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > subnet before_response 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.438390 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > subnets before_response 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.438734 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > network after_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.439102 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > network after_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.439440 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > network after_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.439777 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > port after_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.440463 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > port after_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.440802 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > port after_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.441138 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > subnet after_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.441475 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > subnet after_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.441810 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > subnet after_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.450831 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.quota [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded quota_driver: . Feb 08 18:04:03.451221 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.plugin [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Modular L2 Plugin initialization complete Feb 08 18:04:03.451564 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading services supported by the core plugin {{(pid=102452) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Feb 08 18:04:03.451906 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.plugins.ml2.managers [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Got port-security extension from driver 'port_security' Feb 08 18:04:03.452388 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.extensions.vlantransparent [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Disabled vlantransparent extension. Feb 08 18:04:03.452886 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=102452) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Feb 08 18:04:03.453214 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading Plugin: router Feb 08 18:04:03.489157 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router_interface before_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.489558 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router after_create 55549900 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.489931 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router before_create 55549900 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.490284 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router_interface before_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.490673 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.491162 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router after_delete 55549900 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.491525 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > floatingip after_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.491878 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > floatingip after_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.492246 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router after_create 55549900 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.492592 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router after_update 55549900 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.492950 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router after_update 55549900 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.493296 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.493774 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router after_update 55549900 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.494108 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router precommit_update 55549900 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.494482 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: port after_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.494850 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: port after_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.495191 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: subnet after_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.495536 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.495887 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > port precommit_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.496238 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router precommit_create 55549900 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.496582 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: port before_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.496923 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router precommit_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.497280 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router after_update 55549900 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.497625 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router precommit_delete 55549900 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.498088 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router precommit_create 55549900 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.498452 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router_interface after_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.498828 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router precommit_update 55549900 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.499277 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > agent after_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.499861 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > agent after_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.500347 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > network after_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.501223 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Tracking information for resource: router configured {{(pid=102452) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Feb 08 18:04:03.501559 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Tracking information for resource: floatingip configured {{(pid=102452) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Feb 08 18:04:03.506595 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.db.l3_agentschedulers_db [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Feb 08 18:04:03.507256 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: port after_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.507606 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: port after_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.507959 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: port after_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.508313 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: port after_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.509122 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router before_create 55550100 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.509488 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router precommit_delete 55550100 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.509849 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router precommit_create 55550100 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.510207 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > router precommit_update 55550100 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.515175 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.services.provider_configuration [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Service providers = [] {{(pid=102452) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Feb 08 18:04:03.515546 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.db.servicetype_db [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=102452) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Feb 08 18:04:03.518539 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.services.service_base [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=102452) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Feb 08 18:04:03.518928 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.services.service_base [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=102452) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Feb 08 18:04:03.519272 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.services.service_base [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=102452) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Feb 08 18:04:03.520169 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.services.service_base [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=102452) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Feb 08 18:04:03.520539 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.services.service_base [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Default provider is not specified for service type L3_ROUTER_NAT Feb 08 18:04:03.520930 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=102452) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Feb 08 18:04:03.521246 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Feb 08 18:04:03.532378 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Successfully loaded METERING plugin. Description: METERING {{(pid=102452) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Feb 08 18:04:03.532716 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading Plugin: auto_allocate Feb 08 18:04:03.538571 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: network precommit_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.538983 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: network precommit_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.539515 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=102452) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Feb 08 18:04:03.539833 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading Plugin: tag Feb 08 18:04:03.546793 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=102452) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Feb 08 18:04:03.547134 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading Plugin: timestamp Feb 08 18:04:03.551127 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=102452) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Feb 08 18:04:03.551394 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading Plugin: network_ip_availability Feb 08 18:04:03.556992 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.557366 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.557723 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.558437 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=102452) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Feb 08 18:04:03.558760 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading Plugin: flavors Feb 08 18:04:03.563854 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=102452) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Feb 08 18:04:03.564187 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading Plugin: revisions Feb 08 18:04:03.568939 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=102452) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Feb 08 18:04:03.569332 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_concurrency.lockutils [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.786s {{(pid=102452) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Feb 08 18:04:03.570077 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=102452) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Feb 08 18:04:03.570412 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Initializing extension manager. Feb 08 18:04:03.570969 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: __init__.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.571321 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: __pycache__ {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.571663 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.571994 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: address_group.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.572767 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.573340 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: address-group Feb 08 18:04:03.573646 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: address_scope.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.574369 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.574925 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: address-scope Feb 08 18:04:03.575253 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: admin_state_down_before_update.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.576191 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.576701 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: router-admin-state-down-before-update Feb 08 18:04:03.577027 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: agent.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.577755 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.578255 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: agent Feb 08 18:04:03.578581 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: agent_resources_synced.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.579525 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.580082 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: agent-resources-synced Feb 08 18:04:03.580408 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: allowedaddresspairs.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.582222 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.582741 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: allowed-address-pairs Feb 08 18:04:03.583100 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: auto_allocated_topology.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.584200 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.584718 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: auto-allocated-topology Feb 08 18:04:03.585043 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: availability_zone.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.585742 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.586256 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: availability_zone Feb 08 18:04:03.586635 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: availability_zone_filter.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.587588 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.588102 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: availability_zone_filter Feb 08 18:04:03.588428 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: data_plane_status.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.589351 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.589853 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension data-plane-status not supported by any of loaded plugins Feb 08 18:04:03.590181 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: default_subnetpools.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.591138 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.591649 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: default-subnetpools Feb 08 18:04:03.591967 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: dhcpagentscheduler.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.592787 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.593346 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: dhcp_agent_scheduler Feb 08 18:04:03.593671 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: dns.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.594589 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.595111 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension dns-integration not supported by any of loaded plugins Feb 08 18:04:03.595433 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: dns_domain_ports.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.596353 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.596855 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension dns-domain-ports not supported by any of loaded plugins Feb 08 18:04:03.597175 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.598101 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.598601 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Feb 08 18:04:03.598956 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: dvr.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.599641 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.600145 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: dvr Feb 08 18:04:03.600474 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: ecmp_routes.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.601398 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.601902 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension ecmp_routes not supported by any of loaded plugins Feb 08 18:04:03.602227 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: empty_string_filtering.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.603198 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.603705 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: empty-string-filtering Feb 08 18:04:03.604030 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.604952 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.605456 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Feb 08 18:04:03.605779 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.606704 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.607238 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Feb 08 18:04:03.607560 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: external_net.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.608475 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.609003 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: external-net Feb 08 18:04:03.609336 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: extra_dhcp_opt.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.610292 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.610802 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: extra_dhcp_opt Feb 08 18:04:03.611152 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: extraroute.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.612074 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.612585 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: extraroute Feb 08 18:04:03.612907 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: extraroute_atomic.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.613947 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.614456 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: extraroute-atomic Feb 08 18:04:03.614788 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: filter_validation.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.615477 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.615975 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: filter-validation Feb 08 18:04:03.616310 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: fip_pf_description.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.617261 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.617766 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Feb 08 18:04:03.618090 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: fip_port_details.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.619217 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.619729 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: fip-port-details Feb 08 18:04:03.620055 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: flavors.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.621337 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.621850 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: flavors Feb 08 18:04:03.622177 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.623947 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.624523 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Feb 08 18:04:03.624878 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: floatingip_pools.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.625584 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.626091 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: floatingip-pools Feb 08 18:04:03.626420 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: ip_allocation.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.627390 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.627889 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension ip_allocation not supported by any of loaded plugins Feb 08 18:04:03.628214 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: ip_substring_port_filtering.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.629141 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.629654 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: ip-substring-filtering Feb 08 18:04:03.629979 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: l2_adjacency.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.630947 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.631455 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension l2_adjacency not supported by any of loaded plugins Feb 08 18:04:03.631767 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: l3.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.632736 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.633247 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: router Feb 08 18:04:03.633596 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: l3_conntrack_helper.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.636128 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.636670 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension l3-conntrack-helper not supported by any of loaded plugins Feb 08 18:04:03.637065 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: l3_ext_gw_mode.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.638247 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.638837 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: ext-gw-mode Feb 08 18:04:03.639286 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: l3_ext_ha_mode.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.640386 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.640929 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: l3-ha Feb 08 18:04:03.641342 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: l3_ext_ndp_proxy.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.642417 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Router support to enable NDP proxy" alias="l3-ext-ndp-proxy" description="Router extension to enable ndp proxy" updated="2020-08-25T00:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.643115 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension l3-ext-ndp-proxy not supported by any of loaded plugins Feb 08 18:04:03.643482 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: l3_flavors.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.644535 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.645202 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: l3-flavors Feb 08 18:04:03.645534 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: l3_ndp_proxy.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.647130 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="name" alias="l3-ndp-proxy" description="description" updated="2021-06-29T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.647723 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension l3-ndp-proxy not supported by any of loaded plugins Feb 08 18:04:03.648092 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.649147 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.649717 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: l3-port-ip-change-not-allowed Feb 08 18:04:03.650169 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: l3agentscheduler.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.651373 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.651976 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: l3_agent_scheduler Feb 08 18:04:03.652378 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: local_ip.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.654477 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.655069 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension local_ip not supported by any of loaded plugins Feb 08 18:04:03.655459 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: logging.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.657114 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.657639 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension logging not supported by any of loaded plugins Feb 08 18:04:03.657972 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: metering.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.658726 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.659331 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: metering Feb 08 18:04:03.659664 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.660772 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.661294 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: metering_source_and_destination_fields Feb 08 18:04:03.661616 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: multiprovidernet.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.662549 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.663097 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: multi-provider Feb 08 18:04:03.663427 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: netmtu.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.664389 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.664903 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: net-mtu Feb 08 18:04:03.665227 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: netmtu_writable.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.666151 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.666664 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: net-mtu-writable Feb 08 18:04:03.667022 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: network_availability_zone.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.667706 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.668210 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: network_availability_zone Feb 08 18:04:03.668533 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: network_ip_availability.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.669675 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.670187 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: network-ip-availability Feb 08 18:04:03.670509 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: network_segment_range.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.671334 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.671836 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension network-segment-range not supported by any of loaded plugins Feb 08 18:04:03.672158 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: pagination.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.673148 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.673478 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: pagination Feb 08 18:04:03.673801 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: port_device_profile.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.674735 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.675285 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: port-device-profile Feb 08 18:04:03.675609 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: port_mac_address_regenerate.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.676534 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.677042 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: port-mac-address-regenerate Feb 08 18:04:03.677366 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: port_numa_affinity_policy.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.678289 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.678825 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: port-numa-affinity-policy Feb 08 18:04:03.679153 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: port_resource_request.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.680076 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.680579 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension port-resource-request not supported by any of loaded plugins Feb 08 18:04:03.680910 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: port_resource_request_groups.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.681883 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.682385 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension port-resource-request-groups not supported by any of loaded plugins Feb 08 18:04:03.682709 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: portbindings.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.683662 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.684173 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: binding Feb 08 18:04:03.684498 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: portbindings_extended.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.685780 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.686292 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: binding-extended Feb 08 18:04:03.686712 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: portsecurity.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.687684 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.688197 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: port-security Feb 08 18:04:03.688521 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: project_id.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.689513 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.689842 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: project-id Feb 08 18:04:03.690521 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: providernet.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.691490 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.692004 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: provider Feb 08 18:04:03.692329 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: qos.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.695972 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.696501 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension qos not supported by any of loaded plugins Feb 08 18:04:03.696834 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: qos_bw_limit_direction.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.698095 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.698648 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Feb 08 18:04:03.698995 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.699924 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.700435 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Feb 08 18:04:03.700759 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: qos_default.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.701689 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.702194 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension qos-default not supported by any of loaded plugins Feb 08 18:04:03.702575 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: qos_fip.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.703551 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.704056 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension qos-fip not supported by any of loaded plugins Feb 08 18:04:03.704385 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: qos_fip_network_policy.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.705309 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="QoS floating IP network policy ID" alias="qos-fip-network-policy" description="Adds a the QoS network ID to the floating IP definition" updated="2021-11-15T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.705816 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension qos-fip-network-policy not supported by any of loaded plugins Feb 08 18:04:03.706140 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: qos_gateway_ip.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.707216 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.707725 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension qos-gateway-ip not supported by any of loaded plugins Feb 08 18:04:03.708038 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: qos_port_network_policy.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.709000 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.709512 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension qos-port-network-policy not supported by any of loaded plugins Feb 08 18:04:03.709828 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.710922 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.711435 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension qos-pps-minimum not supported by any of loaded plugins Feb 08 18:04:03.711764 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: qos_pps_rule.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.712955 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.713468 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension qos-pps not supported by any of loaded plugins Feb 08 18:04:03.713792 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: qos_rule_type_details.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.714787 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.715297 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension qos-rule-type-details not supported by any of loaded plugins Feb 08 18:04:03.715623 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: qos_rules_alias.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.716677 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.717189 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension qos-rules-alias not supported by any of loaded plugins Feb 08 18:04:03.717515 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: quota_check_limit.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.718551 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.719102 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: quota-check-limit Feb 08 18:04:03.719431 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: quotasv2.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.720367 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.720698 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: quotas Feb 08 18:04:03.721026 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: quotasv2_detail.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.722873 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.723212 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: quota_details Feb 08 18:04:03.723544 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: rbac.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.724611 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.725133 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: rbac-policies Feb 08 18:04:03.725463 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: rbac_address_group.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.726411 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.726967 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: rbac-address-group Feb 08 18:04:03.727295 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: rbac_address_scope.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.728224 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.728737 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: rbac-address-scope Feb 08 18:04:03.729063 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: rbac_security_groups.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.729992 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.730502 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: rbac-security-groups Feb 08 18:04:03.730853 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: rbac_subnetpool.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.731797 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.732286 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: rbac-subnetpool Feb 08 18:04:03.732607 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: revisionifmatch.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.733607 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.734120 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: revision-if-match Feb 08 18:04:03.734446 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: revisions.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.735740 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.736253 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: standard-attr-revisions Feb 08 18:04:03.736573 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: router_availability_zone.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.737251 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.737757 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: router_availability_zone Feb 08 18:04:03.738079 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: routerservicetype.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.739064 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.739571 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension router-service-type not supported by any of loaded plugins Feb 08 18:04:03.739896 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.740832 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.741342 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: security-groups-normalized-cidr Feb 08 18:04:03.741663 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: security_groups_port_filtering.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.742592 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.743138 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: port-security-groups-filtering Feb 08 18:04:03.743459 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: security_groups_remote_address_group.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.744568 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.745128 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: security-groups-remote-address-group Feb 08 18:04:03.745507 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: security_groups_shared_filtering.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.746635 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.747318 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: security-groups-shared-filtering Feb 08 18:04:03.747789 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.748430 dv-cinder-773985-21-iscsi neutron-server[102452]: WARNING neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Feb 08 18:04:03.748749 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: securitygroup.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.759947 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.760478 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: security-group Feb 08 18:04:03.760820 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: segment.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.761618 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.762126 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension segment not supported by any of loaded plugins Feb 08 18:04:03.762452 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.763434 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.763946 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Feb 08 18:04:03.764271 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: servicetype.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.765452 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.765970 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: service-type Feb 08 18:04:03.766295 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: sorting.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.767324 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.767657 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: sorting Feb 08 18:04:03.767960 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: standard_attr_segment.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.768883 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.769390 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension standard-attr-segment not supported by any of loaded plugins Feb 08 18:04:03.769713 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: standardattrdescription.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.770363 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.770890 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: standard-attr-description Feb 08 18:04:03.771221 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: stateful_security_group.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.772181 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.772688 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: stateful-security-group Feb 08 18:04:03.773014 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: stdattrs_common.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.773586 dv-cinder-773985-21-iscsi neutron-server[102452]: WARNING neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Feb 08 18:04:03.773905 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.774870 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.775384 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Feb 08 18:04:03.775708 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: subnet_onboard.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.776793 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.777313 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: subnet_onboard Feb 08 18:04:03.777638 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: subnet_segmentid_writable.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.778571 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.779104 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Feb 08 18:04:03.779427 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: subnet_service_types.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.780474 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.781020 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: subnet-service-types Feb 08 18:04:03.781350 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: subnetallocation.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.782440 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.786324 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: subnet_allocation Feb 08 18:04:03.786324 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.786324 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.786324 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: subnetpool-prefix-ops Feb 08 18:04:03.786324 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.786324 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.786324 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Feb 08 18:04:03.786870 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: tagging.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.787898 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.788565 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: standard-attr-tag Feb 08 18:04:03.788565 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: timestamp.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.789645 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.790156 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loaded extension: standard-attr-timestamp Feb 08 18:04:03.790487 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: trunk.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.791571 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.792083 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension trunk not supported by any of loaded plugins Feb 08 18:04:03.792407 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: trunk_details.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.793344 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.793852 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension trunk-details not supported by any of loaded plugins Feb 08 18:04:03.794180 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: uplink_status_propagation.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.795138 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.795645 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension uplink-status-propagation not supported by any of loaded plugins Feb 08 18:04:03.795972 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Loading extension file: vlantransparent.py {{(pid=102452) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Feb 08 18:04:03.796749 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=102452) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Feb 08 18:04:03.797254 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extension vlan-transparent not supported by any of loaded plugins Feb 08 18:04:03.799909 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Creating instance of TrackedResource for resource:network Feb 08 18:04:03.800429 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Creating instance of TrackedResource for resource:subnet Feb 08 18:04:03.800828 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Creating instance of TrackedResource for resource:subnetpool Feb 08 18:04:03.801268 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Creating instance of TrackedResource for resource:port Feb 08 18:04:03.802475 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.v2.resource_helper [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102452) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Feb 08 18:04:03.803061 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.v2.resource_helper [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Service FLAVORS assigned prefix: {{(pid=102452) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Feb 08 18:04:03.803766 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.v2.resource_helper [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102452) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Feb 08 18:04:03.804287 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.v2.resource_helper [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102452) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Feb 08 18:04:03.804858 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Creating instance of TrackedResource for resource:router Feb 08 18:04:03.805319 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Creating instance of TrackedResource for resource:floatingip Feb 08 18:04:03.805807 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.v2.resource_helper [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Service METERING assigned prefix: /metering {{(pid=102452) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Feb 08 18:04:03.807319 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.807691 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.808074 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102452) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:04:03.809091 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Creating instance of CountableResource for resource:rbac_policy Feb 08 18:04:03.811865 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Creating instance of TrackedResource for resource:security_group Feb 08 18:04:03.811865 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Creating instance of TrackedResource for resource:security_group_rule Feb 08 18:04:03.811865 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.v2.resource_helper [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Service CORE assigned prefix: {{(pid=102452) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Feb 08 18:04:03.811865 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Creating instance of TrackedResource for resource:subnetpool Feb 08 18:04:03.811865 dv-cinder-773985-21-iscsi neutron-server[102452]: WARNING neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] subnetpool is already registered Feb 08 18:04:03.811865 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.v2.resource_helper [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Service CORE assigned prefix: {{(pid=102452) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Feb 08 18:04:03.812419 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Creating instance of TrackedResource for resource:subnetpool Feb 08 18:04:03.812419 dv-cinder-773985-21-iscsi neutron-server[102452]: WARNING neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] subnetpool is already registered Feb 08 18:04:03.814662 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.v2.resource_helper [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102452) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Feb 08 18:04:03.815450 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.v2.resource_helper [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Service FLAVORS assigned prefix: {{(pid=102452) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Feb 08 18:04:03.816105 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.v2.resource_helper [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102452) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Feb 08 18:04:03.816523 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.v2.resource_helper [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102452) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Feb 08 18:04:03.816858 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Creating instance of TrackedResource for resource:router Feb 08 18:04:03.817196 dv-cinder-773985-21-iscsi neutron-server[102452]: WARNING neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] router is already registered Feb 08 18:04:03.817609 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Creating instance of TrackedResource for resource:floatingip Feb 08 18:04:03.817944 dv-cinder-773985-21-iscsi neutron-server[102452]: WARNING neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] floatingip is already registered Feb 08 18:04:03.818396 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.v2.resource_helper [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Service METERING assigned prefix: /metering {{(pid=102452) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Feb 08 18:04:03.819190 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Creating instance of CountableResource for resource:rbac_policy Feb 08 18:04:03.819519 dv-cinder-773985-21-iscsi neutron-server[102452]: WARNING neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] rbac_policy is already registered Feb 08 18:04:03.819928 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Creating instance of TrackedResource for resource:security_group Feb 08 18:04:03.820257 dv-cinder-773985-21-iscsi neutron-server[102452]: WARNING neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] security_group is already registered Feb 08 18:04:03.820665 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Creating instance of TrackedResource for resource:security_group_rule Feb 08 18:04:03.820999 dv-cinder-773985-21-iscsi neutron-server[102452]: WARNING neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] security_group_rule is already registered Feb 08 18:04:03.821603 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.v2.resource_helper [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Service CORE assigned prefix: {{(pid=102452) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Feb 08 18:04:03.821929 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Creating instance of TrackedResource for resource:subnetpool Feb 08 18:04:03.822259 dv-cinder-773985-21-iscsi neutron-server[102452]: WARNING neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] subnetpool is already registered Feb 08 18:04:03.822685 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.v2.resource_helper [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Service CORE assigned prefix: {{(pid=102452) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Feb 08 18:04:03.823035 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Creating instance of TrackedResource for resource:subnetpool Feb 08 18:04:03.823367 dv-cinder-773985-21-iscsi neutron-server[102452]: WARNING neutron.quota.resource_registry [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] subnetpool is already registered Feb 08 18:04:03.823831 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: extensions {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.825360 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: address-groups {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.826896 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: address-scopes {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.828334 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: agents {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.829516 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: auto-allocated-topology {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.830844 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: availability_zones {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.832062 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: dhcp-networks {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.833576 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: dhcp-agents {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.835066 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: routers {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.837300 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: flavors {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.838493 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: service_profiles {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.839735 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: next_providers {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.841220 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: service_profiles {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.842800 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: floatingip-pools {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.844070 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: routers {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.846219 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: floatingips {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.847513 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: l3-routers {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.848934 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: l3-agents {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.850367 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: metering-labels {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.851764 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: metering-label-rules {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.853049 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: network-ip-availabilities {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.854313 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: bindings {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.856052 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: quotas {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.857627 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: quotas {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.859315 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: rbac-policies {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.861569 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: security-groups {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.862860 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: security-group-rules {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.864110 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: service-providers {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.865340 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: subnetpools {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.866787 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: subnetpools {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.868251 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: tags {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.870099 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: tags {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.872273 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: tags {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.874098 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: tags {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.875934 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: tags {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.877845 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: tags {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.879820 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: tags {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.881752 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: tags {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.883554 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: tags {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.885428 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron.api.extensions [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Extended resource: tags {{(pid=102452) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Feb 08 18:04:03.891595 dv-cinder-773985-21-iscsi neutron-server[102452]: WARNING keystonemiddleware.auth_token [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Feb 08 18:04:03.896353 dv-cinder-773985-21-iscsi neutron-server[102452]: WARNING keystonemiddleware.auth_token [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Feb 08 18:04:03.905004 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_concurrency.lockutils [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Acquired lock "singleton_lock" {{(pid=102452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Feb 08 18:04:03.905506 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_concurrency.lockutils [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Releasing lock "singleton_lock" {{(pid=102452) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Feb 08 18:04:03.906162 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO oslo_service.service [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Starting 2 workers Feb 08 18:04:03.911071 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Started child 102559 {{(pid=102452) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Feb 08 18:04:03.915720 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Started child 102560 {{(pid=102452) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Feb 08 18:04:03.916592 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process (None), after_init {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:03.917272 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO neutron.service [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Neutron service started, listening on 0.0.0.0:9696 Feb 08 18:04:03.917738 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Publish callbacks [] for process (None), before_spawn {{(pid=102452) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:03.918190 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [-] (102559) wsgi starting up on http://0.0.0.0:9696 Feb 08 18:04:03.920212 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO oslo_service.service [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Starting 1 workers Feb 08 18:04:03.920350 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process (None), after_init {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:03.921772 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [-] (102560) wsgi starting up on http://0.0.0.0:9696 Feb 08 18:04:03.925535 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Started child 102561 {{(pid=102452) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Feb 08 18:04:03.926604 dv-cinder-773985-21-iscsi neutron-server[102452]: INFO oslo_service.service [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Starting 1 workers Feb 08 18:04:03.929608 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.service [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] calling RpcWorker wait() {{(pid=102561) _wait /opt/stack/neutron/neutron/service.py:128}} Feb 08 18:04:03.930192 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.service [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] returning from RpcWorker wait() {{(pid=102561) _wait /opt/stack/neutron/neutron/service.py:135}} Feb 08 18:04:03.931170 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Started child 102562 {{(pid=102452) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Feb 08 18:04:03.931299 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process (None), after_init {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:03.931823 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:04:03.931948 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG neutron_lib.callbacks.manager [None req-01b33c31-0bf9-4377-8fed-da73c3d2205f None None] Publish callbacks [] for process (None), after_spawn {{(pid=102452) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:03.933849 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102452) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Feb 08 18:04:03.934034 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 08 18:04:03.934379 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 08 18:04:03.934754 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 08 18:04:03.935252 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 08 18:04:03.935578 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 08 18:04:03.936217 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process (None), after_init {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:03.936727 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.936727 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.936859 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.937126 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.937413 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:04:03.937569 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.937970 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.938198 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.938587 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.939046 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.939451 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.939770 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.940436 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.940827 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.941243 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.941773 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.942190 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.942572 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.943008 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.943322 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.943722 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.944157 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.944537 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.944949 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] debug = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.945333 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.945963 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.946358 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.946747 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.947158 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.947589 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.947960 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.948391 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.948761 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.949134 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.949510 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.949899 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.950288 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.950658 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.951093 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.951470 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.951865 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.952298 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.952907 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] host = dv-cinder-773985-21-iscsi {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.953284 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.953656 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.954042 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.954439 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.954857 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.955279 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.955588 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.955969 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.956491 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.956696 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.957168 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.957404 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.957576 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.958034 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] log_file = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.958264 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] log_options = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.958690 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.959077 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.959309 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.959695 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.959865 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.960023 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.960425 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.960721 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.961123 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.961483 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.961901 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.962062 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.962466 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.962691 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.966405 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.966687 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.966979 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.967221 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.967535 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.967781 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.968036 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.971865 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.972137 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.972381 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.972621 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.972861 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.973108 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.973299 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.973545 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.973780 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.974017 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.974319 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.974509 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.974747 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.975063 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.976049 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.976286 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.976524 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.976793 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.977023 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.977270 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.977520 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.977737 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.977968 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.978183 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.978388 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.978610 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] use_json = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.978844 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.979078 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.979310 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.979537 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.979794 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.979978 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.980209 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.980457 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.980674 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] wsgi_server_debug = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:03.981106 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.981398 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.981692 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.981942 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.982173 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.982411 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.982642 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.982900 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.983150 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.983383 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.983755 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.983984 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.984300 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.984554 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.984824 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.985159 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.985540 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.985813 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.986015 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.986382 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.986740 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.987135 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.987611 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.987802 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.988211 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.988631 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.988991 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.989424 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.989829 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.990348 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.990600 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.990888 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.118/identity {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.991144 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.991391 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.991628 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.991849 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.992065 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.992308 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.992523 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.992819 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.993030 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.993246 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.993902 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.994132 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.994362 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.994629 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.994904 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.995171 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.995470 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.995700 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.995913 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.996125 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.996338 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.996584 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.996834 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.997047 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.997276 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.997537 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.997756 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.997966 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.998195 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.998415 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.998658 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.998904 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.999161 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.999380 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.999581 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:03.999846 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.000102 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.000280 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.000752 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.001116 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.001536 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.001730 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.001986 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.002198 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.002410 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.002642 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.002876 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.003091 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.003315 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.003516 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.003732 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.003954 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.004195 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.004381 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.004800 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.004981 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.005342 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.005650 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.005860 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.006277 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.006747 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.007014 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.007250 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.007482 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.007753 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.008003 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.008252 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.008481 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.008700 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.008908 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.009176 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.009416 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.009643 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.009893 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.010102 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.010331 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.010560 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.010844 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.011059 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.011288 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.011517 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.011813 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.012038 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.012291 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.012541 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.012790 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.013062 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.013276 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.013536 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.013972 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.014246 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.014535 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.014929 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.015453 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.016131 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.016382 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.016789 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.017039 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.017294 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.017541 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.017769 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.017987 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.018232 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.018451 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.018665 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.018932 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.019234 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.019458 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.019684 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.019910 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.020160 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.020412 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.020644 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.020901 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.021142 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.021366 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.021614 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.021841 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.118/identity {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.022067 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.022295 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.022517 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.022941 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.023175 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.023390 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.023626 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.023837 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.024047 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.024274 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.024498 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.024800 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.025155 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.025525 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.025877 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.026340 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.026556 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.026859 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.027118 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.027363 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.027564 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.027776 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.027984 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.028227 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.028882 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 33438) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:04:04.031011 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.031336 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.031616 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.031859 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.032105 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.032376 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.032655 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.032886 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.033163 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.033399 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.033623 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.033846 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.034096 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.034316 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.034545 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.034806 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.035042 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.035313 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.035573 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.035931 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.036199 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.036430 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.036702 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.dead_timeout = 60.0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.036953 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.037477 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [-] 10.222.0.118 "GET / HTTP/1.1" status: 200 len: 254 time: 0.0063553 Feb 08 18:04:04.037832 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.enable_retry_client = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.038258 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.enable_socket_keepalive = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.038649 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.038929 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.039162 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.hashclient_retry_attempts = 2 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.039397 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.hashclient_retry_delay = 1.0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.039623 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.039849 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.040075 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.040299 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.040538 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.040802 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.041048 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.041293 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.041515 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.retry_attempts = 2 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.041762 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.retry_delay = 0.0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.042002 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.socket_keepalive_count = 1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.042239 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.socket_keepalive_idle = 1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.042652 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.socket_keepalive_interval = 1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.042937 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:04:04.043255 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.043666 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.044057 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.044468 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.044880 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.045185 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.045451 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.045684 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.046153 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.046544 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.047026 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.047298 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.048291 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.048291 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.048291 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.048509 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.048627 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.048885 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.049134 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.050135 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.050135 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.050135 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.050135 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.050135 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.050501 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.050600 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.050853 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.051072 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.051355 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.051545 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.051759 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.051972 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.052194 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.052412 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.052644 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.053588 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.053588 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.053588 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.053588 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.053852 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.053921 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.054549 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.054549 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.054716 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.054953 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.055186 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.056104 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.056104 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.056104 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.056315 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.056409 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.056649 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.057161 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.057161 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.057328 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.057662 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.057952 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.058197 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.058457 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.058742 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.059097 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:1050:1099'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.059368 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.059586 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.059980 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.060334 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.061386 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.061386 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.061386 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.061386 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.061807 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.061807 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.062057 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.062288 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.062504 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.062788 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.063037 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.063414 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.063803 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.064028 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.065447 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.065447 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.065447 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.065447 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.065719 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.065785 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 08 18:04:04.066279 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102452) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Feb 08 18:04:04.066443 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Feb 08 18:04:04.066609 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Feb 08 18:04:04.066799 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Feb 08 18:04:04.066984 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Feb 08 18:04:04.067138 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Feb 08 18:04:04.067350 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.067513 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.067675 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.067837 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.067997 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.068180 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.068341 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.068649 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.068956 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.069254 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.069559 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.069728 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.069887 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.070027 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.070190 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.070348 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.070505 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.070665 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.070861 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.071025 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.071186 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.071344 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.071502 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] debug = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.071656 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.071869 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.072040 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.072192 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.072351 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.072495 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.072707 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.072809 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.072949 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.073471 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.073471 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.073471 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.073680 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.073680 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.073898 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.074382 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.074538 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.074907 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.075701 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] host = dv-cinder-773985-21-iscsi {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.075701 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.075701 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.075701 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.075701 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.076034 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.076275 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.076444 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.076605 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.076767 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.076966 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.077232 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.077444 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.077682 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.077849 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] log_file = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.078223 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] log_options = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.078383 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.078540 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.078695 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.078915 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.079212 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.079380 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.079541 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.079702 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.079869 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.080011 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.080171 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.080329 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.080488 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.080646 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.080807 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.080966 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.081127 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.082284 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.082284 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.082284 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.082284 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.082284 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.082284 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.082284 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.082690 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.082690 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.082690 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.082915 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.083161 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.083161 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.084650 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.084812 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.084952 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.085090 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.085239 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.085374 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.085519 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.085653 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.085995 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.086206 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.086376 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.087276 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.087276 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.087276 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.087276 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.087276 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.087949 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] use_json = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.087949 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.087949 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.088339 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.088339 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.088339 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.088550 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.088550 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.088698 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.088862 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] wsgi_server_debug = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Feb 08 18:04:04.089057 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.089410 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.089799 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.090892 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.090892 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.090892 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.090892 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.091451 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.091451 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.091451 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.091657 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.091734 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.092181 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.092181 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.092325 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.092389 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.092527 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.092649 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.092833 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.093117 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.093946 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.094127 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.094326 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.094497 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.094648 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.094837 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.095140 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.095437 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.095751 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.095933 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.096137 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.096315 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.118/identity {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.096511 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.096680 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.096899 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.097069 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.097233 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.097397 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.097563 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.097726 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.097891 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.098051 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.098216 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.098378 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.098542 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.098704 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.098896 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.099066 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.099230 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.099394 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.099559 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.099722 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.099885 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.100046 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.100209 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.100375 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.100540 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.100714 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.100970 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.101133 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.101300 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.101459 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.101622 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.101789 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.102180 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.102180 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.102351 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.102425 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.102574 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.102733 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.102919 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.103082 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.103281 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.103408 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.103570 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.103734 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.103895 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.104057 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.104219 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.104380 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.104541 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.104704 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.104866 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.105028 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.105190 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.105353 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.105513 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.105674 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.105835 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.105999 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.106162 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.106333 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.106511 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.106675 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.106874 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.107037 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.107199 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.107362 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.107524 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.108482 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.108482 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.108482 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.108482 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.108482 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.108482 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.108914 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.108914 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.108914 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.109135 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.109379 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.109670 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.110005 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.110274 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.110552 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.110787 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.110884 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.111004 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.111165 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.111338 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.111504 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.111771 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.111900 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.112076 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.112249 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.112411 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.112560 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.112725 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.112885 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.113047 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.113208 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.113371 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.113533 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.113694 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.113856 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.114074 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.114395 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.114395 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.114545 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.114683 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.114866 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.115023 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.115164 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.115326 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.115488 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.115653 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.115819 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.116063 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.116261 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.116424 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.116586 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.118/identity {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.116748 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.116958 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.117066 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.117211 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.117375 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.117537 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.117699 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.117862 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.118008 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.118173 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.118334 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.118495 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.118657 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.118842 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.119012 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.119174 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.119337 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.119498 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.119658 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.119819 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.119981 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.120143 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.120304 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.120465 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.120627 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.120792 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.120955 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.121120 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.121284 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.121448 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.121610 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.121773 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.121937 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.122098 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.122264 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.122428 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.122590 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.122752 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.122965 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.123803 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.123803 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.123803 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.123803 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.123803 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.124406 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.124406 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.124406 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.dead_timeout = 60.0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.124767 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.124882 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.enable_retry_client = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.125045 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.enable_socket_keepalive = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.125209 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.125373 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.125535 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.hashclient_retry_attempts = 2 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.125701 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.hashclient_retry_delay = 1.0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.125872 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.126036 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.126198 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.126360 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.126521 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.126687 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.126876 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.127041 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.127206 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.retry_attempts = 2 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.127371 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.retry_delay = 0.0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.127544 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.socket_keepalive_count = 1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.127695 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.socket_keepalive_idle = 1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.127921 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.socket_keepalive_interval = 1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.128063 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.128188 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.128311 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.128491 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.128641 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.128769 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.128940 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.129099 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.129264 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.129428 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.129595 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.129768 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.129929 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.130091 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.130312 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.130401 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.130550 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.130723 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.130949 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.131115 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.131256 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.131394 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.131553 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.131696 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.131832 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.131968 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.132118 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.132280 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.132443 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.132614 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.132776 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.132940 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.133102 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.133272 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.133430 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.133596 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.133746 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.133910 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.134074 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.134235 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.134393 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.134555 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.134718 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.135736 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.135916 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.136081 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.136244 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.136407 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.136584 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.136750 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.136916 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.137081 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.137245 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.137408 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.137574 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.137743 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.137915 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.138089 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.138252 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.138425 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.138597 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:1050:1099'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.138849 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.138983 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.139109 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.139282 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.139446 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.139610 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.139814 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.139978 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.140141 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.140304 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.140466 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.140628 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.140789 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.140952 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.141115 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.141277 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.141439 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.141601 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.141765 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.141929 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.142092 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.142243 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.142405 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Feb 08 18:04:04.142561 dv-cinder-773985-21-iscsi neutron-server[102452]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102452) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Feb 08 18:04:15.389207 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-670e105c-7cde-4197-aac3-a37fb4003a37 None None] get_active_networks_info from dv-cinder-773985-21-iscsi {{(pid=102561) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:159}} Feb 08 18:04:15.444493 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-670e105c-7cde-4197-aac3-a37fb4003a37 None None] No non-hosted networks {{(pid=102561) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Feb 08 18:04:15.460225 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.agentschedulers_db [None req-670e105c-7cde-4197-aac3-a37fb4003a37 None None] DHCP Agent not found on host dv-cinder-773985-21-iscsi {{(pid=102561) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Feb 08 18:04:15.556283 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-11009c1f-6bf7-4f27-bd33-17b206b1e02b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-560067'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:17.774904 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-70a58a1d-1ee9-48d3-ab6d-d89b3e7e6a01 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-560067'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:17.804926 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ed21c869-6fa5-4960-9ee3-d64505442c9b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:18.454402 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-560067'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:20.086273 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-560067'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:21.621485 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-560067'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:21.622920 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:21.623630 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:21.623968 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:21.624711 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:21.625001 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:21.625509 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:21.625839 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:21.626877 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:21.627396 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:21.629001 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:21.629608 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:21.630115 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:21.630664 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:21.632236 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-773985-21-iscsi', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2', 'LocalIPAssociation': '1.0'}) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:04:21.644954 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-773985-21-iscsi', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2', 'LocalIPAssociation': '1.0'}} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:04:21.888726 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.db.l3_hamode_db [None req-de2738f4-9192-4472-a93d-48ca4de512cf None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Feb 08 18:04:21.967630 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de2738f4-9192-4472-a93d-48ca4de512cf None None] Routers set() bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:04:21.968265 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de2738f4-9192-4472-a93d-48ca4de512cf None None] Router IDs set() for agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:463}} Feb 08 18:04:24.032041 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 33538) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:04:24.563273 dv-cinder-773985-21-iscsi neutron-server[102560]: WARNING oslo_policy.policy [None req-da492ca3-d8a4-4d24-8017-2e506092ba80 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Feb 08 18:04:24.563832 dv-cinder-773985-21-iscsi neutron-server[102560]: WARNING oslo_policy.policy [None req-da492ca3-d8a4-4d24-8017-2e506092ba80 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Feb 08 18:04:24.783748 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [None req-da492ca3-d8a4-4d24-8017-2e506092ba80 admin admin] http://10.222.0.118:9696/v2.0/extensions returned with HTTP 200 {{(pid=102560) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 08 18:04:24.784848 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-da492ca3-d8a4-4d24-8017-2e506092ba80 admin admin] 10.222.0.118 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7518647 Feb 08 18:04:27.526833 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 33556) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:04:27.853967 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-ae8f22ba-cfc3-440f-b6eb-3970af89aff5 admin admin] Request body: {'subnetpool': {'name': 'shared-default-subnetpool-v4', 'shared': True, 'default_prefixlen': 26, 'is_default': True, 'prefixes': ['172.20.0.0/16'], 'tenant_id': '57214c23b26e4ea39d6d062975f8128b'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:04:27.945219 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.policy [None req-ae8f22ba-cfc3-440f-b6eb-3970af89aff5 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102560) register_rules /opt/stack/neutron/neutron/policy.py:73}} Feb 08 18:04:27.986997 dv-cinder-773985-21-iscsi neutron-server[102560]: WARNING oslo_policy.policy [None req-ae8f22ba-cfc3-440f-b6eb-3970af89aff5 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Feb 08 18:04:27.987365 dv-cinder-773985-21-iscsi neutron-server[102560]: WARNING oslo_policy.policy [None req-ae8f22ba-cfc3-440f-b6eb-3970af89aff5 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Feb 08 18:04:28.083462 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ae8f22ba-cfc3-440f-b6eb-3970af89aff5 admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8770562210211', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8770562210774', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8770562191722', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8770562194045', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8770562183035', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8770562174067', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-1860115', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1870616', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-855247', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-943246'] for rbac-policy (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:28.155460 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ae8f22ba-cfc3-440f-b6eb-3970af89aff5 admin admin] Publish callbacks [] for subnetpool (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:28.156669 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-ae8f22ba-cfc3-440f-b6eb-3970af89aff5 admin admin] 10.222.0.118 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 0.6284750 Feb 08 18:04:30.818166 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 33568) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:04:31.145212 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Request body: {'network': {'project_id': '70394843a862420fba23914ceff48bb4', 'admin_state_up': True, 'tenant_id': '70394843a862420fba23914ceff48bb4', 'name': 'private'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:04:31.178018 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Made reservation on behalf of 70394843a862420fba23914ceff48bb4 for: {'network': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:04:31.180667 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for network (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:31.197576 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:31.315663 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Publish callbacks [] for security_group (9c7c79c4-6abd-4944-b4a8-576cf978273f), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:31.322411 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (9c7c79c4-6abd-4944-b4a8-576cf978273f), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:31.341695 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] vlan segment allocate from pool success with {'vlan_id': 1098, 'physical_network': 'physnet1'} {{(pid=102560) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Feb 08 18:04:31.368558 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8770558865080', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (96423765-ebbf-4b00-bbaa-ec165a06dc18), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:31.369134 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Unsubscribe: segment precommit_create {{(pid=102560) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Feb 08 18:04:31.369643 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.segments_db [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Added segment 96423765-ebbf-4b00-bbaa-ec165a06dc18 of type vlan for network 7292a7a0-ff5c-4926-b1ad-430b74ddd4ce Feb 08 18:04:31.384703 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9c7c79c4-6abd-4944-b4a8-576cf978273f,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:04:31.431050 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:31.431407 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:31.431744 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:31.432069 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:31.432392 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:31.432713 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:31.433043 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:31.433364 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:31.433673 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:31.433986 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:31.434303 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:31.434605 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:31.434928 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Tracked resource versions report: Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: pushed versions: Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: { 'AddressGroup': {'1.2'}, Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'ConntrackHelper': {'1.0'}, Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'LocalIPAssociation': {'1.0'}, Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'Log': {'1.0'}, Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'Network': {'1.1'}, Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'Port': {'1.7'}, Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'PortForwarding': {'1.2'}, Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'QosPolicy': {'1.10'}, Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'SecurityGroup': {'1.5'}, Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'SecurityGroupRule': {'1.2'}, Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'SubPort': {'1.0'}, Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'Subnet': {'1.1'}, Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'Trunk': {'1.1'}} Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: consumer versions: Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: { DHCP agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: L3 agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: Metadata agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: Metering agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: Open vSwitch agent@dv-cinder-773985-21-iscsi: { 'AddressGroup': '1.2', Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'ConntrackHelper': '1.0', Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'LocalIPAssociation': '1.0', Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'Log': '1.0', Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'Network': '1.1', Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'Port': '1.7', Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'PortForwarding': '1.2', Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'QosPolicy': '1.10', Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'SecurityGroup': '1.5', Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'SecurityGroupRule': '1.2', Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'SubPort': '1.0', Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'Subnet': '1.1', Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: 'Trunk': '1.1'}} Feb 08 18:04:31.436346 dv-cinder-773985-21-iscsi neutron-server[102560]: {{(pid=102560) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Feb 08 18:04:31.471303 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8770558521384'] for network (7292a7a0-ff5c-4926-b1ad-430b74ddd4ce), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:31.527436 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for network (7292a7a0-ff5c-4926-b1ad-430b74ddd4ce), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:31.528545 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:04:31.529324 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:31.607116 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] 10.222.0.118 "POST /v2.0/networks HTTP/1.1" status: 201 len: 850 time: 0.7856743 Feb 08 18:04:31.637912 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0929ce67-8c31-4a48-b37c-42ac745faa3a admin admin] Pushing event updated for resources: {'Network': ['ID=7292a7a0-ff5c-4926-b1ad-430b74ddd4ce,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:04:31.652579 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Network 7292a7a0-ff5c-4926-b1ad-430b74ddd4ce details requested by agent ovs-agent-dv-cinder-773985-21-iscsi with host dv-cinder-773985-21-iscsi {{(pid=102561) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Feb 08 18:04:34.363846 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 33582) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:04:34.780147 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ac0016c7-83d6-45aa-b8a8-3cd8f4ac70fa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:04:34.781522 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-ac0016c7-83d6-45aa-b8a8-3cd8f4ac70fa admin admin] 10.222.0.118 "GET /v2.0/networks/7292a7a0-ff5c-4926-b1ad-430b74ddd4ce HTTP/1.1" status: 200 len: 826 time: 0.4167240 Feb 08 18:04:34.808076 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-76872131-03a1-4f61-a540-476ac6066402 admin admin] 10.222.0.118 "GET /v2.0/subnetpools/51f11016-833d-4cb3-aabf-a2695ed178fe HTTP/1.1" status: 200 len: 734 time: 0.0180128 Feb 08 18:04:34.816581 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-5cd210f9-8002-483c-9b98-d3494214cbb0 admin admin] Request body: {'subnet': {'subnetpool_id': '51f11016-833d-4cb3-aabf-a2695ed178fe', 'network_id': '7292a7a0-ff5c-4926-b1ad-430b74ddd4ce', 'name': 'private-subnet', 'gateway_ip': '172.20.0.1', 'tenant_id': '70394843a862420fba23914ceff48bb4', 'ip_version': 4}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:04:34.837960 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5cd210f9-8002-483c-9b98-d3494214cbb0 admin admin] Made reservation on behalf of 70394843a862420fba23914ceff48bb4 for: {'subnet': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:04:34.840340 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-5cd210f9-8002-483c-9b98-d3494214cbb0 admin admin] Publish callbacks [] for subnet (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:35.143975 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-5cd210f9-8002-483c-9b98-d3494214cbb0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for subnet (459513bd-797c-4cca-a490-f750144a0272), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:35.205185 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cd210f9-8002-483c-9b98-d3494214cbb0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=459513bd-797c-4cca-a490-f750144a0272,revision_number=0']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:04:35.213960 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5cd210f9-8002-483c-9b98-d3494214cbb0 admin admin] Checking segment: {'id': '96423765-ebbf-4b00-bbaa-ec165a06dc18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1098, 'network_id': '7292a7a0-ff5c-4926-b1ad-430b74ddd4ce'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102560) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:04:35.214092 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5cd210f9-8002-483c-9b98-d3494214cbb0 admin admin] Network hostable DHCP agents. Network: 7292a7a0-ff5c-4926-b1ad-430b74ddd4ce, hostable agents: ['006b5388-ac7d-4794-a124-14bb8e5d8fec'], hosted agents: [] {{(pid=102560) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Feb 08 18:04:35.240900 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5cd210f9-8002-483c-9b98-d3494214cbb0 admin admin] Network 7292a7a0-ff5c-4926-b1ad-430b74ddd4ce is scheduled to be hosted by DHCP agent 006b5388-ac7d-4794-a124-14bb8e5d8fec with binding_index 1 {{(pid=102560) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Feb 08 18:04:35.251879 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-5cd210f9-8002-483c-9b98-d3494214cbb0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773985-21-iscsi, 7292a7a0-ff5c-4926-b1ad-430b74ddd4ce) {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:04:35.256790 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5cd210f9-8002-483c-9b98-d3494214cbb0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:04:35.257365 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-5cd210f9-8002-483c-9b98-d3494214cbb0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:35.261949 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-031c7c29-9afc-4a91-bbf4-6fc226df4411 None None] Network 7292a7a0-ff5c-4926-b1ad-430b74ddd4ce requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:04:35.273564 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-5cd210f9-8002-483c-9b98-d3494214cbb0 admin admin] 10.222.0.118 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.4604492 Feb 08 18:04:35.527090 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp7dd4f88d-be07-54f7-888b-e9d2dcd2237c-7292a7a0-ff5c-4926-b1ad-430b74ddd4ce', 'network_id': '7292a7a0-ff5c-4926-b1ad-430b74ddd4ce', 'project_id': '70394843a862420fba23914ceff48bb4', 'fixed_ips': [{'subnet_id': '459513bd-797c-4cca-a490-f750144a0272'}]}} from dv-cinder-773985-21-iscsi. {{(pid=102561) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Feb 08 18:04:35.528313 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:35.804891 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.db_base_plugin_common [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Allocated IP 172.20.0.2 (7292a7a0-ff5c-4926-b1ad-430b74ddd4ce/459513bd-797c-4cca-a490-f750144a0272/33e05e63-5c40-481d-b264-d31fc76ac68a) {{(pid=102561) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:04:36.076715 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Publish callbacks [] for port (33e05e63-5c40-481d-b264-d31fc76ac68a), precommit_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:36.085359 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (33e05e63-5c40-481d-b264-d31fc76ac68a), after_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:36.157084 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Network 7292a7a0-ff5c-4926-b1ad-430b74ddd4ce is already hosted by enough agents. {{(pid=102561) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:04:36.163943 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.scheduler.base_scheduler [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Resources bound (agent type, host, resource id): {{(pid=102561) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:04:36.173114 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Received port after_create {{(pid=102561) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:04:36.178794 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Pushing event updated for resources: {'Port': ['ID=33e05e63-5c40-481d-b264-d31fc76ac68a,revision_number=1']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:04:36.187720 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:36.188086 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:36.188439 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:36.188784 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:36.189496 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:36.189823 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:36.190148 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:36.190473 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:36.190807 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:36.191154 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:36.191493 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:36.191800 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:36.192114 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Tracked resource versions report: Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: pushed versions: Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: { 'AddressGroup': {'1.2'}, Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'ConntrackHelper': {'1.0'}, Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'LocalIPAssociation': {'1.0'}, Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'Log': {'1.0'}, Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'Network': {'1.1'}, Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'Port': {'1.7'}, Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'PortForwarding': {'1.2'}, Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'QosPolicy': {'1.10'}, Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'SecurityGroup': {'1.5'}, Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'SecurityGroupRule': {'1.2'}, Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'SubPort': {'1.0'}, Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'Subnet': {'1.1'}, Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'Trunk': {'1.1'}} Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: consumer versions: Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: { DHCP agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: L3 agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: Metadata agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: Metering agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: Open vSwitch agent@dv-cinder-773985-21-iscsi: { 'AddressGroup': '1.2', Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'ConntrackHelper': '1.0', Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'LocalIPAssociation': '1.0', Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'Log': '1.0', Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'Network': '1.1', Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'Port': '1.7', Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'PortForwarding': '1.2', Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'QosPolicy': '1.10', Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'SecurityGroup': '1.5', Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'SecurityGroupRule': '1.2', Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'SubPort': '1.0', Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'Subnet': '1.1', Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: 'Trunk': '1.1'}} Feb 08 18:04:36.193503 dv-cinder-773985-21-iscsi neutron-server[102561]: {{(pid=102561) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Feb 08 18:04:36.268725 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Attempting to bind port 33e05e63-5c40-481d-b264-d31fc76ac68a on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:04:36.269381 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Attempting to bind port 33e05e63-5c40-481d-b264-d31fc76ac68a by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': '96423765-ebbf-4b00-bbaa-ec165a06dc18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1098, 'network_id': '7292a7a0-ff5c-4926-b1ad-430b74ddd4ce'}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:04:36.269499 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Attempting to bind port 33e05e63-5c40-481d-b264-d31fc76ac68a on network 7292a7a0-ff5c-4926-b1ad-430b74ddd4ce {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:04:36.274972 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 4, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:04:36.275340 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Checking segment: {'id': '96423765-ebbf-4b00-bbaa-ec165a06dc18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1098, 'network_id': '7292a7a0-ff5c-4926-b1ad-430b74ddd4ce'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102561) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:04:36.275837 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:36.276230 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Bound using segment: {'id': '96423765-ebbf-4b00-bbaa-ec165a06dc18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1098, 'network_id': '7292a7a0-ff5c-4926-b1ad-430b74ddd4ce'} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:04:36.276713 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Bound port: 33e05e63-5c40-481d-b264-d31fc76ac68a, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '96423765-ebbf-4b00-bbaa-ec165a06dc18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1098, 'network_id': '7292a7a0-ff5c-4926-b1ad-430b74ddd4ce'}}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:04:36.277116 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (33e05e63-5c40-481d-b264-d31fc76ac68a), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:36.344488 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] For port 33e05e63-5c40-481d-b264-d31fc76ac68a, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102561) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:04:36.348773 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] For port 33e05e63-5c40-481d-b264-d31fc76ac68a, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=33e05e63-5c40-481d-b264-d31fc76ac68a,segment=NetworkSegment(96423765-ebbf-4b00-bbaa-ec165a06dc18),segment_id=96423765-ebbf-4b00-bbaa-ec165a06dc18)] {{(pid=102561) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:04:36.358222 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (33e05e63-5c40-481d-b264-d31fc76ac68a), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:36.424209 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b08a2130-6392-48bf-9a40-2cc7c08d305d None None] Pushing event updated for resources: {'Port': ['ID=33e05e63-5c40-481d-b264-d31fc76ac68a,revision_number=2']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:04:37.732791 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 33590) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:04:38.062483 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [None req-68574d6f-424d-4f9f-b8e3-e82f73fc6b69 admin admin] http://10.222.0.118:9696/v2.0/extensions returned with HTTP 200 {{(pid=102560) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 08 18:04:38.063513 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-68574d6f-424d-4f9f-b8e3-e82f73fc6b69 admin admin] 10.222.0.118 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3296177 Feb 08 18:04:40.531650 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 33598) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:04:40.866186 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [None req-92893816-9a81-4b4e-86ef-7f7515a68b44 admin admin] http://10.222.0.118:9696/v2.0/extensions returned with HTTP 200 {{(pid=102560) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 08 18:04:40.867209 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-92893816-9a81-4b4e-86ef-7f7515a68b44 admin admin] 10.222.0.118 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3346186 Feb 08 18:04:43.529942 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 33608) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:04:43.834726 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-d4349da8-fb53-4809-ab97-95bdaa7caeed admin admin] Request body: {'router': {'name': 'router1', 'tenant_id': '70394843a862420fba23914ceff48bb4', 'admin_state_up': True}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:04:43.860180 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d4349da8-fb53-4809-ab97-95bdaa7caeed admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-557369', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6968'] for router (be2957dd-b765-4a75-b20c-775ed1e9fdf7), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:43.861687 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d4349da8-fb53-4809-ab97-95bdaa7caeed admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-557389', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-560615', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-578936', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6961'] for router (be2957dd-b765-4a75-b20c-775ed1e9fdf7), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:43.999172 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d4349da8-fb53-4809-ab97-95bdaa7caeed admin admin] Publish callbacks [] for router_controller (be2957dd-b765-4a75-b20c-775ed1e9fdf7), precommit_add_association {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:44.005060 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d4349da8-fb53-4809-ab97-95bdaa7caeed admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-557494', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-560688'] for router (be2957dd-b765-4a75-b20c-775ed1e9fdf7), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:44.020692 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d4349da8-fb53-4809-ab97-95bdaa7caeed admin admin] Publish callbacks [] for router (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:44.022072 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-d4349da8-fb53-4809-ab97-95bdaa7caeed admin admin] 10.222.0.118 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.4911306 Feb 08 18:04:45.347527 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ee49e467-cfde-48b3-be28-3f7d3a09891b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:46.181913 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 33e05e63-5c40-481d-b264-d31fc76ac68a up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:04:46.271700 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 33e05e63-5c40-481d-b264-d31fc76ac68a triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:04:46.272188 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (33e05e63-5c40-481d-b264-d31fc76ac68a), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:46.383938 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 33e05e63-5c40-481d-b264-d31fc76ac68a is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:04:46.384563 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (33e05e63-5c40-481d-b264-d31fc76ac68a), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:46.419671 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] For port 33e05e63-5c40-481d-b264-d31fc76ac68a, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=33e05e63-5c40-481d-b264-d31fc76ac68a,segment=NetworkSegment(96423765-ebbf-4b00-bbaa-ec165a06dc18),segment_id=96423765-ebbf-4b00-bbaa-ec165a06dc18)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:04:46.424558 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (33e05e63-5c40-481d-b264-d31fc76ac68a), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:46.476760 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Pushing event updated for resources: {'Port': ['ID=33e05e63-5c40-481d-b264-d31fc76ac68a,revision_number=3']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:04:46.522240 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 33620) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:04:46.856611 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [None req-447e8381-e7eb-4a3a-9f2f-72fe5e6da26d admin admin] http://10.222.0.118:9696/v2.0/extensions returned with HTTP 200 {{(pid=102560) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 08 18:04:46.858544 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-447e8381-e7eb-4a3a-9f2f-72fe5e6da26d admin admin] 10.222.0.118 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3343782 Feb 08 18:04:47.304581 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cd1385c3-6294-45dd-9bf5-437f272f722e None None] Network 7292a7a0-ff5c-4926-b1ad-430b74ddd4ce requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:04:47.357414 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-898dcdea-1405-43bd-bf28-a1be41d1b6f3 None None] Provisioning complete for port 33e05e63-5c40-481d-b264-d31fc76ac68a triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:04:47.357800 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-898dcdea-1405-43bd-bf28-a1be41d1b6f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (33e05e63-5c40-481d-b264-d31fc76ac68a), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:47.483646 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-898dcdea-1405-43bd-bf28-a1be41d1b6f3 None None] Current status of the port 33e05e63-5c40-481d-b264-d31fc76ac68a is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:04:47.705138 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-97205ede-7358-402c-a8ed-0445201201f8 None None] Provisioning complete for port 33e05e63-5c40-481d-b264-d31fc76ac68a triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:04:47.705512 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-97205ede-7358-402c-a8ed-0445201201f8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (33e05e63-5c40-481d-b264-d31fc76ac68a), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:47.792982 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-97205ede-7358-402c-a8ed-0445201201f8 None None] Current status of the port 33e05e63-5c40-481d-b264-d31fc76ac68a is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:04:47.796195 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-06377296-b9d9-47ce-a366-44a6420ddf23 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:48.149367 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 33e05e63-5c40-481d-b264-d31fc76ac68a up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:04:48.198039 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 33e05e63-5c40-481d-b264-d31fc76ac68a triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:04:48.198406 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (33e05e63-5c40-481d-b264-d31fc76ac68a), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:48.273030 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 33e05e63-5c40-481d-b264-d31fc76ac68a is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:04:48.419541 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:49.449218 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 33650) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:04:49.584543 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-3175aa77-6009-4b01-b768-688d272790df admin admin] Request body: {'network': {'admin_state_up': True, 'name': 'public', 'provider:network_type': 'flat', 'project_id': '57214c23b26e4ea39d6d062975f8128b', 'is_default': True, 'tenant_id': '57214c23b26e4ea39d6d062975f8128b', 'router:external': True, 'provider:physical_network': 'physnet1'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:04:49.605880 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3175aa77-6009-4b01-b768-688d272790df admin admin] Made reservation on behalf of 57214c23b26e4ea39d6d062975f8128b for: {'network': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:04:49.608136 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3175aa77-6009-4b01-b768-688d272790df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for network (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:49.616281 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3175aa77-6009-4b01-b768-688d272790df admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:49.689985 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3175aa77-6009-4b01-b768-688d272790df admin admin] Publish callbacks [] for security_group (a7226f63-9f1e-4606-9f4c-3ef941948fe3), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:49.696160 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3175aa77-6009-4b01-b768-688d272790df admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (a7226f63-9f1e-4606-9f4c-3ef941948fe3), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:49.714758 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-3175aa77-6009-4b01-b768-688d272790df admin admin] Reserving flat network on physical network physnet1 {{(pid=102560) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Feb 08 18:04:49.732978 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3175aa77-6009-4b01-b768-688d272790df admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a7226f63-9f1e-4606-9f4c-3ef941948fe3,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:04:49.737923 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3175aa77-6009-4b01-b768-688d272790df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (b82851d8-2dbc-41d4-9627-76824b5fc9cb), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:49.738272 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.segments_db [None req-3175aa77-6009-4b01-b768-688d272790df admin admin] Added segment b82851d8-2dbc-41d4-9627-76824b5fc9cb of type flat for network 77055816-7c88-403d-8f8a-9be2c1faa10d Feb 08 18:04:49.784442 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3175aa77-6009-4b01-b768-688d272790df admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8770558521384'] for network (77055816-7c88-403d-8f8a-9be2c1faa10d), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:49.818489 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3175aa77-6009-4b01-b768-688d272790df admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for network (77055816-7c88-403d-8f8a-9be2c1faa10d), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:49.819618 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3175aa77-6009-4b01-b768-688d272790df admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:04:49.820247 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3175aa77-6009-4b01-b768-688d272790df admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:49.874036 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-3175aa77-6009-4b01-b768-688d272790df admin admin] 10.222.0.118 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.4236944 Feb 08 18:04:49.878492 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3175aa77-6009-4b01-b768-688d272790df admin admin] Pushing event updated for resources: {'Network': ['ID=77055816-7c88-403d-8f8a-9be2c1faa10d,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:04:49.888844 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Network 77055816-7c88-403d-8f8a-9be2c1faa10d details requested by agent ovs-agent-dv-cinder-773985-21-iscsi with host dv-cinder-773985-21-iscsi {{(pid=102561) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Feb 08 18:04:50.013986 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:51.608619 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:52.127285 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 33658) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:04:52.280289 dv-cinder-773985-21-iscsi neutron-server[102559]: WARNING oslo_policy.policy [None req-a6094c07-c677-47af-bb9f-47ad58ebcfcc admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Feb 08 18:04:52.280824 dv-cinder-773985-21-iscsi neutron-server[102559]: WARNING oslo_policy.policy [None req-a6094c07-c677-47af-bb9f-47ad58ebcfcc admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Feb 08 18:04:52.684259 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.policy [None req-a6094c07-c677-47af-bb9f-47ad58ebcfcc admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102559) register_rules /opt/stack/neutron/neutron/policy.py:73}} Feb 08 18:04:52.728485 dv-cinder-773985-21-iscsi neutron-server[102559]: WARNING oslo_policy.policy [None req-a6094c07-c677-47af-bb9f-47ad58ebcfcc admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Feb 08 18:04:52.728849 dv-cinder-773985-21-iscsi neutron-server[102559]: WARNING oslo_policy.policy [None req-a6094c07-c677-47af-bb9f-47ad58ebcfcc admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Feb 08 18:04:52.736653 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a6094c07-c677-47af-bb9f-47ad58ebcfcc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:04:52.738604 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-a6094c07-c677-47af-bb9f-47ad58ebcfcc admin admin] 10.222.0.118 "GET /v2.0/subnets/459513bd-797c-4cca-a490-f750144a0272 HTTP/1.1" status: 200 len: 849 time: 0.6092575 Feb 08 18:04:52.909516 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-73e95588-3b11-40d9-8a9e-f7de0d5c8dfc admin admin] 10.222.0.118 "GET /v2.0/routers/be2957dd-b765-4a75-b20c-775ed1e9fdf7 HTTP/1.1" status: 200 len: 704 time: 0.1622236 Feb 08 18:04:53.191851 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:53.516582 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Allocated IP 172.20.0.1 (7292a7a0-ff5c-4926-b1ad-430b74ddd4ce/459513bd-797c-4cca-a490-f750144a0272/dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:04:53.724641 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Publish callbacks [] for port (dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:53.796459 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:53.855364 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Network 7292a7a0-ff5c-4926-b1ad-430b74ddd4ce is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:04:53.861155 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:04:53.915835 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Pushing event updated for resources: {'Port': ['ID=dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:04:53.918892 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:04:53.918986 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-560871'] for router_interface (be2957dd-b765-4a75-b20c-775ed1e9fdf7), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:53.979610 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:53.979960 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:53.980308 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:53.980654 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:53.980961 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:53.981292 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:53.981628 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:53.982097 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:53.982407 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:53.982758 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:53.983109 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:53.983429 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:53.983752 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Tracked resource versions report: Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: pushed versions: Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: { 'AddressGroup': {'1.2'}, Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'ConntrackHelper': {'1.0'}, Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'LocalIPAssociation': {'1.0'}, Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'Log': {'1.0'}, Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'Network': {'1.1'}, Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'Port': {'1.7'}, Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'PortForwarding': {'1.2'}, Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'QosPolicy': {'1.10'}, Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'SecurityGroup': {'1.5'}, Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'SecurityGroupRule': {'1.2'}, Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'SubPort': {'1.0'}, Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'Subnet': {'1.1'}, Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'Trunk': {'1.1'}} Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: consumer versions: Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: { DHCP agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: L3 agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: Metadata agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: Metering agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: Open vSwitch agent@dv-cinder-773985-21-iscsi: { 'AddressGroup': '1.2', Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'ConntrackHelper': '1.0', Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'LocalIPAssociation': '1.0', Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'Log': '1.0', Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'Network': '1.1', Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'Port': '1.7', Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'PortForwarding': '1.2', Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'QosPolicy': '1.10', Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'SecurityGroup': '1.5', Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'SecurityGroupRule': '1.2', Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'SubPort': '1.0', Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'Subnet': '1.1', Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: 'Trunk': '1.1'}} Feb 08 18:04:53.985142 dv-cinder-773985-21-iscsi neutron-server[102559]: {{(pid=102559) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Feb 08 18:04:54.135078 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:54.158693 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-fc3347bc-c4fe-4797-975a-31be18567d87 None None] Provisioning complete for port dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:04:54.159259 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-fc3347bc-c4fe-4797-975a-31be18567d87 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:54.192145 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-fc3347bc-c4fe-4797-975a-31be18567d87 None None] Port dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:04:54.365574 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Publish callbacks [] for port (dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:54.371592 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:54.372438 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-631683', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-559991'] for router_interface (be2957dd-b765-4a75-b20c-775ed1e9fdf7), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:54.445198 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Pushing event updated for resources: {'Port': ['ID=dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:04:54.497964 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Network 7292a7a0-ff5c-4926-b1ad-430b74ddd4ce is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:04:54.499492 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:04:54.716463 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-4d1ae778-7798-41b4-b424-7fc01e63fd5a None None] Provisioning complete for port dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:04:54.716849 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-4d1ae778-7798-41b4-b424-7fc01e63fd5a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:54.746460 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Router be2957dd-b765-4a75-b20c-775ed1e9fdf7 is scheduled to L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 with binding_index 1 {{(pid=102559) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Feb 08 18:04:54.756635 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-4d1ae778-7798-41b4-b424-7fc01e63fd5a None None] Port dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:04:54.841711 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102559) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:04:54.848193 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-6c7b7b6a-fcd6-4dad-b836-dff13409bace admin admin] 10.222.0.118 "PUT /v2.0/routers/be2957dd-b765-4a75-b20c-775ed1e9fdf7/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.9307601 Feb 08 18:04:54.851693 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] Sync routers for ids ['be2957dd-b765-4a75-b20c-775ed1e9fdf7'] in dv-cinder-773985-21-iscsi {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:04:54.865175 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] Routers {'be2957dd-b765-4a75-b20c-775ed1e9fdf7'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:04:54.866011 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:04:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['be2957dd-b765-4a75-b20c-775ed1e9fdf7'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:04:55.056083 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] Set router be2957dd-b765-4a75-b20c-775ed1e9fdf7 gateway port host: None {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:04:55.483262 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'be2957dd-b765-4a75-b20c-775ed1e9fdf7', 'name': 'router1', 'tenant_id': '70394843a862420fba23914ceff48bb4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:04:43Z', 'updated_at': '2022-02-08T18:04:54Z', 'revision_number': 2, 'project_id': '70394843a862420fba23914ceff48bb4', 'gw_port_host': None, '_interfaces': [{'id': 'dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb', 'name': '', 'network_id': '7292a7a0-ff5c-4926-b1ad-430b74ddd4ce', 'tenant_id': '70394843a862420fba23914ceff48bb4', 'mac_address': 'fa:16:3e:12:22:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'be2957dd-b765-4a75-b20c-775ed1e9fdf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '459513bd-797c-4cca-a490-f750144a0272', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:04:53Z', 'updated_at': '2022-02-08T18:04:54Z', 'revision_number': 2, 'project_id': '70394843a862420fba23914ceff48bb4', 'subnets': [{'id': '459513bd-797c-4cca-a490-f750144a0272', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '51f11016-833d-4cb3-aabf-a2695ed178fe'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:04:55.532047 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] Checking router: be2957dd-b765-4a75-b20c-775ed1e9fdf7 for host: dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:04:55.532395 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] Updating router be2957dd-b765-4a75-b20c-775ed1e9fdf7 port dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb binding host dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Feb 08 18:04:55.611417 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb), before_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:56.099191 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] Publish callbacks [] for port (dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb), precommit_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:56.107069 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb), after_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:56.277844 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] Attempting to bind port dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:04:56.278489 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] Attempting to bind port dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': '96423765-ebbf-4b00-bbaa-ec165a06dc18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1098, 'network_id': '7292a7a0-ff5c-4926-b1ad-430b74ddd4ce'}] {{(pid=102562) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:04:56.279002 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] Attempting to bind port dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb on network 7292a7a0-ff5c-4926-b1ad-430b74ddd4ce {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:04:56.281056 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24f4d8a7-4cd0-42c4-a4f5-2fc416fc7293 None None] Pushing event updated for resources: {'Port': ['ID=dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb,revision_number=3']} {{(pid=102562) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:04:56.291184 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f4d8a7-4cd0-42c4-a4f5-2fc416fc7293 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:56.291532 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f4d8a7-4cd0-42c4-a4f5-2fc416fc7293 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:56.291880 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f4d8a7-4cd0-42c4-a4f5-2fc416fc7293 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:56.292220 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f4d8a7-4cd0-42c4-a4f5-2fc416fc7293 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:56.292550 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f4d8a7-4cd0-42c4-a4f5-2fc416fc7293 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:56.293160 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f4d8a7-4cd0-42c4-a4f5-2fc416fc7293 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:56.293511 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f4d8a7-4cd0-42c4-a4f5-2fc416fc7293 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:56.293842 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f4d8a7-4cd0-42c4-a4f5-2fc416fc7293 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:56.294227 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f4d8a7-4cd0-42c4-a4f5-2fc416fc7293 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:56.294569 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f4d8a7-4cd0-42c4-a4f5-2fc416fc7293 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:56.294917 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f4d8a7-4cd0-42c4-a4f5-2fc416fc7293 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:56.295239 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f4d8a7-4cd0-42c4-a4f5-2fc416fc7293 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:56.295559 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f4d8a7-4cd0-42c4-a4f5-2fc416fc7293 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24f4d8a7-4cd0-42c4-a4f5-2fc416fc7293 None None] Tracked resource versions report: Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: pushed versions: Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: { 'AddressGroup': {'1.2'}, Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'ConntrackHelper': {'1.0'}, Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'LocalIPAssociation': {'1.0'}, Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'Log': {'1.0'}, Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'Network': {'1.1'}, Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'Port': {'1.7'}, Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'PortForwarding': {'1.2'}, Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'QosPolicy': {'1.10'}, Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'SecurityGroup': {'1.5'}, Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'SecurityGroupRule': {'1.2'}, Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'SubPort': {'1.0'}, Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'Subnet': {'1.1'}, Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'Trunk': {'1.1'}} Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: consumer versions: Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: { DHCP agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: L3 agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: Metadata agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: Metering agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: Open vSwitch agent@dv-cinder-773985-21-iscsi: { 'AddressGroup': '1.2', Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'ConntrackHelper': '1.0', Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'LocalIPAssociation': '1.0', Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'Log': '1.0', Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'Network': '1.1', Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'Port': '1.7', Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'PortForwarding': '1.2', Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'QosPolicy': '1.10', Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'SecurityGroup': '1.5', Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'SecurityGroupRule': '1.2', Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'SubPort': '1.0', Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'Subnet': '1.1', Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: 'Trunk': '1.1'}} Feb 08 18:04:56.296945 dv-cinder-773985-21-iscsi neutron-server[102562]: {{(pid=102562) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Feb 08 18:04:56.301636 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 4, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:04:56.302024 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] Checking segment: {'id': '96423765-ebbf-4b00-bbaa-ec165a06dc18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1098, 'network_id': '7292a7a0-ff5c-4926-b1ad-430b74ddd4ce'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102562) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:04:56.302499 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:56.302901 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] Bound using segment: {'id': '96423765-ebbf-4b00-bbaa-ec165a06dc18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1098, 'network_id': '7292a7a0-ff5c-4926-b1ad-430b74ddd4ce'} {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:04:56.303390 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] Bound port: dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '96423765-ebbf-4b00-bbaa-ec165a06dc18', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1098, 'network_id': '7292a7a0-ff5c-4926-b1ad-430b74ddd4ce'}}] {{(pid=102562) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:04:56.303773 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb), before_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:56.377491 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.db [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] For port dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102562) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:04:56.389380 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-aee3b7b1-67ee-4a56-98dc-0ad646e15f3e None None] Provisioning complete for port dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:04:56.390003 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-aee3b7b1-67ee-4a56-98dc-0ad646e15f3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:56.398946 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.db [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] For port dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb,segment=NetworkSegment(96423765-ebbf-4b00-bbaa-ec165a06dc18),segment_id=96423765-ebbf-4b00-bbaa-ec165a06dc18)] {{(pid=102562) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:04:56.406133 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb), after_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:56.424149 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-aee3b7b1-67ee-4a56-98dc-0ad646e15f3e None None] Port dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:04:56.460376 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24f4d8a7-4cd0-42c4-a4f5-2fc416fc7293 None None] Pushing event updated for resources: {'Port': ['ID=dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb,revision_number=4']} {{(pid=102562) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:04:56.480514 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] Routers {'be2957dd-b765-4a75-b20c-775ed1e9fdf7'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:04:56.481123 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:04:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['be2957dd-b765-4a75-b20c-775ed1e9fdf7'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:04:56.572938 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] Set router be2957dd-b765-4a75-b20c-775ed1e9fdf7 gateway port host: None {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:04:56.645147 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-1bc1fd9d-7b49-47f3-841f-6d41b31c220f None None] Provisioning complete for port dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:04:56.645773 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-1bc1fd9d-7b49-47f3-841f-6d41b31c220f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:56.728490 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-1bc1fd9d-7b49-47f3-841f-6d41b31c220f None None] Current status of the port dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:04:56.728828 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-1bc1fd9d-7b49-47f3-841f-6d41b31c220f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:56.760536 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-1bc1fd9d-7b49-47f3-841f-6d41b31c220f None None] For port dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb,segment=NetworkSegment(96423765-ebbf-4b00-bbaa-ec165a06dc18),segment_id=96423765-ebbf-4b00-bbaa-ec165a06dc18)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:04:56.766821 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-1bc1fd9d-7b49-47f3-841f-6d41b31c220f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:56.785571 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'be2957dd-b765-4a75-b20c-775ed1e9fdf7', 'name': 'router1', 'tenant_id': '70394843a862420fba23914ceff48bb4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:04:43Z', 'updated_at': '2022-02-08T18:04:54Z', 'revision_number': 2, 'project_id': '70394843a862420fba23914ceff48bb4', 'gw_port_host': None, '_interfaces': [{'id': 'dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb', 'name': '', 'network_id': '7292a7a0-ff5c-4926-b1ad-430b74ddd4ce', 'tenant_id': '70394843a862420fba23914ceff48bb4', 'mac_address': 'fa:16:3e:12:22:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'be2957dd-b765-4a75-b20c-775ed1e9fdf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '459513bd-797c-4cca-a490-f750144a0272', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:04:53Z', 'updated_at': '2022-02-08T18:04:56Z', 'revision_number': 4, 'project_id': '70394843a862420fba23914ceff48bb4', 'subnets': [{'id': '459513bd-797c-4cca-a490-f750144a0272', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '51f11016-833d-4cb3-aabf-a2695ed178fe'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:04:56.813765 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-309f3b2d-71e5-427b-adf3-379bcc290736 None None] The sync data for ids ['be2957dd-b765-4a75-b20c-775ed1e9fdf7'] in dv-cinder-773985-21-iscsi is: [{'id': 'be2957dd-b765-4a75-b20c-775ed1e9fdf7', 'name': 'router1', 'tenant_id': '70394843a862420fba23914ceff48bb4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:04:43Z', 'updated_at': '2022-02-08T18:04:54Z', 'revision_number': 2, 'project_id': '70394843a862420fba23914ceff48bb4', 'gw_port_host': None, '_interfaces': [{'id': 'dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb', 'name': '', 'network_id': '7292a7a0-ff5c-4926-b1ad-430b74ddd4ce', 'tenant_id': '70394843a862420fba23914ceff48bb4', 'mac_address': 'fa:16:3e:12:22:2c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'be2957dd-b765-4a75-b20c-775ed1e9fdf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '459513bd-797c-4cca-a490-f750144a0272', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:04:53Z', 'updated_at': '2022-02-08T18:04:56Z', 'revision_number': 4, 'project_id': '70394843a862420fba23914ceff48bb4', 'subnets': [{'id': '459513bd-797c-4cca-a490-f750144a0272', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '51f11016-833d-4cb3-aabf-a2695ed178fe'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:04:56.820861 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bc1fd9d-7b49-47f3-841f-6d41b31c220f None None] Pushing event updated for resources: {'Port': ['ID=dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:04:59.464970 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 33690) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:04:59.573119 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5329d838-a619-45be-a12e-7dbfa68a6a32 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:04:59.574498 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-5329d838-a619-45be-a12e-7dbfa68a6a32 admin admin] 10.222.0.118 "GET /v2.0/networks/77055816-7c88-403d-8f8a-9be2c1faa10d HTTP/1.1" status: 200 len: 842 time: 0.1085279 Feb 08 18:04:59.584163 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-53b0979a-043a-407a-ab39-b58d830a534d admin admin] Request body: {'subnet': {'gateway_ip': '172.27.1.1', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'enable_dhcp': False, 'ip_version': 4, 'name': 'public-subnet', 'tenant_id': '57214c23b26e4ea39d6d062975f8128b', 'cidr': '172.27.1.0/24'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:04:59.602991 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-53b0979a-043a-407a-ab39-b58d830a534d admin admin] Made reservation on behalf of 57214c23b26e4ea39d6d062975f8128b for: {'subnet': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:04:59.605409 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-53b0979a-043a-407a-ab39-b58d830a534d admin admin] Publish callbacks [] for subnet (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:59.919152 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.objects.ports [None req-53b0979a-043a-407a-ab39-b58d830a534d admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=102560) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Feb 08 18:04:59.919588 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-53b0979a-043a-407a-ab39-b58d830a534d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for subnet (18547c52-7b23-42cd-bb53-214663ed102b), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:04:59.969476 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53b0979a-043a-407a-ab39-b58d830a534d admin admin] Pushing event updated for resources: {'Subnet': ['ID=18547c52-7b23-42cd-bb53-214663ed102b,revision_number=0']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:04:59.979329 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-53b0979a-043a-407a-ab39-b58d830a534d admin admin] Checking segment: {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102560) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:04:59.979680 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53b0979a-043a-407a-ab39-b58d830a534d admin admin] Network hostable DHCP agents. Network: 77055816-7c88-403d-8f8a-9be2c1faa10d, hostable agents: ['006b5388-ac7d-4794-a124-14bb8e5d8fec'], hosted agents: [] {{(pid=102560) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Feb 08 18:04:59.996707 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-53b0979a-043a-407a-ab39-b58d830a534d admin admin] Network 77055816-7c88-403d-8f8a-9be2c1faa10d is scheduled to be hosted by DHCP agent 006b5388-ac7d-4794-a124-14bb8e5d8fec with binding_index 1 {{(pid=102560) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Feb 08 18:05:00.006028 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-53b0979a-043a-407a-ab39-b58d830a534d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773985-21-iscsi, 77055816-7c88-403d-8f8a-9be2c1faa10d) {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:05:00.010225 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-53b0979a-043a-407a-ab39-b58d830a534d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:05:00.011048 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-53b0979a-043a-407a-ab39-b58d830a534d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:00.016372 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-24ace35b-ad84-4bcb-9985-09a313126590 None None] Network 77055816-7c88-403d-8f8a-9be2c1faa10d requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:05:00.030445 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-53b0979a-043a-407a-ab39-b58d830a534d admin admin] 10.222.0.118 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4496777 Feb 08 18:05:00.134342 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-90704e80-e5e7-4ee3-ba10-c895f940ce4e None None] Network 77055816-7c88-403d-8f8a-9be2c1faa10d requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:05:02.341825 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 33698) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:05:02.559144 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-4f88540a-b347-4f4e-b72f-da73a8014244 admin admin] 10.222.0.118 "GET /v2.0/routers/be2957dd-b765-4a75-b20c-775ed1e9fdf7 HTTP/1.1" status: 200 len: 710 time: 0.2161591 Feb 08 18:05:02.648350 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-efa77cbc-d19f-48db-a735-c003d22b792d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:05:02.649917 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-efa77cbc-d19f-48db-a735-c003d22b792d admin admin] 10.222.0.118 "GET /v2.0/networks/77055816-7c88-403d-8f8a-9be2c1faa10d HTTP/1.1" status: 200 len: 886 time: 0.0846457 Feb 08 18:05:02.659565 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-ec658ca4-591f-40a4-a524-5eeef67c68b6 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:05:02.957483 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ec658ca4-591f-40a4-a524-5eeef67c68b6 admin admin] Publish callbacks [] for router_gateway (be2957dd-b765-4a75-b20c-775ed1e9fdf7), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:03.211668 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ec658ca4-591f-40a4-a524-5eeef67c68b6 admin admin] Publish callbacks [] for router_gateway (be2957dd-b765-4a75-b20c-775ed1e9fdf7), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:03.292971 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ec658ca4-591f-40a4-a524-5eeef67c68b6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:03.451569 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_common [None req-ec658ca4-591f-40a4-a524-5eeef67c68b6 admin admin] Allocated IP 172.27.1.60 (77055816-7c88-403d-8f8a-9be2c1faa10d/18547c52-7b23-42cd-bb53-214663ed102b/809548f0-2439-45ed-b11d-d740a3e01d70) {{(pid=102560) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:05:03.562051 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ec658ca4-591f-40a4-a524-5eeef67c68b6 admin admin] Publish callbacks [] for port (809548f0-2439-45ed-b11d-d740a3e01d70), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:03.627942 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ec658ca4-591f-40a4-a524-5eeef67c68b6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (809548f0-2439-45ed-b11d-d740a3e01d70), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:03.693256 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ec658ca4-591f-40a4-a524-5eeef67c68b6 admin admin] Network 77055816-7c88-403d-8f8a-9be2c1faa10d is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:05:03.700451 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-ec658ca4-591f-40a4-a524-5eeef67c68b6 admin admin] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:05:03.705797 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ec658ca4-591f-40a4-a524-5eeef67c68b6 admin admin] Received port after_create {{(pid=102560) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:05:03.744969 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec658ca4-591f-40a4-a524-5eeef67c68b6 admin admin] Pushing event updated for resources: {'Port': ['ID=809548f0-2439-45ed-b11d-d740a3e01d70,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:05:03.990637 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ec658ca4-591f-40a4-a524-5eeef67c68b6 admin admin] Publish callbacks [] for router_gateway (be2957dd-b765-4a75-b20c-775ed1e9fdf7), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:04.183823 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:05:04.234437 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:05:04.234729 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:04.262761 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ec658ca4-591f-40a4-a524-5eeef67c68b6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-560593', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-557503', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-6943'] for router (be2957dd-b765-4a75-b20c-775ed1e9fdf7), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:04.267537 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ec658ca4-591f-40a4-a524-5eeef67c68b6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-560688', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-560602', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-560579', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-557472'] for router (be2957dd-b765-4a75-b20c-775ed1e9fdf7), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:04.312024 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:05:04.382615 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ec658ca4-591f-40a4-a524-5eeef67c68b6 admin admin] Router be2957dd-b765-4a75-b20c-775ed1e9fdf7 has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:05:04.492040 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ec658ca4-591f-40a4-a524-5eeef67c68b6 admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:05:04.497089 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ec658ca4-591f-40a4-a524-5eeef67c68b6 admin admin] Publish callbacks [] for router (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:04.498277 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-ec658ca4-591f-40a4-a524-5eeef67c68b6 admin admin] 10.222.0.118 "PUT /v2.0/routers/be2957dd-b765-4a75-b20c-775ed1e9fdf7 HTTP/1.1" status: 200 len: 889 time: 1.8423085 Feb 08 18:05:05.104774 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] Sync routers for ids ['be2957dd-b765-4a75-b20c-775ed1e9fdf7'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:05:05.116358 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] Routers {'be2957dd-b765-4a75-b20c-775ed1e9fdf7'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:05:05.117087 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:04:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['be2957dd-b765-4a75-b20c-775ed1e9fdf7'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:05:05.325209 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] Set router be2957dd-b765-4a75-b20c-775ed1e9fdf7 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:05:05.799884 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'be2957dd-b765-4a75-b20c-775ed1e9fdf7', 'name': 'router1', 'tenant_id': '70394843a862420fba23914ceff48bb4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.60'}], 'enable_snat': True}, 'gw_port_id': '809548f0-2439-45ed-b11d-d740a3e01d70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:04:43Z', 'updated_at': '2022-02-08T18:05:03Z', 'revision_number': 4, 'project_id': '70394843a862420fba23914ceff48bb4', 'gw_port': {'id': '809548f0-2439-45ed-b11d-d740a3e01d70', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:89:74:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'be2957dd-b765-4a75-b20c-775ed1e9fdf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:05:03Z', 'updated_at': '2022-02-08T18:05:03Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb', 'name': '', 'network_id': '7292a7a0-ff5c-4926-b1ad-430b74ddd4ce', 'tenant_id': '70394843a862420fba23914ceff48bb4', 'mac_address': 'fa:16:3e:12:22:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be2957dd-b765-4a75-b20c-775ed1e9fdf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '459513bd-797c-4cca-a490-f750144a0272', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:04:53Z', 'updated_at': '2022-02-08T18:04:56Z', 'revision_number': 5, 'project_id': '70394843a862420fba23914ceff48bb4', 'subnets': [{'id': '459513bd-797c-4cca-a490-f750144a0272', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '51f11016-833d-4cb3-aabf-a2695ed178fe'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:05:05.853052 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] Checking router: be2957dd-b765-4a75-b20c-775ed1e9fdf7 for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:05:05.853411 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] Updating router be2957dd-b765-4a75-b20c-775ed1e9fdf7 port 809548f0-2439-45ed-b11d-d740a3e01d70 binding host dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Feb 08 18:05:05.904454 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (809548f0-2439-45ed-b11d-d740a3e01d70), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:06.220347 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] Publish callbacks [] for port (809548f0-2439-45ed-b11d-d740a3e01d70), precommit_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:06.226939 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (809548f0-2439-45ed-b11d-d740a3e01d70), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:06.281626 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] Attempting to bind port 809548f0-2439-45ed-b11d-d740a3e01d70 on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:05:06.282271 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] Attempting to bind port 809548f0-2439-45ed-b11d-d740a3e01d70 by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:05:06.282471 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] Attempting to bind port 809548f0-2439-45ed-b11d-d740a3e01d70 on network 77055816-7c88-403d-8f8a-9be2c1faa10d {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:05:06.285489 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c192ffb-598e-40e2-be69-de92c3df65e4 None None] Pushing event updated for resources: {'Port': ['ID=809548f0-2439-45ed-b11d-d740a3e01d70,revision_number=2']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:05:06.291057 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 4, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:05:06.291415 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] Checking segment: {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102561) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:05:06.291808 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:06.292163 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] Bound using segment: {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:05:06.292645 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] Bound port: 809548f0-2439-45ed-b11d-d740a3e01d70, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:05:06.293009 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (809548f0-2439-45ed-b11d-d740a3e01d70), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:06.354447 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] For port 809548f0-2439-45ed-b11d-d740a3e01d70, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102561) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:05:06.357913 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] For port 809548f0-2439-45ed-b11d-d740a3e01d70, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=809548f0-2439-45ed-b11d-d740a3e01d70,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102561) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:05:06.366238 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (809548f0-2439-45ed-b11d-d740a3e01d70), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:06.421404 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c192ffb-598e-40e2-be69-de92c3df65e4 None None] Pushing event updated for resources: {'Port': ['ID=809548f0-2439-45ed-b11d-d740a3e01d70,revision_number=3']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:05:06.425209 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] Routers {'be2957dd-b765-4a75-b20c-775ed1e9fdf7'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:05:06.425799 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:04:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['be2957dd-b765-4a75-b20c-775ed1e9fdf7'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:05:06.530142 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] Set router be2957dd-b765-4a75-b20c-775ed1e9fdf7 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:05:06.739116 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'be2957dd-b765-4a75-b20c-775ed1e9fdf7', 'name': 'router1', 'tenant_id': '70394843a862420fba23914ceff48bb4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.60'}], 'enable_snat': True}, 'gw_port_id': '809548f0-2439-45ed-b11d-d740a3e01d70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:04:43Z', 'updated_at': '2022-02-08T18:05:03Z', 'revision_number': 4, 'project_id': '70394843a862420fba23914ceff48bb4', 'gw_port': {'id': '809548f0-2439-45ed-b11d-d740a3e01d70', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:89:74:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'be2957dd-b765-4a75-b20c-775ed1e9fdf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:05:03Z', 'updated_at': '2022-02-08T18:05:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb', 'name': '', 'network_id': '7292a7a0-ff5c-4926-b1ad-430b74ddd4ce', 'tenant_id': '70394843a862420fba23914ceff48bb4', 'mac_address': 'fa:16:3e:12:22:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be2957dd-b765-4a75-b20c-775ed1e9fdf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '459513bd-797c-4cca-a490-f750144a0272', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:04:53Z', 'updated_at': '2022-02-08T18:04:56Z', 'revision_number': 5, 'project_id': '70394843a862420fba23914ceff48bb4', 'subnets': [{'id': '459513bd-797c-4cca-a490-f750144a0272', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '51f11016-833d-4cb3-aabf-a2695ed178fe'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:05:06.764707 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-14866f94-8256-42c1-9666-11bbca1fde5b None None] The sync data for ids ['be2957dd-b765-4a75-b20c-775ed1e9fdf7'] in dv-cinder-773985-21-iscsi is: [{'id': 'be2957dd-b765-4a75-b20c-775ed1e9fdf7', 'name': 'router1', 'tenant_id': '70394843a862420fba23914ceff48bb4', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.60'}], 'enable_snat': True}, 'gw_port_id': '809548f0-2439-45ed-b11d-d740a3e01d70', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:04:43Z', 'updated_at': '2022-02-08T18:05:03Z', 'revision_number': 4, 'project_id': '70394843a862420fba23914ceff48bb4', 'gw_port': {'id': '809548f0-2439-45ed-b11d-d740a3e01d70', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:89:74:0c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'be2957dd-b765-4a75-b20c-775ed1e9fdf7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.60', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:05:03Z', 'updated_at': '2022-02-08T18:05:06Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb', 'name': '', 'network_id': '7292a7a0-ff5c-4926-b1ad-430b74ddd4ce', 'tenant_id': '70394843a862420fba23914ceff48bb4', 'mac_address': 'fa:16:3e:12:22:2c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'be2957dd-b765-4a75-b20c-775ed1e9fdf7', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '459513bd-797c-4cca-a490-f750144a0272', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:04:53Z', 'updated_at': '2022-02-08T18:04:56Z', 'revision_number': 5, 'project_id': '70394843a862420fba23914ceff48bb4', 'subnets': [{'id': '459513bd-797c-4cca-a490-f750144a0272', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '51f11016-833d-4cb3-aabf-a2695ed178fe'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:05:06.984070 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 33710) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:05:07.106564 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-3090d3f9-6218-4331-bc53-867bd61dc5a4 admin admin] 10.222.0.118 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 410 time: 0.1213024 Feb 08 18:05:08.180840 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 809548f0-2439-45ed-b11d-d740a3e01d70 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:05:08.227785 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 809548f0-2439-45ed-b11d-d740a3e01d70 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:05:08.228172 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (809548f0-2439-45ed-b11d-d740a3e01d70), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:08.317929 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 809548f0-2439-45ed-b11d-d740a3e01d70 is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:05:08.318357 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (809548f0-2439-45ed-b11d-d740a3e01d70), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:08.339747 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] For port 809548f0-2439-45ed-b11d-d740a3e01d70, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=809548f0-2439-45ed-b11d-d740a3e01d70,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:05:08.345534 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (809548f0-2439-45ed-b11d-d740a3e01d70), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:08.394921 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Pushing event updated for resources: {'Port': ['ID=809548f0-2439-45ed-b11d-d740a3e01d70,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:05:10.171966 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 809548f0-2439-45ed-b11d-d740a3e01d70 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:05:10.224849 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 809548f0-2439-45ed-b11d-d740a3e01d70 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:05:10.225372 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (809548f0-2439-45ed-b11d-d740a3e01d70), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:10.299778 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 809548f0-2439-45ed-b11d-d740a3e01d70 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:05:15.365783 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-e085550e-0f1c-4835-a2d3-405c9f8b8f55 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:15.969845 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 5 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:05:17.781640 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ee8a6861-79ab-4d43-8cdc-23c7aa970b0a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:18.453641 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:20.016542 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:21.613126 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:45.341830 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-9b5f4b89-93a4-49e6-a217-130d95ffdc3d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:47.798081 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-82c48de4-942f-4181-a4e8-a81bcaf04fa8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:48.428350 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:50.026781 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:51.619141 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:05:52.970780 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 5 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:06:15.346803 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ef4d5768-2b32-4940-9e3b-473a3a577405 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:06:17.773394 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2b66c351-7068-4a32-a50a-7ccd39487e45 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:06:18.425813 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:06:20.030234 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:06:21.615717 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:06:26.232766 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 34194) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:06:26.305920 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.pecan_wsgi.hooks.translation [None req-cf23625e-f418-4a59-a39f-7bfafbf84b3a admin admin] GET failed (client error): The resource could not be found. Feb 08 18:06:26.307249 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-cf23625e-f418-4a59-a39f-7bfafbf84b3a admin admin] 10.222.0.118 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0731947 Feb 08 18:06:26.469795 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4c21eef7-7c47-4cd1-82bb-cc7937baf8f7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:06:26.471364 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-4c21eef7-7c47-4cd1-82bb-cc7937baf8f7 admin admin] 10.222.0.118 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 873 time: 0.1578147 Feb 08 18:06:28.700659 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 34204) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:06:28.814928 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fc0e2e32-3dd5-4f6e-afd2-5b769907513c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:06:28.816340 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-fc0e2e32-3dd5-4f6e-afd2-5b769907513c admin admin] 10.222.0.118 "GET /v2.0/subnets/459513bd-797c-4cca-a490-f750144a0272 HTTP/1.1" status: 200 len: 849 time: 0.1143270 Feb 08 18:06:28.828654 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-0e119a97-7e49-43f7-8af0-e51d81962ceb admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:06:28.915564 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0e119a97-7e49-43f7-8af0-e51d81962ceb admin admin] Publish callbacks [] for subnet (459513bd-797c-4cca-a490-f750144a0272), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:06:29.067182 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0e119a97-7e49-43f7-8af0-e51d81962ceb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8770559041540'] for subnet (459513bd-797c-4cca-a490-f750144a0272), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:06:29.097166 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0e119a97-7e49-43f7-8af0-e51d81962ceb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:06:29.097797 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0e119a97-7e49-43f7-8af0-e51d81962ceb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:06:29.099152 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-0e119a97-7e49-43f7-8af0-e51d81962ceb admin admin] 10.222.0.118 "PUT /v2.0/subnets/459513bd-797c-4cca-a490-f750144a0272 HTTP/1.1" status: 200 len: 868 time: 0.2742722 Feb 08 18:06:29.114532 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fe8e10d7-765a-4026-8929-afdb14658b57 None None] Network 7292a7a0-ff5c-4926-b1ad-430b74ddd4ce requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:06:29.120618 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0e119a97-7e49-43f7-8af0-e51d81962ceb admin admin] Pushing event updated for resources: {'Subnet': ['ID=459513bd-797c-4cca-a490-f750144a0272,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:06:29.128679 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e119a97-7e49-43f7-8af0-e51d81962ceb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:06:29.129046 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e119a97-7e49-43f7-8af0-e51d81962ceb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:06:29.129375 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e119a97-7e49-43f7-8af0-e51d81962ceb admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:06:29.129708 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e119a97-7e49-43f7-8af0-e51d81962ceb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:06:29.130036 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e119a97-7e49-43f7-8af0-e51d81962ceb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:06:29.130345 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e119a97-7e49-43f7-8af0-e51d81962ceb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:06:29.130690 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e119a97-7e49-43f7-8af0-e51d81962ceb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:06:29.131047 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e119a97-7e49-43f7-8af0-e51d81962ceb admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:06:29.131385 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e119a97-7e49-43f7-8af0-e51d81962ceb admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:06:29.131709 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e119a97-7e49-43f7-8af0-e51d81962ceb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:06:29.132019 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e119a97-7e49-43f7-8af0-e51d81962ceb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:06:29.132350 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e119a97-7e49-43f7-8af0-e51d81962ceb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:06:29.132674 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0e119a97-7e49-43f7-8af0-e51d81962ceb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:06:29.516150 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-11842912-4e12-4af6-892b-c3566affe071 None None] Provisioning complete for port 33e05e63-5c40-481d-b264-d31fc76ac68a triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:06:29.516452 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-11842912-4e12-4af6-892b-c3566affe071 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (33e05e63-5c40-481d-b264-d31fc76ac68a), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:06:29.593320 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-11842912-4e12-4af6-892b-c3566affe071 None None] Current status of the port 33e05e63-5c40-481d-b264-d31fc76ac68a is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:06:29.603820 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-11842912-4e12-4af6-892b-c3566affe071 None None] Provisioning complete for port dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:06:29.604197 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-11842912-4e12-4af6-892b-c3566affe071 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:06:29.682799 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-11842912-4e12-4af6-892b-c3566affe071 None None] Current status of the port dc69cdf0-5d4f-4c83-8e61-e0c8ed2812cb is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:06:29.970673 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 5 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:06:31.351514 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 34214) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:06:31.560674 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-167be441-04d0-4741-8f1e-dc552f0b642f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:06:31.561025 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-167be441-04d0-4741-8f1e-dc552f0b642f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:06:31.562624 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-167be441-04d0-4741-8f1e-dc552f0b642f admin admin] 10.222.0.118 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1550 time: 0.2098746 Feb 08 18:06:33.800733 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 34222) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:06:34.014584 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2c79fa5-01d4-4303-8931-5d8507f63f2a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:06:34.014995 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2c79fa5-01d4-4303-8931-5d8507f63f2a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:06:34.016559 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-a2c79fa5-01d4-4303-8931-5d8507f63f2a admin admin] 10.222.0.118 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1550 time: 0.2148733 Feb 08 18:06:36.235834 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 34230) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:06:36.399671 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0108e7bd-bbf5-4b67-97b4-c3d3d8d66ea8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:06:36.401041 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-0108e7bd-bbf5-4b67-97b4-c3d3d8d66ea8 admin admin] 10.222.0.118 "GET /v2.0/networks/7292a7a0-ff5c-4926-b1ad-430b74ddd4ce HTTP/1.1" status: 200 len: 870 time: 0.1642332 Feb 08 18:06:38.641818 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 34238) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:06:38.767949 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-72a5dad8-9e5f-468c-929f-fa2095780011 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:06:38.769305 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-72a5dad8-9e5f-468c-929f-fa2095780011 admin admin] 10.222.0.118 "GET /v2.0/networks/77055816-7c88-403d-8f8a-9be2c1faa10d HTTP/1.1" status: 200 len: 886 time: 0.1264932 Feb 08 18:06:41.045200 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 34246) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:06:41.171520 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dfe934b4-cf0b-4d49-82da-e89965a825bf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:06:41.171983 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dfe934b4-cf0b-4d49-82da-e89965a825bf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:06:41.173647 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-dfe934b4-cf0b-4d49-82da-e89965a825bf admin admin] 10.222.0.118 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1275015 Feb 08 18:06:43.411528 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 34254) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:06:43.539088 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1064cae-5dbf-497c-bd12-bd63101b3dd6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:06:43.539535 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1064cae-5dbf-497c-bd12-bd63101b3dd6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:06:43.541063 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-f1064cae-5dbf-497c-bd12-bd63101b3dd6 admin admin] 10.222.0.118 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1285665 Feb 08 18:06:45.350489 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-afaa58e0-87b8-4c47-b5b3-2a006a58c9d2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:06:45.827112 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 34262) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:06:45.928475 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2dd1a9ec-288b-4324-82b0-f3bf4c5d9a17 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:06:45.929825 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-2dd1a9ec-288b-4324-82b0-f3bf4c5d9a17 admin admin] 10.222.0.118 "GET /v2.0/subnets/18547c52-7b23-42cd-bb53-214663ed102b HTTP/1.1" status: 200 len: 816 time: 0.1016612 Feb 08 18:06:47.776587 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-66ab0efd-6b4f-435d-a6be-dc5690d30db2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:06:48.182025 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 34270) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:06:48.273656 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5385e34b-db89-4b07-9e13-b5246e55006b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:06:48.275004 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-5385e34b-db89-4b07-9e13-b5246e55006b admin admin] 10.222.0.118 "GET /v2.0/subnets/459513bd-797c-4cca-a490-f750144a0272 HTTP/1.1" status: 200 len: 868 time: 0.0919633 Feb 08 18:06:48.431096 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:06:50.031737 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:06:51.625329 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:06.969535 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 5 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:07:12.423276 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 34324) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:07:12.480386 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [None req-366faef0-5714-400b-9a25-2ee59540c83d admin admin] http://10.222.0.118:9696/v2.0/extensions returned with HTTP 200 {{(pid=102560) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 08 18:07:12.481684 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-366faef0-5714-400b-9a25-2ee59540c83d admin admin] 10.222.0.118 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0571303 Feb 08 18:07:14.816677 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 34332) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:07:14.883134 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.pecan_wsgi.hooks.translation [None req-33ba64c3-f8de-497d-958e-9e4e19e220fe admin admin] GET failed (client error): The resource could not be found. Feb 08 18:07:14.884400 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-33ba64c3-f8de-497d-958e-9e4e19e220fe admin admin] 10.222.0.118 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0667582 Feb 08 18:07:15.037804 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1818575d-1351-4625-9d85-81e6ba86db92 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:07:15.040363 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-1818575d-1351-4625-9d85-81e6ba86db92 admin admin] 10.222.0.118 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1514053 Feb 08 18:07:15.355023 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-df67dde4-221b-4a30-8519-56dcf1fdc1cd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:17.363810 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 34342) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:07:17.414808 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-df3301dd-1afe-4391-9128-5c58c0d0fdc9 admin admin] Request body: {'network': {'admin_state_up': True, 'tenant_id': '57214c23b26e4ea39d6d062975f8128b', 'name': 'shared', 'shared': True, 'project_id': '57214c23b26e4ea39d6d062975f8128b'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:07:17.436969 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-df3301dd-1afe-4391-9128-5c58c0d0fdc9 admin admin] Made reservation on behalf of 57214c23b26e4ea39d6d062975f8128b for: {'network': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:07:17.439584 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-df3301dd-1afe-4391-9128-5c58c0d0fdc9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for network (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:17.473986 dv-cinder-773985-21-iscsi neutron-server[102560]: WARNING neutron.services.revisions.revision_plugin [None req-df3301dd-1afe-4391-9128-5c58c0d0fdc9 admin admin] Could not find related network for resource to bump revision. Feb 08 18:07:17.485716 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-df3301dd-1afe-4391-9128-5c58c0d0fdc9 admin admin] vlan segment allocate from pool success with {'vlan_id': 1059, 'physical_network': 'physnet1'} {{(pid=102560) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Feb 08 18:07:17.494863 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-df3301dd-1afe-4391-9128-5c58c0d0fdc9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (154cb5f9-649d-4c0e-87ea-ee1bef794d47), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:17.495197 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.segments_db [None req-df3301dd-1afe-4391-9128-5c58c0d0fdc9 admin admin] Added segment 154cb5f9-649d-4c0e-87ea-ee1bef794d47 of type vlan for network 0e45e9f5-b786-4875-81b2-3623bb709dc6 Feb 08 18:07:17.536865 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-df3301dd-1afe-4391-9128-5c58c0d0fdc9 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8770558521384'] for network (0e45e9f5-b786-4875-81b2-3623bb709dc6), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:17.567445 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-df3301dd-1afe-4391-9128-5c58c0d0fdc9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for network (0e45e9f5-b786-4875-81b2-3623bb709dc6), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:17.568335 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-df3301dd-1afe-4391-9128-5c58c0d0fdc9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:07:17.568898 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-df3301dd-1afe-4391-9128-5c58c0d0fdc9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:17.622333 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-df3301dd-1afe-4391-9128-5c58c0d0fdc9 admin admin] 10.222.0.118 "POST /v2.0/networks HTTP/1.1" status: 201 len: 848 time: 0.2574506 Feb 08 18:07:17.628589 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df3301dd-1afe-4391-9128-5c58c0d0fdc9 admin admin] Pushing event updated for resources: {'Network': ['ID=0e45e9f5-b786-4875-81b2-3623bb709dc6,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:07:17.641172 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Network 0e45e9f5-b786-4875-81b2-3623bb709dc6 details requested by agent ovs-agent-dv-cinder-773985-21-iscsi with host dv-cinder-773985-21-iscsi {{(pid=102561) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Feb 08 18:07:17.780681 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-f42325d1-39b7-4300-853c-86dc4b0df6c3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:18.433237 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:19.926926 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 34352) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:07:19.992196 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.pecan_wsgi.hooks.translation [None req-10a2c8b0-ca08-4f3d-ac3b-1ec6fa56638c admin admin] GET failed (client error): The resource could not be found. Feb 08 18:07:19.993660 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-10a2c8b0-ca08-4f3d-ac3b-1ec6fa56638c admin admin] 10.222.0.118 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0656657 Feb 08 18:07:20.032712 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:20.065825 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43725e9b-a847-46fe-b575-401da63f75de admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:07:20.067330 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-43725e9b-a847-46fe-b575-401da63f75de admin admin] 10.222.0.118 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 827 time: 0.0695560 Feb 08 18:07:20.077589 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Request body: {'subnet': {'ip_version': 4, 'network_id': '0e45e9f5-b786-4875-81b2-3623bb709dc6', 'name': 'shared-subnet', 'description': 'shared-subnet', 'tenant_id': '57214c23b26e4ea39d6d062975f8128b', 'cidr': '192.168.233.0/24'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:07:20.113230 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Made reservation on behalf of 57214c23b26e4ea39d6d062975f8128b for: {'subnet': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:07:20.115551 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Publish callbacks [] for subnet (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:20.307401 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for subnet (cbe0418d-c54a-4c73-9109-d1357b7f7680), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:20.358865 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Pushing event updated for resources: {'Subnet': ['ID=cbe0418d-c54a-4c73-9109-d1357b7f7680,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:07:20.369494 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:20.369836 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:20.370202 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:20.370534 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:20.370887 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:20.371218 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:20.371582 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:20.371907 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:20.372245 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:20.372566 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:20.372888 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:20.373185 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:20.373499 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:20.381111 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Checking segment: {'id': '154cb5f9-649d-4c0e-87ea-ee1bef794d47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1059, 'network_id': '0e45e9f5-b786-4875-81b2-3623bb709dc6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102559) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:07:20.381458 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Network hostable DHCP agents. Network: 0e45e9f5-b786-4875-81b2-3623bb709dc6, hostable agents: ['006b5388-ac7d-4794-a124-14bb8e5d8fec'], hosted agents: [] {{(pid=102559) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Feb 08 18:07:20.404202 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Network 0e45e9f5-b786-4875-81b2-3623bb709dc6 is scheduled to be hosted by DHCP agent 006b5388-ac7d-4794-a124-14bb8e5d8fec with binding_index 1 {{(pid=102559) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Feb 08 18:07:20.417202 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773985-21-iscsi, 0e45e9f5-b786-4875-81b2-3623bb709dc6) {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:07:20.421330 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:07:20.421988 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:20.426658 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2028e8bb-ae29-4304-ad2d-20bcd54b46d6 None None] Network 0e45e9f5-b786-4875-81b2-3623bb709dc6 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:07:20.448402 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-172e24d3-d43b-4e85-98fe-12305ad69fdb admin admin] 10.222.0.118 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3745272 Feb 08 18:07:20.635378 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp7dd4f88d-be07-54f7-888b-e9d2dcd2237c-0e45e9f5-b786-4875-81b2-3623bb709dc6', 'network_id': '0e45e9f5-b786-4875-81b2-3623bb709dc6', 'project_id': '57214c23b26e4ea39d6d062975f8128b', 'fixed_ips': [{'subnet_id': 'cbe0418d-c54a-4c73-9109-d1357b7f7680'}]}} from dv-cinder-773985-21-iscsi. {{(pid=102561) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Feb 08 18:07:20.636597 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:20.781531 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.db_base_plugin_common [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Allocated IP 192.168.233.2 (0e45e9f5-b786-4875-81b2-3623bb709dc6/cbe0418d-c54a-4c73-9109-d1357b7f7680/423ab1d7-acb1-41fe-8b12-a5ed1d754ba2) {{(pid=102561) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:07:20.924225 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Publish callbacks [] for port (423ab1d7-acb1-41fe-8b12-a5ed1d754ba2), precommit_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:20.929559 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (423ab1d7-acb1-41fe-8b12-a5ed1d754ba2), after_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:20.964819 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Network 0e45e9f5-b786-4875-81b2-3623bb709dc6 is already hosted by enough agents. {{(pid=102561) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:07:20.967644 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.scheduler.base_scheduler [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Resources bound (agent type, host, resource id): {{(pid=102561) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:07:20.973082 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Received port after_create {{(pid=102561) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:07:20.985940 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Pushing event updated for resources: {'Port': ['ID=423ab1d7-acb1-41fe-8b12-a5ed1d754ba2,revision_number=1']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:07:21.009397 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:21.009774 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:21.010125 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:21.010480 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:21.010817 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:21.011145 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:21.011465 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:21.011784 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:21.012194 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:21.012527 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:21.012851 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:21.013183 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:21.013491 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:07:21.042356 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Attempting to bind port 423ab1d7-acb1-41fe-8b12-a5ed1d754ba2 on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:07:21.043018 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Attempting to bind port 423ab1d7-acb1-41fe-8b12-a5ed1d754ba2 by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': '154cb5f9-649d-4c0e-87ea-ee1bef794d47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1059, 'network_id': '0e45e9f5-b786-4875-81b2-3623bb709dc6'}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:07:21.043216 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Attempting to bind port 423ab1d7-acb1-41fe-8b12-a5ed1d754ba2 on network 0e45e9f5-b786-4875-81b2-3623bb709dc6 {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:07:21.048228 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 6, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:07:21.048596 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Checking segment: {'id': '154cb5f9-649d-4c0e-87ea-ee1bef794d47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1059, 'network_id': '0e45e9f5-b786-4875-81b2-3623bb709dc6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102561) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:07:21.048991 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:21.049373 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Bound using segment: {'id': '154cb5f9-649d-4c0e-87ea-ee1bef794d47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1059, 'network_id': '0e45e9f5-b786-4875-81b2-3623bb709dc6'} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:07:21.049828 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Bound port: 423ab1d7-acb1-41fe-8b12-a5ed1d754ba2, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '154cb5f9-649d-4c0e-87ea-ee1bef794d47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1059, 'network_id': '0e45e9f5-b786-4875-81b2-3623bb709dc6'}}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:07:21.050198 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (423ab1d7-acb1-41fe-8b12-a5ed1d754ba2), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:21.113543 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] For port 423ab1d7-acb1-41fe-8b12-a5ed1d754ba2, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102561) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:07:21.116589 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] For port 423ab1d7-acb1-41fe-8b12-a5ed1d754ba2, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=423ab1d7-acb1-41fe-8b12-a5ed1d754ba2,segment=NetworkSegment(154cb5f9-649d-4c0e-87ea-ee1bef794d47),segment_id=154cb5f9-649d-4c0e-87ea-ee1bef794d47)] {{(pid=102561) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:07:21.123810 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (423ab1d7-acb1-41fe-8b12-a5ed1d754ba2), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:21.180463 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-396e05e3-d606-49b7-ace1-648ce73cd420 None None] Pushing event updated for resources: {'Port': ['ID=423ab1d7-acb1-41fe-8b12-a5ed1d754ba2,revision_number=2']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:07:21.619447 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:22.119178 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b51c7ca0-d1d1-4b1a-a24d-085f4acd93d6 None None] Network 0e45e9f5-b786-4875-81b2-3623bb709dc6 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:07:22.208091 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-5b94576a-150d-4535-b484-4f261403539a None None] Provisioning complete for port 423ab1d7-acb1-41fe-8b12-a5ed1d754ba2 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:07:22.208091 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-5b94576a-150d-4535-b484-4f261403539a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (423ab1d7-acb1-41fe-8b12-a5ed1d754ba2), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:22.286212 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 423ab1d7-acb1-41fe-8b12-a5ed1d754ba2 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:07:22.380940 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-5b94576a-150d-4535-b484-4f261403539a None None] Current status of the port 423ab1d7-acb1-41fe-8b12-a5ed1d754ba2 is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:07:22.381326 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-5b94576a-150d-4535-b484-4f261403539a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (423ab1d7-acb1-41fe-8b12-a5ed1d754ba2), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:22.420491 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 423ab1d7-acb1-41fe-8b12-a5ed1d754ba2 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:07:22.421295 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (423ab1d7-acb1-41fe-8b12-a5ed1d754ba2), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:22.423524 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-5b94576a-150d-4535-b484-4f261403539a None None] For port 423ab1d7-acb1-41fe-8b12-a5ed1d754ba2, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=423ab1d7-acb1-41fe-8b12-a5ed1d754ba2,segment=NetworkSegment(154cb5f9-649d-4c0e-87ea-ee1bef794d47),segment_id=154cb5f9-649d-4c0e-87ea-ee1bef794d47)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:07:22.447304 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-5b94576a-150d-4535-b484-4f261403539a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (423ab1d7-acb1-41fe-8b12-a5ed1d754ba2), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:22.513242 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b94576a-150d-4535-b484-4f261403539a None None] Pushing event updated for resources: {'Port': ['ID=423ab1d7-acb1-41fe-8b12-a5ed1d754ba2,revision_number=3']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:07:22.561414 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 423ab1d7-acb1-41fe-8b12-a5ed1d754ba2 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:07:22.571230 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-7454c1a9-9ad3-4d21-ac9c-b6843fe9b549 None None] Provisioning complete for port 423ab1d7-acb1-41fe-8b12-a5ed1d754ba2 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:07:22.571624 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-7454c1a9-9ad3-4d21-ac9c-b6843fe9b549 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (423ab1d7-acb1-41fe-8b12-a5ed1d754ba2), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:22.662012 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-7454c1a9-9ad3-4d21-ac9c-b6843fe9b549 None None] Current status of the port 423ab1d7-acb1-41fe-8b12-a5ed1d754ba2 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:07:24.233653 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 423ab1d7-acb1-41fe-8b12-a5ed1d754ba2 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:07:24.280573 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 423ab1d7-acb1-41fe-8b12-a5ed1d754ba2 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:07:24.280860 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (423ab1d7-acb1-41fe-8b12-a5ed1d754ba2), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:24.364365 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 423ab1d7-acb1-41fe-8b12-a5ed1d754ba2 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:07:43.969253 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 5 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:07:45.360006 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-9512114f-be1f-4af7-b6b2-8ccd1b283a71 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:47.783350 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-1ec7a1ad-7606-4076-a2d5-1fbf9da7c19c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:48.438107 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:50.036939 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:07:51.624985 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:08:15.354747 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2cb9c70c-b22d-4c4e-aaa9-bc8668d4ce11 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:08:17.789961 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ff9df05d-9e91-4a8c-8eb9-7e102f806eab None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:08:18.443245 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:08:20.041379 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:08:20.968604 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 5 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:08:21.639877 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:08:35.501800 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 34398) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:08:35.508594 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [None req-7d0f1cd8-cf26-4d32-a1f5-3cb3631107b3 tempest-verify_tempest_config-378281318 tempest-verify_tempest_config-378281318-project] http://10.222.0.118:9696/v2.0/extensions returned with HTTP 200 {{(pid=102559) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 08 18:08:35.509559 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-7d0f1cd8-cf26-4d32-a1f5-3cb3631107b3 tempest-verify_tempest_config-378281318 tempest-verify_tempest_config-378281318-project] 10.222.0.118 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0068021 Feb 08 18:08:35.823384 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 34416) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:08:35.931584 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f913ae39-d259-4eb0-b4d1-ce623ff27d59 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:08:36.006648 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f913ae39-d259-4eb0-b4d1-ce623ff27d59 admin admin] Publish callbacks [] for security_group (e6646168-e8e8-4e44-8426-acd3314d1ef0), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:08:36.012357 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f913ae39-d259-4eb0-b4d1-ce623ff27d59 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (e6646168-e8e8-4e44-8426-acd3314d1ef0), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:08:36.057079 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-f913ae39-d259-4eb0-b4d1-ce623ff27d59 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=9d9099fdb0fc46b6bc87fa1e6cf24ae4&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2326119 Feb 08 18:08:36.058831 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f913ae39-d259-4eb0-b4d1-ce623ff27d59 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e6646168-e8e8-4e44-8426-acd3314d1ef0,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:08:36.060356 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 34422) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:08:36.075787 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f913ae39-d259-4eb0-b4d1-ce623ff27d59 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:08:36.076153 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f913ae39-d259-4eb0-b4d1-ce623ff27d59 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:08:36.076497 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f913ae39-d259-4eb0-b4d1-ce623ff27d59 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:08:36.076830 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f913ae39-d259-4eb0-b4d1-ce623ff27d59 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:08:36.077157 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f913ae39-d259-4eb0-b4d1-ce623ff27d59 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:08:36.077482 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f913ae39-d259-4eb0-b4d1-ce623ff27d59 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:08:36.077814 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f913ae39-d259-4eb0-b4d1-ce623ff27d59 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:08:36.078135 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f913ae39-d259-4eb0-b4d1-ce623ff27d59 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:08:36.078469 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f913ae39-d259-4eb0-b4d1-ce623ff27d59 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:08:36.078806 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f913ae39-d259-4eb0-b4d1-ce623ff27d59 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:08:36.079125 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f913ae39-d259-4eb0-b4d1-ce623ff27d59 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:08:36.079474 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f913ae39-d259-4eb0-b4d1-ce623ff27d59 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:08:36.079785 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f913ae39-d259-4eb0-b4d1-ce623ff27d59 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:08:36.124103 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f0081167-81c6-44e2-91ae-6aa22ad85563 admin admin] Publish callbacks [] for security_group (e6646168-e8e8-4e44-8426-acd3314d1ef0), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:08:36.147293 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f0081167-81c6-44e2-91ae-6aa22ad85563 admin admin] Publish callbacks [] for security_group (e6646168-e8e8-4e44-8426-acd3314d1ef0), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:08:36.332672 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f0081167-81c6-44e2-91ae-6aa22ad85563 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (e6646168-e8e8-4e44-8426-acd3314d1ef0), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:08:36.335369 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f0081167-81c6-44e2-91ae-6aa22ad85563 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:08:36.336531 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-f0081167-81c6-44e2-91ae-6aa22ad85563 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/e6646168-e8e8-4e44-8426-acd3314d1ef0 HTTP/1.1" status: 204 len: 168 time: 0.2753103 Feb 08 18:08:36.344788 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0081167-81c6-44e2-91ae-6aa22ad85563 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e6646168-e8e8-4e44-8426-acd3314d1ef0,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:08:45.362758 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-52067d9e-67e9-4ae5-b61e-a662cafd47f8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:08:47.793901 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b552709f-d569-452b-a968-018bd6a2cec2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:08:48.450794 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:08:50.047448 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:08:51.644798 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:08:57.971908 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 5 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:09:15.360714 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-83926f93-5f9c-43c3-b3a2-1ccf116f66bd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:09:17.804631 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-058b1109-6e23-4733-95e3-346c3f0b5086 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:09:18.457383 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:09:20.051631 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:09:21.649214 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:09:34.974102 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 5 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:09:45.363509 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-1c673991-d366-4aa8-a470-3a147d509528 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:09:47.803044 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-92f4c817-5066-4ba6-9f05-d2e593c8cf36 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:09:48.459282 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:09:50.052126 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:09:51.649528 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:10:11.973187 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 5 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:10:15.364038 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-91a426cd-c853-4bb1-8471-681d802c726f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:10:17.797354 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-e604eae6-cda7-4c58-b5b8-a827ce922605 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:10:17.926518 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-560067'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:10:18.457222 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:10:20.059248 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:10:21.655762 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:10:32.579342 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 34494) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:10:32.694254 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-9f7ce8b0-4c56-4040-ac08-38aa427d21e0 admin admin] 10.222.0.118 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4560 time: 0.1137881 Feb 08 18:10:34.956153 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 34504) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:10:35.013580 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-29d247fd-9b49-4faa-a7be-b8f600a25bc7 admin admin] 10.222.0.118 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4560 time: 0.0562947 Feb 08 18:10:45.370972 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-d5c2fc9c-137c-48c0-8ca4-b8d61aa55e7c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:10:47.815019 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-769b8145-4d41-4e78-b8f3-2ce44a62a7a9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:10:47.912096 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:10:48.466131 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:10:48.978274 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:10:50.060639 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:10:51.651253 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:11:15.361527 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-5bde51e8-5a8e-4fd6-9b61-967ddd54d83a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:11:17.804707 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-c4c13f7f-2df3-4c8c-b9ae-5236f45a176f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:11:17.931374 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:11:18.463449 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:11:20.066776 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:11:21.636700 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:11:25.978932 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:11:45.356077 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-09c551c6-a133-4230-83b8-218a8c5bebe5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:11:47.805095 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-6b0df665-1220-41da-9a4a-79a60c7d93e3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:11:47.922792 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:11:48.465616 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:11:50.066211 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:11:51.641022 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:02.979038 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:12:07.137083 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 34688) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:07.165623 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 34694) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:07.323611 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 34714) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:07.347853 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1378896839-network', 'tenant_id': '4947894da18b4d0580dc1cf24ecb581c'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:07.365638 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1610510663-network', 'tenant_id': '3fb51fc0e23f4c66a482d4d406197299'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:07.370125 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Made reservation on behalf of 4947894da18b4d0580dc1cf24ecb581c for: {'network': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:12:07.374979 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for network (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:07.388278 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:07.389744 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Made reservation on behalf of 3fb51fc0e23f4c66a482d4d406197299 for: {'network': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:12:07.392273 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for network (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:07.400666 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:07.501251 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Publish callbacks [] for security_group (a70d7f73-fc20-4c96-ba3a-f48a3d3736a6), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:07.508343 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (a70d7f73-fc20-4c96-ba3a-f48a3d3736a6), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:07.543148 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a70d7f73-fc20-4c96-ba3a-f48a3d3736a6,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:07.557827 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Publish callbacks [] for security_group (3f13be41-fc10-4e73-b2e6-a6baad01d4aa), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:07.558584 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.559027 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.559398 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.559764 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.560252 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.560697 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.560914 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.561251 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.561584 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.561928 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.562282 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.562686 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.563015 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.564145 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (3f13be41-fc10-4e73-b2e6-a6baad01d4aa), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Tracked resource versions report: Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: pushed versions: Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: { 'AddressGroup': {'1.2'}, Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'ConntrackHelper': {'1.0'}, Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'LocalIPAssociation': {'1.0'}, Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'Log': {'1.0'}, Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'Network': {'1.1'}, Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'Port': {'1.7'}, Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'PortForwarding': {'1.2'}, Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'QosPolicy': {'1.10'}, Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'SecurityGroup': {'1.5'}, Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'SecurityGroupRule': {'1.2'}, Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'SubPort': {'1.0'}, Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'Subnet': {'1.1'}, Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'Trunk': {'1.1'}} Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: consumer versions: Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: { DHCP agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: HyperV agent@hv-cinder-77398: {}, Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: L3 agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: Metadata agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: Metering agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: Open vSwitch agent@dv-cinder-773985-21-iscsi: { 'AddressGroup': '1.2', Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'ConntrackHelper': '1.0', Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'LocalIPAssociation': '1.0', Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'Log': '1.0', Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'Network': '1.1', Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'Port': '1.7', Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'PortForwarding': '1.2', Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'QosPolicy': '1.10', Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'SecurityGroup': '1.5', Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'SecurityGroupRule': '1.2', Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'SubPort': '1.0', Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'Subnet': '1.1', Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: 'Trunk': '1.1'}} Feb 08 18:12:07.564385 dv-cinder-773985-21-iscsi neutron-server[102560]: {{(pid=102560) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Feb 08 18:12:07.571149 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] vlan segment allocate from pool success with {'vlan_id': 1093, 'physical_network': 'physnet1'} {{(pid=102560) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Feb 08 18:12:07.582995 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (36b36f15-bf90-46bb-ac3a-109acbbc7fd3), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:07.583629 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.segments_db [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Added segment 36b36f15-bf90-46bb-ac3a-109acbbc7fd3 of type vlan for network c6ecb925-b9a5-4524-9125-b49155fa007e Feb 08 18:12:07.623168 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] vlan segment allocate from pool success with {'vlan_id': 1065, 'physical_network': 'physnet1'} {{(pid=102559) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Feb 08 18:12:07.626406 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3f13be41-fc10-4e73-b2e6-a6baad01d4aa,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:07.636436 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.637049 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.637547 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.638671 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.639219 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.639551 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.639983 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8770558521384'] for network (c6ecb925-b9a5-4524-9125-b49155fa007e), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:07.640210 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.640699 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.641186 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.641680 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.642158 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.646721 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.647267 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Tracked resource versions report: Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: pushed versions: Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: { 'AddressGroup': {'1.2'}, Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'ConntrackHelper': {'1.0'}, Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'LocalIPAssociation': {'1.0'}, Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'Log': {'1.0'}, Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'Network': {'1.1'}, Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'Port': {'1.7'}, Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'PortForwarding': {'1.2'}, Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'QosPolicy': {'1.10'}, Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'SecurityGroup': {'1.5'}, Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'SecurityGroupRule': {'1.2'}, Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'SubPort': {'1.0'}, Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'Subnet': {'1.1'}, Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'Trunk': {'1.1'}} Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: consumer versions: Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: { DHCP agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: HyperV agent@hv-cinder-77398: {}, Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: L3 agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: Metadata agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: Metering agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: Open vSwitch agent@dv-cinder-773985-21-iscsi: { 'AddressGroup': '1.2', Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'ConntrackHelper': '1.0', Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'LocalIPAssociation': '1.0', Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'Log': '1.0', Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'Network': '1.1', Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'Port': '1.7', Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'PortForwarding': '1.2', Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'QosPolicy': '1.10', Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'SecurityGroup': '1.5', Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'SecurityGroupRule': '1.2', Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'SubPort': '1.0', Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'Subnet': '1.1', Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: 'Trunk': '1.1'}} Feb 08 18:12:07.648580 dv-cinder-773985-21-iscsi neutron-server[102559]: {{(pid=102559) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Feb 08 18:12:07.671558 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for network (c6ecb925-b9a5-4524-9125-b49155fa007e), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:07.672649 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:07.673507 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:07.676679 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8770558865080', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (7e36cc20-402b-47f5-9242-a15d0de4717c), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:07.677468 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Unsubscribe: segment precommit_create {{(pid=102559) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Feb 08 18:12:07.678360 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.db.segments_db [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Added segment 7e36cc20-402b-47f5-9242-a15d0de4717c of type vlan for network f089911e-72de-4ff6-880b-ac3dd7927165 Feb 08 18:12:07.739198 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] 10.222.0.118 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.6009009 Feb 08 18:12:07.741995 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 34732) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:07.744160 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8770558521384'] for network (f089911e-72de-4ff6-880b-ac3dd7927165), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:07.747185 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-f89dabfd-2fb3-4cfa-997f-74c459795c06 admin admin] Request body: {'subnet': {'network_id': 'c6ecb925-b9a5-4524-9125-b49155fa007e', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1378896839-subnet', 'tenant_id': '4947894da18b4d0580dc1cf24ecb581c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:07.755877 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4df2fa1-dddc-4d51-a966-83159a4e3f7e admin admin] Pushing event updated for resources: {'Network': ['ID=c6ecb925-b9a5-4524-9125-b49155fa007e,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:07.765931 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Network c6ecb925-b9a5-4524-9125-b49155fa007e details requested by agent ovs-agent-dv-cinder-773985-21-iscsi with host dv-cinder-773985-21-iscsi {{(pid=102561) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Feb 08 18:12:07.777004 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f89dabfd-2fb3-4cfa-997f-74c459795c06 admin admin] Made reservation on behalf of 4947894da18b4d0580dc1cf24ecb581c for: {'subnet': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:12:07.779954 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f89dabfd-2fb3-4cfa-997f-74c459795c06 admin admin] Publish callbacks [] for subnet (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:07.824353 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for network (f089911e-72de-4ff6-880b-ac3dd7927165), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:07.825461 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:07.826045 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:08.008158 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f89dabfd-2fb3-4cfa-997f-74c459795c06 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for subnet (bb9e2714-8d92-49d4-a88e-0ba6d48e2ad3), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:08.031029 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-e82e81de-f5de-4a65-bb22-db69dae14d20 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-997005721-network', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:08.040298 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 34740) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:08.046555 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 34744) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:08.046788 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] 10.222.0.118 "POST /v2.0/networks HTTP/1.1" status: 201 len: 893 time: 0.8797886 Feb 08 18:12:08.056645 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-71afaac4-7377-4c34-9215-a476634f14ad admin admin] Request body: {'subnet': {'network_id': 'f089911e-72de-4ff6-880b-ac3dd7927165', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1610510663-subnet', 'tenant_id': '3fb51fc0e23f4c66a482d4d406197299', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:08.085135 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a44171c-b550-4965-8cd5-677a6aeb18a8 admin admin] Pushing event updated for resources: {'Network': ['ID=f089911e-72de-4ff6-880b-ac3dd7927165,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:08.095917 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-71afaac4-7377-4c34-9215-a476634f14ad admin admin] Made reservation on behalf of 3fb51fc0e23f4c66a482d4d406197299 for: {'subnet': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:12:08.098902 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-71afaac4-7377-4c34-9215-a476634f14ad admin admin] Publish callbacks [] for subnet (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:08.102654 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Network f089911e-72de-4ff6-880b-ac3dd7927165 details requested by agent ovs-agent-dv-cinder-773985-21-iscsi with host dv-cinder-773985-21-iscsi {{(pid=102561) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Feb 08 18:12:08.103023 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e82e81de-f5de-4a65-bb22-db69dae14d20 admin admin] Made reservation on behalf of 630172c388404c75bda3d0ba2d9d5834 for: {'network': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:12:08.105743 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e82e81de-f5de-4a65-bb22-db69dae14d20 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for network (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:08.115050 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e82e81de-f5de-4a65-bb22-db69dae14d20 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:08.117211 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f89dabfd-2fb3-4cfa-997f-74c459795c06 admin admin] Pushing event updated for resources: {'Subnet': ['ID=bb9e2714-8d92-49d4-a88e-0ba6d48e2ad3,revision_number=0']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:08.272216 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f89dabfd-2fb3-4cfa-997f-74c459795c06 admin admin] Checking segment: {'id': '36b36f15-bf90-46bb-ac3a-109acbbc7fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1093, 'network_id': 'c6ecb925-b9a5-4524-9125-b49155fa007e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102560) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:12:08.273543 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f89dabfd-2fb3-4cfa-997f-74c459795c06 admin admin] Network hostable DHCP agents. Network: c6ecb925-b9a5-4524-9125-b49155fa007e, hostable agents: ['006b5388-ac7d-4794-a124-14bb8e5d8fec'], hosted agents: [] {{(pid=102560) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Feb 08 18:12:08.306149 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e82e81de-f5de-4a65-bb22-db69dae14d20 admin admin] Publish callbacks [] for security_group (bac1a928-adf4-482b-b92b-1646f13f5125), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:08.314325 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e82e81de-f5de-4a65-bb22-db69dae14d20 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (bac1a928-adf4-482b-b92b-1646f13f5125), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:08.327438 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f89dabfd-2fb3-4cfa-997f-74c459795c06 admin admin] Network c6ecb925-b9a5-4524-9125-b49155fa007e is scheduled to be hosted by DHCP agent 006b5388-ac7d-4794-a124-14bb8e5d8fec with binding_index 1 {{(pid=102560) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Feb 08 18:12:08.350632 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-f89dabfd-2fb3-4cfa-997f-74c459795c06 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773985-21-iscsi, c6ecb925-b9a5-4524-9125-b49155fa007e) {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:08.360312 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-caec4eb8-28cc-4349-b7eb-e0e33272a36f None None] Network c6ecb925-b9a5-4524-9125-b49155fa007e requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:12:08.368831 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e82e81de-f5de-4a65-bb22-db69dae14d20 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bac1a928-adf4-482b-b92b-1646f13f5125,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:08.369951 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f89dabfd-2fb3-4cfa-997f-74c459795c06 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:08.370717 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f89dabfd-2fb3-4cfa-997f-74c459795c06 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:08.391346 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e82e81de-f5de-4a65-bb22-db69dae14d20 admin admin] vlan segment allocate from pool success with {'vlan_id': 1082, 'physical_network': 'physnet1'} {{(pid=102559) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Feb 08 18:12:08.415279 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e82e81de-f5de-4a65-bb22-db69dae14d20 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (acdceaea-bf94-4e23-8e9f-0f5d9197e75f), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:08.416492 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.db.segments_db [None req-e82e81de-f5de-4a65-bb22-db69dae14d20 admin admin] Added segment acdceaea-bf94-4e23-8e9f-0f5d9197e75f of type vlan for network e430084e-9b28-426f-9937-61346814b135 Feb 08 18:12:08.418995 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-f89dabfd-2fb3-4cfa-997f-74c459795c06 admin admin] 10.222.0.118 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.6747646 Feb 08 18:12:08.555149 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-fc92dcbf-14b0-41e4-855c-b965dc299bea admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-785190803-network', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:08.567169 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9846440c-e247-497a-b7c6-7cf3fb6cb871 None None] Network c6ecb925-b9a5-4524-9125-b49155fa007e requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:12:08.601584 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e82e81de-f5de-4a65-bb22-db69dae14d20 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8770558521384'] for network (e430084e-9b28-426f-9937-61346814b135), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:08.611300 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-71afaac4-7377-4c34-9215-a476634f14ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for subnet (0af67967-364e-4325-b04f-b7e157c3c3d4), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:08.667105 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e82e81de-f5de-4a65-bb22-db69dae14d20 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for network (e430084e-9b28-426f-9937-61346814b135), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:08.668306 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e82e81de-f5de-4a65-bb22-db69dae14d20 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:08.671823 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e82e81de-f5de-4a65-bb22-db69dae14d20 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:08.710910 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71afaac4-7377-4c34-9215-a476634f14ad admin admin] Pushing event updated for resources: {'Subnet': ['ID=0af67967-364e-4325-b04f-b7e157c3c3d4,revision_number=0']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:08.777711 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-71afaac4-7377-4c34-9215-a476634f14ad admin admin] Checking segment: {'id': '7e36cc20-402b-47f5-9242-a15d0de4717c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'f089911e-72de-4ff6-880b-ac3dd7927165'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102560) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:12:08.778229 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71afaac4-7377-4c34-9215-a476634f14ad admin admin] Network hostable DHCP agents. Network: f089911e-72de-4ff6-880b-ac3dd7927165, hostable agents: ['006b5388-ac7d-4794-a124-14bb8e5d8fec'], hosted agents: [] {{(pid=102560) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Feb 08 18:12:08.787343 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e82e81de-f5de-4a65-bb22-db69dae14d20 admin admin] Pushing event updated for resources: {'Network': ['ID=e430084e-9b28-426f-9937-61346814b135,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:08.789876 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fc92dcbf-14b0-41e4-855c-b965dc299bea admin admin] Made reservation on behalf of 357dab3d3db74ef9a8ee50fdd8a8bdcd for: {'network': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:12:08.792664 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fc92dcbf-14b0-41e4-855c-b965dc299bea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for network (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:08.802006 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Network e430084e-9b28-426f-9937-61346814b135 details requested by agent ovs-agent-dv-cinder-773985-21-iscsi with host dv-cinder-773985-21-iscsi {{(pid=102561) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Feb 08 18:12:08.805465 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-71afaac4-7377-4c34-9215-a476634f14ad admin admin] Network f089911e-72de-4ff6-880b-ac3dd7927165 is scheduled to be hosted by DHCP agent 006b5388-ac7d-4794-a124-14bb8e5d8fec with binding_index 1 {{(pid=102560) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Feb 08 18:12:08.811692 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fc92dcbf-14b0-41e4-855c-b965dc299bea admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:08.830465 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-71afaac4-7377-4c34-9215-a476634f14ad admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773985-21-iscsi, f089911e-72de-4ff6-880b-ac3dd7927165) {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:08.839290 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-71afaac4-7377-4c34-9215-a476634f14ad admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:08.840200 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-71afaac4-7377-4c34-9215-a476634f14ad admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:08.877439 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-71afaac4-7377-4c34-9215-a476634f14ad admin admin] 10.222.0.118 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 856 time: 0.8274405 Feb 08 18:12:08.889752 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9dc52740-6fcb-4ab2-95cf-26b6dc54370c None None] Network f089911e-72de-4ff6-880b-ac3dd7927165 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:12:08.897240 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fc92dcbf-14b0-41e4-855c-b965dc299bea admin admin] Publish callbacks [] for security_group (fe897b30-e023-4c28-9280-5753c32a5659), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:08.911077 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-e82e81de-f5de-4a65-bb22-db69dae14d20 admin admin] 10.222.0.118 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 1.5829148 Feb 08 18:12:08.911318 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 34774) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:08.928843 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-a2e41ffd-cb77-4c79-9225-836f995d04c2 admin admin] Request body: {'subnet': {'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-997005721-subnet', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:08.930245 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 34776) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:08.935765 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-cd5b810c-a535-48af-be1a-814d97736277 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1610510663-router', 'tenant_id': '3fb51fc0e23f4c66a482d4d406197299', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:08.940071 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fc92dcbf-14b0-41e4-855c-b965dc299bea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (fe897b30-e023-4c28-9280-5753c32a5659), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:08.982740 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-cd5b810c-a535-48af-be1a-814d97736277 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-557369', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6968'] for router (751d5daa-7864-4c4e-a90b-e2428fafc279), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:08.983905 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-cd5b810c-a535-48af-be1a-814d97736277 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-557389', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-560615', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-578936', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6961'] for router (751d5daa-7864-4c4e-a90b-e2428fafc279), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:09.014260 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fc92dcbf-14b0-41e4-855c-b965dc299bea admin admin] vlan segment allocate from pool success with {'vlan_id': 1053, 'physical_network': 'physnet1'} {{(pid=102559) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Feb 08 18:12:09.094900 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-cd5b810c-a535-48af-be1a-814d97736277 admin admin] Publish callbacks [] for router_controller (751d5daa-7864-4c4e-a90b-e2428fafc279), precommit_add_association {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:09.104709 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc92dcbf-14b0-41e4-855c-b965dc299bea admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fe897b30-e023-4c28-9280-5753c32a5659,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:09.130988 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a2e41ffd-cb77-4c79-9225-836f995d04c2 admin admin] Made reservation on behalf of 630172c388404c75bda3d0ba2d9d5834 for: {'subnet': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:12:09.133508 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a2e41ffd-cb77-4c79-9225-836f995d04c2 admin admin] Publish callbacks [] for subnet (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:09.168441 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-486feae2-ffbc-47f5-87a9-3a158724cd19 None None] Network f089911e-72de-4ff6-880b-ac3dd7927165 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:12:09.291455 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fc92dcbf-14b0-41e4-855c-b965dc299bea admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (87601f46-1ba0-4a2e-93d3-e5859bcfbefa), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:09.293357 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.db.segments_db [None req-fc92dcbf-14b0-41e4-855c-b965dc299bea admin admin] Added segment 87601f46-1ba0-4a2e-93d3-e5859bcfbefa of type vlan for network 7a854399-3ce6-42bd-bfc4-061132ecb9c2 Feb 08 18:12:09.417574 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fc92dcbf-14b0-41e4-855c-b965dc299bea admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8770558521384'] for network (7a854399-3ce6-42bd-bfc4-061132ecb9c2), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:09.428657 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-cd5b810c-a535-48af-be1a-814d97736277 admin admin] Publish callbacks [] for router_gateway (751d5daa-7864-4c4e-a90b-e2428fafc279), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:09.487625 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fc92dcbf-14b0-41e4-855c-b965dc299bea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for network (7a854399-3ce6-42bd-bfc4-061132ecb9c2), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:09.488980 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fc92dcbf-14b0-41e4-855c-b965dc299bea admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:09.489763 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fc92dcbf-14b0-41e4-855c-b965dc299bea admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:09.568609 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-fc92dcbf-14b0-41e4-855c-b965dc299bea admin admin] 10.222.0.118 "POST /v2.0/networks HTTP/1.1" status: 201 len: 890 time: 1.5207560 Feb 08 18:12:09.571928 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 34816) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:09.579147 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-aef10a14-5ce7-4812-95f4-df3bb6dd343b admin admin] Request body: {'subnet': {'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-785190803-subnet', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:09.599374 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc92dcbf-14b0-41e4-855c-b965dc299bea admin admin] Pushing event updated for resources: {'Network': ['ID=7a854399-3ce6-42bd-bfc4-061132ecb9c2,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:09.617078 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Network 7a854399-3ce6-42bd-bfc4-061132ecb9c2 details requested by agent ovs-agent-dv-cinder-773985-21-iscsi with host dv-cinder-773985-21-iscsi {{(pid=102561) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Feb 08 18:12:09.618832 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a2e41ffd-cb77-4c79-9225-836f995d04c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for subnet (86592955-e7d0-4e8a-9490-976e17240d7c), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:09.659909 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aef10a14-5ce7-4812-95f4-df3bb6dd343b admin admin] Made reservation on behalf of 357dab3d3db74ef9a8ee50fdd8a8bdcd for: {'subnet': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:12:09.669836 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-aef10a14-5ce7-4812-95f4-df3bb6dd343b admin admin] Publish callbacks [] for subnet (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:09.743127 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a2e41ffd-cb77-4c79-9225-836f995d04c2 admin admin] Checking segment: {'id': 'acdceaea-bf94-4e23-8e9f-0f5d9197e75f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1082, 'network_id': 'e430084e-9b28-426f-9937-61346814b135'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102559) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:12:09.743496 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a2e41ffd-cb77-4c79-9225-836f995d04c2 admin admin] Network hostable DHCP agents. Network: e430084e-9b28-426f-9937-61346814b135, hostable agents: ['006b5388-ac7d-4794-a124-14bb8e5d8fec'], hosted agents: [] {{(pid=102559) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Feb 08 18:12:09.781041 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a2e41ffd-cb77-4c79-9225-836f995d04c2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=86592955-e7d0-4e8a-9490-976e17240d7c,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:09.789556 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a2e41ffd-cb77-4c79-9225-836f995d04c2 admin admin] Network e430084e-9b28-426f-9937-61346814b135 is scheduled to be hosted by DHCP agent 006b5388-ac7d-4794-a124-14bb8e5d8fec with binding_index 1 {{(pid=102559) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Feb 08 18:12:09.819150 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-a2e41ffd-cb77-4c79-9225-836f995d04c2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773985-21-iscsi, e430084e-9b28-426f-9937-61346814b135) {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:09.831668 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a2e41ffd-cb77-4c79-9225-836f995d04c2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:09.832503 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a2e41ffd-cb77-4c79-9225-836f995d04c2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:09.834123 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-09ebfd46-b71c-4b50-8306-da6391e62c4e None None] Network e430084e-9b28-426f-9937-61346814b135 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:12:09.860868 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-a2e41ffd-cb77-4c79-9225-836f995d04c2 admin admin] 10.222.0.118 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.9479752 Feb 08 18:12:09.865682 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-cd5b810c-a535-48af-be1a-814d97736277 admin admin] Publish callbacks [] for router_gateway (751d5daa-7864-4c4e-a90b-e2428fafc279), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:09.917006 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 34846) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:09.925890 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-c7b2e591-4839-4db5-8475-cf867fde5d89 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-997005721-router', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:09.939553 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-cd5b810c-a535-48af-be1a-814d97736277 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:09.988627 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c7b2e591-4839-4db5-8475-cf867fde5d89 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-557369', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6968'] for router (3c53cb16-5d43-40f1-a3a6-2ca2f7a42984), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:09.999321 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c7b2e591-4839-4db5-8475-cf867fde5d89 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-557389', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-560615', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-578936', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6961'] for router (3c53cb16-5d43-40f1-a3a6-2ca2f7a42984), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:10.112668 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp7dd4f88d-be07-54f7-888b-e9d2dcd2237c-e430084e-9b28-426f-9937-61346814b135', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'fixed_ips': [{'subnet_id': '86592955-e7d0-4e8a-9490-976e17240d7c'}]}} from dv-cinder-773985-21-iscsi. {{(pid=102561) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Feb 08 18:12:10.113915 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:10.135121 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-aef10a14-5ce7-4812-95f4-df3bb6dd343b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for subnet (73de7865-d87d-4a2a-a702-160c400f145f), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:10.155082 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c7b2e591-4839-4db5-8475-cf867fde5d89 admin admin] Publish callbacks [] for router_controller (3c53cb16-5d43-40f1-a3a6-2ca2f7a42984), precommit_add_association {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:10.214009 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_common [None req-cd5b810c-a535-48af-be1a-814d97736277 admin admin] Allocated IP 172.27.1.140 (77055816-7c88-403d-8f8a-9be2c1faa10d/18547c52-7b23-42cd-bb53-214663ed102b/af462b70-3112-405d-a84b-10c4370a9bbe) {{(pid=102560) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:12:10.240856 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 34866) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:10.280126 dv-cinder-773985-21-iscsi neutron-server[102560]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Feb 08 18:12:10.384940 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aef10a14-5ce7-4812-95f4-df3bb6dd343b admin admin] Pushing event updated for resources: {'Subnet': ['ID=73de7865-d87d-4a2a-a702-160c400f145f,revision_number=0']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:10.399396 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c7b2e591-4839-4db5-8475-cf867fde5d89 admin admin] Publish callbacks [] for router_gateway (3c53cb16-5d43-40f1-a3a6-2ca2f7a42984), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:10.490130 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 34886) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:10.536206 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.db_base_plugin_common [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Allocated IP 172.20.0.2 (e430084e-9b28-426f-9937-61346814b135/86592955-e7d0-4e8a-9490-976e17240d7c/e32a7e0c-0045-4331-a9ac-7dc7ba90cadf) {{(pid=102561) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:12:10.758036 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Publish callbacks [] for port (e32a7e0c-0045-4331-a9ac-7dc7ba90cadf), precommit_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:10.771186 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (e32a7e0c-0045-4331-a9ac-7dc7ba90cadf), after_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:10.783028 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aef10a14-5ce7-4812-95f4-df3bb6dd343b admin admin] Checking segment: {'id': '87601f46-1ba0-4a2e-93d3-e5859bcfbefa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1053, 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102560) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:12:10.783394 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aef10a14-5ce7-4812-95f4-df3bb6dd343b admin admin] Network hostable DHCP agents. Network: 7a854399-3ce6-42bd-bfc4-061132ecb9c2, hostable agents: ['006b5388-ac7d-4794-a124-14bb8e5d8fec'], hosted agents: [] {{(pid=102560) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Feb 08 18:12:10.875017 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Pushing event updated for resources: {'Port': ['ID=e32a7e0c-0045-4331-a9ac-7dc7ba90cadf,revision_number=1']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:10.897049 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:10.897426 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:10.897940 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:10.898282 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:10.898611 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:10.898957 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:10.899296 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:10.899502 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c7b2e591-4839-4db5-8475-cf867fde5d89 admin admin] Publish callbacks [] for router_gateway (3c53cb16-5d43-40f1-a3a6-2ca2f7a42984), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:10.899990 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:10.899990 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:10.900421 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:10.900740 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:10.901155 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:10.901589 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:10.903521 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aef10a14-5ce7-4812-95f4-df3bb6dd343b admin admin] Network 7a854399-3ce6-42bd-bfc4-061132ecb9c2 is scheduled to be hosted by DHCP agent 006b5388-ac7d-4794-a124-14bb8e5d8fec with binding_index 1 {{(pid=102560) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Tracked resource versions report: Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: pushed versions: Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: { 'AddressGroup': {'1.2'}, Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'ConntrackHelper': {'1.0'}, Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'LocalIPAssociation': {'1.0'}, Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'Log': {'1.0'}, Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'Network': {'1.1'}, Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'Port': {'1.7'}, Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'PortForwarding': {'1.2'}, Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'QosPolicy': {'1.10'}, Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'SecurityGroup': {'1.5'}, Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'SecurityGroupRule': {'1.2'}, Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'SubPort': {'1.0'}, Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'Subnet': {'1.1'}, Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'Trunk': {'1.1'}} Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: consumer versions: Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: { DHCP agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: HyperV agent@hv-cinder-77398: {}, Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: L3 agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: Metadata agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: Metering agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: Open vSwitch agent@dv-cinder-773985-21-iscsi: { 'AddressGroup': '1.2', Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'ConntrackHelper': '1.0', Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'LocalIPAssociation': '1.0', Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'Log': '1.0', Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'Network': '1.1', Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'Port': '1.7', Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'PortForwarding': '1.2', Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'QosPolicy': '1.10', Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'SecurityGroup': '1.5', Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'SecurityGroupRule': '1.2', Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'SubPort': '1.0', Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'Subnet': '1.1', Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: 'Trunk': '1.1'}} Feb 08 18:12:10.907606 dv-cinder-773985-21-iscsi neutron-server[102561]: {{(pid=102561) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Feb 08 18:12:10.938254 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Network e430084e-9b28-426f-9937-61346814b135 is already hosted by enough agents. {{(pid=102561) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:12:10.943516 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.scheduler.base_scheduler [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Resources bound (agent type, host, resource id): {{(pid=102561) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:10.949171 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Received port after_create {{(pid=102561) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:12:10.965567 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c7b2e591-4839-4db5-8475-cf867fde5d89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:10.980890 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-aef10a14-5ce7-4812-95f4-df3bb6dd343b admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773985-21-iscsi, 7a854399-3ce6-42bd-bfc4-061132ecb9c2) {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:10.994286 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-f4aca6a5-18eb-4aaf-b010-9d56b02fc27b tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:11.001436 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-f4aca6a5-18eb-4aaf-b010-9d56b02fc27b tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/networks?id=c6ecb925-b9a5-4524-9125-b49155fa007e HTTP/1.1" status: 200 len: 812 time: 0.7454414 Feb 08 18:12:11.006067 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4e9652a0-68b2-4f5d-8ca7-44ab1b6c2cc8 None None] Network 7a854399-3ce6-42bd-bfc4-061132ecb9c2 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:12:11.009931 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-aef2f921-e5b4-4fa4-b099-6420c07ef26c admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:11.019263 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aef10a14-5ce7-4812-95f4-df3bb6dd343b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:11.020147 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-aef10a14-5ce7-4812-95f4-df3bb6dd343b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:11.045130 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-cd5b810c-a535-48af-be1a-814d97736277 admin admin] Publish callbacks [] for port (af462b70-3112-405d-a84b-10c4370a9bbe), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:11.055968 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-2eb96c36-dccb-4e7a-a576-b51eac3b468c tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/quotas/4947894da18b4d0580dc1cf24ecb581c HTTP/1.1" status: 200 len: 375 time: 0.0529265 Feb 08 18:12:11.125853 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Attempting to bind port e32a7e0c-0045-4331-a9ac-7dc7ba90cadf on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:12:11.126525 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Attempting to bind port e32a7e0c-0045-4331-a9ac-7dc7ba90cadf by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': 'acdceaea-bf94-4e23-8e9f-0f5d9197e75f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1082, 'network_id': 'e430084e-9b28-426f-9937-61346814b135'}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:12:11.126919 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Attempting to bind port e32a7e0c-0045-4331-a9ac-7dc7ba90cadf on network e430084e-9b28-426f-9937-61346814b135 {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:12:11.133235 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-f7418c2f-dca2-4efe-8a14-b80bae1396d8 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?tenant_id=4947894da18b4d0580dc1cf24ecb581c&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0758135 Feb 08 18:12:11.136158 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 11, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:12:11.136329 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Checking segment: {'id': 'acdceaea-bf94-4e23-8e9f-0f5d9197e75f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1082, 'network_id': 'e430084e-9b28-426f-9937-61346814b135'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102561) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:12:11.136655 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:11.137034 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Bound using segment: {'id': 'acdceaea-bf94-4e23-8e9f-0f5d9197e75f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1082, 'network_id': 'e430084e-9b28-426f-9937-61346814b135'} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:12:11.137533 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Bound port: e32a7e0c-0045-4331-a9ac-7dc7ba90cadf, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'acdceaea-bf94-4e23-8e9f-0f5d9197e75f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1082, 'network_id': 'e430084e-9b28-426f-9937-61346814b135'}}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:12:11.137860 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (e32a7e0c-0045-4331-a9ac-7dc7ba90cadf), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:11.164813 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-aef10a14-5ce7-4812-95f4-df3bb6dd343b admin admin] 10.222.0.118 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 1.5921860 Feb 08 18:12:11.167611 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 34912) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:11.224008 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 34916) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:11.229224 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-cd154ed7-fe7d-43ba-99de-7be0e57858cd admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-785190803-router', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:11.232423 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c244f43-430d-4c42-aac1-beb51345699f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp7dd4f88d-be07-54f7-888b-e9d2dcd2237c-7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'fixed_ips': [{'subnet_id': '73de7865-d87d-4a2a-a702-160c400f145f'}]}} from dv-cinder-773985-21-iscsi. {{(pid=102561) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Feb 08 18:12:11.239579 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-aef2f921-e5b4-4fa4-b099-6420c07ef26c admin admin] Publish callbacks [] for security_group (bbec98be-8cc2-45ad-aef1-cab627a2d2cc), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:11.241898 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-cd5b810c-a535-48af-be1a-814d97736277 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (af462b70-3112-405d-a84b-10c4370a9bbe), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:11.243546 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-1c244f43-430d-4c42-aac1-beb51345699f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:11.260744 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-aef2f921-e5b4-4fa4-b099-6420c07ef26c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (bbec98be-8cc2-45ad-aef1-cab627a2d2cc), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:11.308419 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-cd154ed7-fe7d-43ba-99de-7be0e57858cd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-557369', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6968'] for router (058f0c04-e3de-4d16-8a7a-a7247919133c), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:11.309771 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-cd154ed7-fe7d-43ba-99de-7be0e57858cd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-557389', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-560615', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-578936', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6961'] for router (058f0c04-e3de-4d16-8a7a-a7247919133c), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:11.327485 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [None req-c7b2e591-4839-4db5-8475-cf867fde5d89 admin admin] Allocated IP 172.27.1.77 (77055816-7c88-403d-8f8a-9be2c1faa10d/18547c52-7b23-42cd-bb53-214663ed102b/ae5f46f2-7729-4ab9-95e0-646bf67653f0) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:12:11.353033 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-aef2f921-e5b4-4fa4-b099-6420c07ef26c admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=d8c6e656459e4ad6923ace1d67ab021a&name=default HTTP/1.1" status: 200 len: 2992 time: 0.6512117 Feb 08 18:12:11.355344 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aef2f921-e5b4-4fa4-b099-6420c07ef26c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bbec98be-8cc2-45ad-aef1-cab627a2d2cc,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:11.362311 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 34918) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:11.372527 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cd5b810c-a535-48af-be1a-814d97736277 admin admin] Network 77055816-7c88-403d-8f8a-9be2c1faa10d is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:12:11.377283 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-cd5b810c-a535-48af-be1a-814d97736277 admin admin] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:11.383932 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd5b810c-a535-48af-be1a-814d97736277 admin admin] Received port after_create {{(pid=102560) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:12:11.401397 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] For port e32a7e0c-0045-4331-a9ac-7dc7ba90cadf, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102561) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:12:11.423042 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] For port e32a7e0c-0045-4331-a9ac-7dc7ba90cadf, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=e32a7e0c-0045-4331-a9ac-7dc7ba90cadf,segment=NetworkSegment(acdceaea-bf94-4e23-8e9f-0f5d9197e75f),segment_id=acdceaea-bf94-4e23-8e9f-0f5d9197e75f)] {{(pid=102561) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:12:11.440785 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (e32a7e0c-0045-4331-a9ac-7dc7ba90cadf), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:11.449448 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.db_base_plugin_common [None req-1c244f43-430d-4c42-aac1-beb51345699f None None] Allocated IP 172.20.0.2 (7a854399-3ce6-42bd-bfc4-061132ecb9c2/73de7865-d87d-4a2a-a702-160c400f145f/d9374f34-b117-40ce-9bb7-744f0c221b6b) {{(pid=102561) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:12:11.457609 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e2700845-9688-446c-8ca3-b771b78ecb42 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:11.497282 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-cd154ed7-fe7d-43ba-99de-7be0e57858cd admin admin] Publish callbacks [] for router_controller (058f0c04-e3de-4d16-8a7a-a7247919133c), precommit_add_association {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:11.519082 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-e54a3981-f5a4-43d6-9ee4-ae17a1a9e670 service neutron] http://10.222.0.118:9696/v2.0/extensions returned with HTTP 200 {{(pid=102560) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 08 18:12:11.521106 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-e54a3981-f5a4-43d6-9ee4-ae17a1a9e670 service neutron] 10.222.0.118 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1667187 Feb 08 18:12:11.556609 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03d63120-9bea-4664-bea8-4d63d0c336b8 None None] Pushing event updated for resources: {'Port': ['ID=e32a7e0c-0045-4331-a9ac-7dc7ba90cadf,revision_number=2']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:11.585653 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd5b810c-a535-48af-be1a-814d97736277 admin admin] Pushing event updated for resources: {'Port': ['ID=af462b70-3112-405d-a84b-10c4370a9bbe,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:11.668273 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-1c244f43-430d-4c42-aac1-beb51345699f None None] Publish callbacks [] for port (d9374f34-b117-40ce-9bb7-744f0c221b6b), precommit_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:11.678107 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-1c244f43-430d-4c42-aac1-beb51345699f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (d9374f34-b117-40ce-9bb7-744f0c221b6b), after_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:11.718364 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-ca9de2c5-70b9-4472-a617-7113b438ed53 service neutron] 10.222.0.118 "GET /v2.0/networks/c6ecb925-b9a5-4524-9125-b49155fa007e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1857514 Feb 08 18:12:11.718942 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1c244f43-430d-4c42-aac1-beb51345699f None None] Network 7a854399-3ce6-42bd-bfc4-061132ecb9c2 is already hosted by enough agents. {{(pid=102561) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:12:11.722083 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.scheduler.base_scheduler [None req-1c244f43-430d-4c42-aac1-beb51345699f None None] Resources bound (agent type, host, resource id): {{(pid=102561) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:11.722562 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-cd5b810c-a535-48af-be1a-814d97736277 admin admin] Publish callbacks [] for router_gateway (751d5daa-7864-4c4e-a90b-e2428fafc279), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:11.725816 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1c244f43-430d-4c42-aac1-beb51345699f None None] Received port after_create {{(pid=102561) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:12:11.764849 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c244f43-430d-4c42-aac1-beb51345699f None None] Pushing event updated for resources: {'Port': ['ID=d9374f34-b117-40ce-9bb7-744f0c221b6b,revision_number=1']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:11.780733 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-76666b6d-1ab2-42b6-8dd0-a229916e6e0a admin admin] Publish callbacks [] for security_group (bbec98be-8cc2-45ad-aef1-cab627a2d2cc), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:11.863347 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-1c244f43-430d-4c42-aac1-beb51345699f None None] Attempting to bind port d9374f34-b117-40ce-9bb7-744f0c221b6b on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:12:11.863347 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-1c244f43-430d-4c42-aac1-beb51345699f None None] Attempting to bind port d9374f34-b117-40ce-9bb7-744f0c221b6b by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': '87601f46-1ba0-4a2e-93d3-e5859bcfbefa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1053, 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2'}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:12:11.863347 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c244f43-430d-4c42-aac1-beb51345699f None None] Attempting to bind port d9374f34-b117-40ce-9bb7-744f0c221b6b on network 7a854399-3ce6-42bd-bfc4-061132ecb9c2 {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:12:11.863347 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c244f43-430d-4c42-aac1-beb51345699f None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 11, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:12:11.863347 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c244f43-430d-4c42-aac1-beb51345699f None None] Checking segment: {'id': '87601f46-1ba0-4a2e-93d3-e5859bcfbefa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1053, 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102561) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:12:11.863347 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-1c244f43-430d-4c42-aac1-beb51345699f None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:11.863347 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-1c244f43-430d-4c42-aac1-beb51345699f None None] Bound using segment: {'id': '87601f46-1ba0-4a2e-93d3-e5859bcfbefa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1053, 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2'} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:12:11.863347 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-1c244f43-430d-4c42-aac1-beb51345699f None None] Bound port: d9374f34-b117-40ce-9bb7-744f0c221b6b, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '87601f46-1ba0-4a2e-93d3-e5859bcfbefa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1053, 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2'}}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:12:11.863347 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-1c244f43-430d-4c42-aac1-beb51345699f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (d9374f34-b117-40ce-9bb7-744f0c221b6b), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:11.870701 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-76666b6d-1ab2-42b6-8dd0-a229916e6e0a admin admin] Publish callbacks [] for security_group (bbec98be-8cc2-45ad-aef1-cab627a2d2cc), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:11.940625 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-1c244f43-430d-4c42-aac1-beb51345699f None None] For port d9374f34-b117-40ce-9bb7-744f0c221b6b, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102561) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:12:11.944495 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-1c244f43-430d-4c42-aac1-beb51345699f None None] For port d9374f34-b117-40ce-9bb7-744f0c221b6b, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=d9374f34-b117-40ce-9bb7-744f0c221b6b,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102561) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:12:11.958914 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-1c244f43-430d-4c42-aac1-beb51345699f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (d9374f34-b117-40ce-9bb7-744f0c221b6b), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:12.071353 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c244f43-430d-4c42-aac1-beb51345699f None None] Pushing event updated for resources: {'Port': ['ID=d9374f34-b117-40ce-9bb7-744f0c221b6b,revision_number=2']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:12.087043 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-76666b6d-1ab2-42b6-8dd0-a229916e6e0a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (bbec98be-8cc2-45ad-aef1-cab627a2d2cc), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:12.089978 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-76666b6d-1ab2-42b6-8dd0-a229916e6e0a admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:12.093568 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-76666b6d-1ab2-42b6-8dd0-a229916e6e0a admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/bbec98be-8cc2-45ad-aef1-cab627a2d2cc HTTP/1.1" status: 204 len: 168 time: 0.7232807 Feb 08 18:12:12.099798 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-cd5b810c-a535-48af-be1a-814d97736277 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-557494', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-560688'] for router (751d5daa-7864-4c4e-a90b-e2428fafc279), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:12.112436 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-0fa33a4d-6362-4988-baf5-d82924a70b74 service neutron] 10.222.0.118 "GET /v2.0/networks/c6ecb925-b9a5-4524-9125-b49155fa007e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2700074 Feb 08 18:12:12.119592 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e2700845-9688-446c-8ca3-b771b78ecb42 admin admin] Publish callbacks [] for security_group (f00d7510-4049-42ee-8a83-9835f50c2f10), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:12.125984 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-cd154ed7-fe7d-43ba-99de-7be0e57858cd admin admin] Publish callbacks [] for router_gateway (058f0c04-e3de-4d16-8a7a-a7247919133c), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:12.138612 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c7b2e591-4839-4db5-8475-cf867fde5d89 admin admin] Publish callbacks [] for port (ae5f46f2-7729-4ab9-95e0-646bf67653f0), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:12.140322 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e2700845-9688-446c-8ca3-b771b78ecb42 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (f00d7510-4049-42ee-8a83-9835f50c2f10), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:12.197529 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-76666b6d-1ab2-42b6-8dd0-a229916e6e0a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bbec98be-8cc2-45ad-aef1-cab627a2d2cc,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:12.203018 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-e2700845-9688-446c-8ca3-b771b78ecb42 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=dd9bf5d4c93b49aebe1fdd20c7461c6b&name=default HTTP/1.1" status: 200 len: 2992 time: 1.0343161 Feb 08 18:12:12.210252 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 34938) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:12.360501 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e2700845-9688-446c-8ca3-b771b78ecb42 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f00d7510-4049-42ee-8a83-9835f50c2f10,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:12.447080 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fa2b4eea-3b73-4ee8-89ad-b44b9dd38063 admin admin] Publish callbacks [] for security_group (f00d7510-4049-42ee-8a83-9835f50c2f10), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:12.454210 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cd5b810c-a535-48af-be1a-814d97736277 admin admin] Router 751d5daa-7864-4c4e-a90b-e2428fafc279 is scheduled to L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 with binding_index 1 {{(pid=102560) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Feb 08 18:12:12.558451 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fa2b4eea-3b73-4ee8-89ad-b44b9dd38063 admin admin] Publish callbacks [] for security_group (f00d7510-4049-42ee-8a83-9835f50c2f10), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:12.660342 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 34952) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:12.668789 dv-cinder-773985-21-iscsi neutron-server[102559]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Feb 08 18:12:12.690374 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c7b2e591-4839-4db5-8475-cf867fde5d89 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (ae5f46f2-7729-4ab9-95e0-646bf67653f0), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:12.713615 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device e32a7e0c-0045-4331-a9ac-7dc7ba90cadf up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:12:12.749386 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fa2b4eea-3b73-4ee8-89ad-b44b9dd38063 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (f00d7510-4049-42ee-8a83-9835f50c2f10), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:12.754634 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fa2b4eea-3b73-4ee8-89ad-b44b9dd38063 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:12.755811 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-fa2b4eea-3b73-4ee8-89ad-b44b9dd38063 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/f00d7510-4049-42ee-8a83-9835f50c2f10 HTTP/1.1" status: 204 len: 168 time: 0.5445845 Feb 08 18:12:12.808987 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cd5b810c-a535-48af-be1a-814d97736277 admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:12:12.826082 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] Sync routers for ids ['751d5daa-7864-4c4e-a90b-e2428fafc279'] in dv-cinder-773985-21-iscsi {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:12:12.840503 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] Routers {'751d5daa-7864-4c4e-a90b-e2428fafc279'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:12:12.841221 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:11:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['751d5daa-7864-4c4e-a90b-e2428fafc279'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:12.852728 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-cd5b810c-a535-48af-be1a-814d97736277 admin admin] Publish callbacks [] for router (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:12.853991 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-cd5b810c-a535-48af-be1a-814d97736277 admin admin] 10.222.0.118 "POST /v2.0/routers HTTP/1.1" status: 201 len: 931 time: 3.9222696 Feb 08 18:12:12.860537 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 34966) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:12.917771 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port e32a7e0c-0045-4331-a9ac-7dc7ba90cadf triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:12.918318 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (e32a7e0c-0045-4331-a9ac-7dc7ba90cadf), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:12.968993 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa2b4eea-3b73-4ee8-89ad-b44b9dd38063 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f00d7510-4049-42ee-8a83-9835f50c2f10,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:12.997003 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 34974) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:13.025437 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-af6486c6-b63f-490f-86f2-0818b10515eb req-faa7b858-64b7-40a1-bebc-6879f743292c tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 210 time: 0.3579528 Feb 08 18:12:13.165365 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c7b2e591-4839-4db5-8475-cf867fde5d89 admin admin] Network 77055816-7c88-403d-8f8a-9be2c1faa10d is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:12:13.188116 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-18041ab4-a4e0-405e-9fdc-a41c411b3a20 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:13.189052 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-c7b2e591-4839-4db5-8475-cf867fde5d89 admin admin] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:13.209123 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port e32a7e0c-0045-4331-a9ac-7dc7ba90cadf is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:13.210178 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (e32a7e0c-0045-4331-a9ac-7dc7ba90cadf), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:13.214573 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7b2e591-4839-4db5-8475-cf867fde5d89 admin admin] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:12:13.329048 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] For port e32a7e0c-0045-4331-a9ac-7dc7ba90cadf, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=e32a7e0c-0045-4331-a9ac-7dc7ba90cadf,segment=NetworkSegment(acdceaea-bf94-4e23-8e9f-0f5d9197e75f),segment_id=acdceaea-bf94-4e23-8e9f-0f5d9197e75f)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:12:13.340487 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (e32a7e0c-0045-4331-a9ac-7dc7ba90cadf), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:13.442597 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7b2e591-4839-4db5-8475-cf867fde5d89 admin admin] Pushing event updated for resources: {'Port': ['ID=ae5f46f2-7729-4ab9-95e0-646bf67653f0,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:13.463672 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1c075e6b-aa6e-4781-b594-972dca16acba None None] Network e430084e-9b28-426f-9937-61346814b135 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:12:13.570442 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Pushing event updated for resources: {'Port': ['ID=e32a7e0c-0045-4331-a9ac-7dc7ba90cadf,revision_number=3']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:13.602212 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-dba2075b-86f8-498e-b49f-444a7cbbf73c None None] Provisioning complete for port e32a7e0c-0045-4331-a9ac-7dc7ba90cadf triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:13.602593 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-dba2075b-86f8-498e-b49f-444a7cbbf73c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (e32a7e0c-0045-4331-a9ac-7dc7ba90cadf), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:13.728011 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] Set router 751d5daa-7864-4c4e-a90b-e2428fafc279 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:12:13.873553 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-dba2075b-86f8-498e-b49f-444a7cbbf73c None None] Current status of the port e32a7e0c-0045-4331-a9ac-7dc7ba90cadf is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:14.028747 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-efd18e85-0db1-414d-aa5d-e113aee60d48 None None] Network 7a854399-3ce6-42bd-bfc4-061132ecb9c2 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:12:14.042653 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-18041ab4-a4e0-405e-9fdc-a41c411b3a20 admin admin] Publish callbacks [] for security_group (24282534-6985-40c5-8aa8-5e07de99f224), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:14.064968 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-18041ab4-a4e0-405e-9fdc-a41c411b3a20 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (24282534-6985-40c5-8aa8-5e07de99f224), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:14.159194 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-cd154ed7-fe7d-43ba-99de-7be0e57858cd admin admin] Publish callbacks [] for router_gateway (058f0c04-e3de-4d16-8a7a-a7247919133c), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:14.211549 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-dd8eab6a-916d-4f67-a8a7-b8ced94fbb5f None None] Provisioning complete for port d9374f34-b117-40ce-9bb7-744f0c221b6b triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:14.212268 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-dd8eab6a-916d-4f67-a8a7-b8ced94fbb5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (d9374f34-b117-40ce-9bb7-744f0c221b6b), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:14.297107 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-00c06925-f5a7-4f8b-836e-6b65e8d59f03 req-ba59666d-9ba0-4134-bc67-c7163c1371d1 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 210 time: 0.1205244 Feb 08 18:12:14.319743 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-cd154ed7-fe7d-43ba-99de-7be0e57858cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:14.364823 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '751d5daa-7864-4c4e-a90b-e2428fafc279', 'name': 'tempest-ServerRescueNegativeTestJSON-1610510663-router', 'tenant_id': '3fb51fc0e23f4c66a482d4d406197299', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.140'}], 'enable_snat': True}, 'gw_port_id': 'af462b70-3112-405d-a84b-10c4370a9bbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:08Z', 'updated_at': '2022-02-08T18:12:11Z', 'revision_number': 3, 'project_id': '3fb51fc0e23f4c66a482d4d406197299', 'gw_port': {'id': 'af462b70-3112-405d-a84b-10c4370a9bbe', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:c7:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '751d5daa-7864-4c4e-a90b-e2428fafc279', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.140', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:09Z', 'updated_at': '2022-02-08T18:12:10Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:14.452607 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-dd8eab6a-916d-4f67-a8a7-b8ced94fbb5f None None] Current status of the port d9374f34-b117-40ce-9bb7-744f0c221b6b is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:14.453030 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-dd8eab6a-916d-4f67-a8a7-b8ced94fbb5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (d9374f34-b117-40ce-9bb7-744f0c221b6b), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:14.462842 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] Checking router: 751d5daa-7864-4c4e-a90b-e2428fafc279 for host: dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:12:14.463193 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] Updating router 751d5daa-7864-4c4e-a90b-e2428fafc279 port af462b70-3112-405d-a84b-10c4370a9bbe binding host dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Feb 08 18:12:14.537178 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c7b2e591-4839-4db5-8475-cf867fde5d89 admin admin] Publish callbacks [] for router_gateway (3c53cb16-5d43-40f1-a3a6-2ca2f7a42984), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:14.538530 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18041ab4-a4e0-405e-9fdc-a41c411b3a20 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=24282534-6985-40c5-8aa8-5e07de99f224,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:14.547910 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-18041ab4-a4e0-405e-9fdc-a41c411b3a20 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=a6c48b1719f44cb7ab477385a37bd1aa&name=default HTTP/1.1" status: 200 len: 2992 time: 1.5213616 Feb 08 18:12:14.557208 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 35034) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:14.581870 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-dd8eab6a-916d-4f67-a8a7-b8ced94fbb5f None None] For port d9374f34-b117-40ce-9bb7-744f0c221b6b, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=d9374f34-b117-40ce-9bb7-744f0c221b6b,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:12:14.587010 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (af462b70-3112-405d-a84b-10c4370a9bbe), before_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:14.596801 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-dd8eab6a-916d-4f67-a8a7-b8ced94fbb5f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (d9374f34-b117-40ce-9bb7-744f0c221b6b), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:14.827867 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd8eab6a-916d-4f67-a8a7-b8ced94fbb5f None None] Pushing event updated for resources: {'Port': ['ID=d9374f34-b117-40ce-9bb7-744f0c221b6b,revision_number=3']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:14.846355 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-a930113d-955c-46fc-91ae-de8a86d42b08 None None] Provisioning complete for port e32a7e0c-0045-4331-a9ac-7dc7ba90cadf triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:14.847571 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-a930113d-955c-46fc-91ae-de8a86d42b08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (e32a7e0c-0045-4331-a9ac-7dc7ba90cadf), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:15.010814 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0d17aa3d-60c5-4881-9629-e31bfe09e7ba admin admin] Publish callbacks [] for security_group (24282534-6985-40c5-8aa8-5e07de99f224), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:15.016552 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-68224c96-f010-4162-94e5-beaa5a002d7c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:15.017890 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device e32a7e0c-0045-4331-a9ac-7dc7ba90cadf up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:12:15.041661 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [None req-cd154ed7-fe7d-43ba-99de-7be0e57858cd admin admin] Allocated IP 172.27.1.106 (77055816-7c88-403d-8f8a-9be2c1faa10d/18547c52-7b23-42cd-bb53-214663ed102b/2aaec302-cd25-4e18-b85c-4834b2fc0c69) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:12:15.072677 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0d17aa3d-60c5-4881-9629-e31bfe09e7ba admin admin] Publish callbacks [] for security_group (24282534-6985-40c5-8aa8-5e07de99f224), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:15.257563 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-a930113d-955c-46fc-91ae-de8a86d42b08 None None] Current status of the port e32a7e0c-0045-4331-a9ac-7dc7ba90cadf is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:15.292379 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port e32a7e0c-0045-4331-a9ac-7dc7ba90cadf triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:15.292769 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (e32a7e0c-0045-4331-a9ac-7dc7ba90cadf), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:15.425258 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-4e599adc-6c4c-4cef-b9f1-5dcd2ee54632 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:15.447242 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-a3e54197-109c-43d1-aaa7-430ab7568bdd None None] Provisioning complete for port d9374f34-b117-40ce-9bb7-744f0c221b6b triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:15.447618 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-a3e54197-109c-43d1-aaa7-430ab7568bdd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (d9374f34-b117-40ce-9bb7-744f0c221b6b), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:15.500869 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0d17aa3d-60c5-4881-9629-e31bfe09e7ba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (24282534-6985-40c5-8aa8-5e07de99f224), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:15.504267 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0d17aa3d-60c5-4881-9629-e31bfe09e7ba admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:15.511418 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-0d17aa3d-60c5-4881-9629-e31bfe09e7ba admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/24282534-6985-40c5-8aa8-5e07de99f224 HTTP/1.1" status: 204 len: 168 time: 0.9347880 Feb 08 18:12:15.560186 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-cd154ed7-fe7d-43ba-99de-7be0e57858cd admin admin] Publish callbacks [] for port (2aaec302-cd25-4e18-b85c-4834b2fc0c69), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:15.573824 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d17aa3d-60c5-4881-9629-e31bfe09e7ba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=24282534-6985-40c5-8aa8-5e07de99f224,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:15.581894 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c7b2e591-4839-4db5-8475-cf867fde5d89 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-557494', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-560688'] for router (3c53cb16-5d43-40f1-a3a6-2ca2f7a42984), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:15.619048 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_common [None req-68224c96-f010-4162-94e5-beaa5a002d7c admin admin] Allocated IP 172.20.0.1 (f089911e-72de-4ff6-880b-ac3dd7927165/0af67967-364e-4325-b04f-b7e157c3c3d4/f7548915-8b6b-47ac-982b-ba931ac61b22) {{(pid=102560) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:12:15.808772 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3337ae5c-7cce-42bd-a5ec-000b816f53ee req-60542d94-1ffc-4c53-a432-290eb148a5ba tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 210 time: 0.1155934 Feb 08 18:12:15.850231 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-68224c96-f010-4162-94e5-beaa5a002d7c admin admin] Publish callbacks [] for port (f7548915-8b6b-47ac-982b-ba931ac61b22), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:15.856537 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-cd154ed7-fe7d-43ba-99de-7be0e57858cd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (2aaec302-cd25-4e18-b85c-4834b2fc0c69), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:15.878904 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port e32a7e0c-0045-4331-a9ac-7dc7ba90cadf is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:15.880053 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device d9374f34-b117-40ce-9bb7-744f0c221b6b up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:12:15.940504 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-68224c96-f010-4162-94e5-beaa5a002d7c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (f7548915-8b6b-47ac-982b-ba931ac61b22), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:15.965836 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-cd154ed7-fe7d-43ba-99de-7be0e57858cd admin admin] Network 77055816-7c88-403d-8f8a-9be2c1faa10d is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:12:15.981550 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-cd154ed7-fe7d-43ba-99de-7be0e57858cd admin admin] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:15.987891 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cd154ed7-fe7d-43ba-99de-7be0e57858cd admin admin] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:12:16.015174 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68224c96-f010-4162-94e5-beaa5a002d7c admin admin] Network f089911e-72de-4ff6-880b-ac3dd7927165 is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:12:16.027948 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-68224c96-f010-4162-94e5-beaa5a002d7c admin admin] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:16.040265 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [None req-68224c96-f010-4162-94e5-beaa5a002d7c admin admin] Received port after_create {{(pid=102560) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:12:16.040558 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-68224c96-f010-4162-94e5-beaa5a002d7c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-560871'] for router_interface (751d5daa-7864-4c4e-a90b-e2428fafc279), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:16.064968 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port d9374f34-b117-40ce-9bb7-744f0c221b6b triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:16.066474 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (d9374f34-b117-40ce-9bb7-744f0c221b6b), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:16.089003 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd154ed7-fe7d-43ba-99de-7be0e57858cd admin admin] Pushing event updated for resources: {'Port': ['ID=2aaec302-cd25-4e18-b85c-4834b2fc0c69,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:16.096533 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] Publish callbacks [] for port (af462b70-3112-405d-a84b-10c4370a9bbe), precommit_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:16.106323 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (af462b70-3112-405d-a84b-10c4370a9bbe), after_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:16.116896 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-a3e54197-109c-43d1-aaa7-430ab7568bdd None None] Current status of the port d9374f34-b117-40ce-9bb7-744f0c221b6b is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:16.172111 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7959a7d-8baf-4090-b027-fd9e81d38ac3 None None] Pushing event updated for resources: {'Port': ['ID=af462b70-3112-405d-a84b-10c4370a9bbe,revision_number=2']} {{(pid=102562) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:16.191530 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7959a7d-8baf-4090-b027-fd9e81d38ac3 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:16.191915 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7959a7d-8baf-4090-b027-fd9e81d38ac3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:16.192277 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7959a7d-8baf-4090-b027-fd9e81d38ac3 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:16.192680 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7959a7d-8baf-4090-b027-fd9e81d38ac3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:16.193987 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7959a7d-8baf-4090-b027-fd9e81d38ac3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:16.194335 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7959a7d-8baf-4090-b027-fd9e81d38ac3 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:16.194694 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7959a7d-8baf-4090-b027-fd9e81d38ac3 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:16.195287 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7959a7d-8baf-4090-b027-fd9e81d38ac3 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:16.195628 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7959a7d-8baf-4090-b027-fd9e81d38ac3 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:16.197692 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7959a7d-8baf-4090-b027-fd9e81d38ac3 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:16.198048 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7959a7d-8baf-4090-b027-fd9e81d38ac3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:16.198389 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7959a7d-8baf-4090-b027-fd9e81d38ac3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:16.198721 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7959a7d-8baf-4090-b027-fd9e81d38ac3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b7959a7d-8baf-4090-b027-fd9e81d38ac3 None None] Tracked resource versions report: Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: pushed versions: Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: { 'AddressGroup': {'1.2'}, Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'ConntrackHelper': {'1.0'}, Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'LocalIPAssociation': {'1.0'}, Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'Log': {'1.0'}, Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'Network': {'1.1'}, Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'Port': {'1.7'}, Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'PortForwarding': {'1.2'}, Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'QosPolicy': {'1.10'}, Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'SecurityGroup': {'1.5'}, Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'SecurityGroupRule': {'1.2'}, Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'SubPort': {'1.0'}, Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'Subnet': {'1.1'}, Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'Trunk': {'1.1'}} Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: consumer versions: Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: { DHCP agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: HyperV agent@hv-cinder-77398: {}, Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: L3 agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: Metadata agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: Metering agent@dv-cinder-773985-21-iscsi: {}, Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: Open vSwitch agent@dv-cinder-773985-21-iscsi: { 'AddressGroup': '1.2', Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'ConntrackHelper': '1.0', Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'LocalIPAssociation': '1.0', Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'Log': '1.0', Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'Network': '1.1', Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'Port': '1.7', Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'PortForwarding': '1.2', Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'QosPolicy': '1.10', Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'SecurityGroup': '1.5', Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'SecurityGroupRule': '1.2', Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'SubPort': '1.0', Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'Subnet': '1.1', Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: 'Trunk': '1.1'}} Feb 08 18:12:16.200936 dv-cinder-773985-21-iscsi neutron-server[102562]: {{(pid=102562) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Feb 08 18:12:16.229715 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] Attempting to bind port af462b70-3112-405d-a84b-10c4370a9bbe on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:12:16.230091 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] Attempting to bind port af462b70-3112-405d-a84b-10c4370a9bbe by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}] {{(pid=102562) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:12:16.230687 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] Attempting to bind port af462b70-3112-405d-a84b-10c4370a9bbe on network 77055816-7c88-403d-8f8a-9be2c1faa10d {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:12:16.237721 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 11, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:12:16.238377 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] Checking segment: {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102562) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:12:16.239230 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:16.239842 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] Bound using segment: {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'} {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:12:16.240557 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] Bound port: af462b70-3112-405d-a84b-10c4370a9bbe, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}}] {{(pid=102562) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:12:16.241161 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (af462b70-3112-405d-a84b-10c4370a9bbe), before_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:16.254047 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68224c96-f010-4162-94e5-beaa5a002d7c admin admin] Pushing event updated for resources: {'Port': ['ID=f7548915-8b6b-47ac-982b-ba931ac61b22,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:16.270992 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port d9374f34-b117-40ce-9bb7-744f0c221b6b is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:16.309150 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.db [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] For port af462b70-3112-405d-a84b-10c4370a9bbe, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102562) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:12:16.313079 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.db [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] For port af462b70-3112-405d-a84b-10c4370a9bbe, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=af462b70-3112-405d-a84b-10c4370a9bbe,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102562) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:12:16.323732 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (af462b70-3112-405d-a84b-10c4370a9bbe), after_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:16.348434 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c7b2e591-4839-4db5-8475-cf867fde5d89 admin admin] Router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 is scheduled to L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 with binding_index 1 {{(pid=102559) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Feb 08 18:12:16.447952 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7959a7d-8baf-4090-b027-fd9e81d38ac3 None None] Pushing event updated for resources: {'Port': ['ID=af462b70-3112-405d-a84b-10c4370a9bbe,revision_number=3']} {{(pid=102562) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:16.452085 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] Routers {'751d5daa-7864-4c4e-a90b-e2428fafc279'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:12:16.452870 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:11:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['751d5daa-7864-4c4e-a90b-e2428fafc279'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:16.475478 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-68224c96-f010-4162-94e5-beaa5a002d7c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (f7548915-8b6b-47ac-982b-ba931ac61b22), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:16.640764 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] Set router 751d5daa-7864-4c4e-a90b-e2428fafc279 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:12:16.641603 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-cd154ed7-fe7d-43ba-99de-7be0e57858cd admin admin] Publish callbacks [] for router_gateway (058f0c04-e3de-4d16-8a7a-a7247919133c), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:16.827187 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c7b2e591-4839-4db5-8475-cf867fde5d89 admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102559) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:12:16.844017 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device d9374f34-b117-40ce-9bb7-744f0c221b6b up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:12:16.885671 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c7b2e591-4839-4db5-8475-cf867fde5d89 admin admin] Publish callbacks [] for router (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:16.887554 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-c7b2e591-4839-4db5-8475-cf867fde5d89 admin admin] 10.222.0.118 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 6.9685519 Feb 08 18:12:16.888527 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] Sync routers for ids ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:12:16.890288 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 35146) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:16.908852 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-68224c96-f010-4162-94e5-beaa5a002d7c admin admin] Publish callbacks [] for port (f7548915-8b6b-47ac-982b-ba931ac61b22), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:16.919856 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] Routers {'3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:12:16.920737 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:11:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:16.927126 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-68224c96-f010-4162-94e5-beaa5a002d7c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (f7548915-8b6b-47ac-982b-ba931ac61b22), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:16.927841 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-68224c96-f010-4162-94e5-beaa5a002d7c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-631683', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-559991'] for router_interface (751d5daa-7864-4c4e-a90b-e2428fafc279), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:16.976444 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '751d5daa-7864-4c4e-a90b-e2428fafc279', 'name': 'tempest-ServerRescueNegativeTestJSON-1610510663-router', 'tenant_id': '3fb51fc0e23f4c66a482d4d406197299', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.140'}], 'enable_snat': True}, 'gw_port_id': 'af462b70-3112-405d-a84b-10c4370a9bbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:08Z', 'updated_at': '2022-02-08T18:12:16Z', 'revision_number': 4, 'project_id': '3fb51fc0e23f4c66a482d4d406197299', 'gw_port': {'id': 'af462b70-3112-405d-a84b-10c4370a9bbe', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:c7:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '751d5daa-7864-4c4e-a90b-e2428fafc279', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.140', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:09Z', 'updated_at': '2022-02-08T18:12:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'f7548915-8b6b-47ac-982b-ba931ac61b22', 'name': '', 'network_id': 'f089911e-72de-4ff6-880b-ac3dd7927165', 'tenant_id': '3fb51fc0e23f4c66a482d4d406197299', 'mac_address': 'fa:16:3e:a0:80:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '751d5daa-7864-4c4e-a90b-e2428fafc279', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '0af67967-364e-4325-b04f-b7e157c3c3d4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:15Z', 'updated_at': '2022-02-08T18:12:15Z', 'revision_number': 1, 'project_id': '3fb51fc0e23f4c66a482d4d406197299', 'subnets': [{'id': '0af67967-364e-4325-b04f-b7e157c3c3d4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:17.004920 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-cd154ed7-fe7d-43ba-99de-7be0e57858cd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-557494', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-560688'] for router (058f0c04-e3de-4d16-8a7a-a7247919133c), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:17.038172 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6bc63c6f-21cf-48e1-915a-8b9e9c784313 None None] The sync data for ids ['751d5daa-7864-4c4e-a90b-e2428fafc279'] in dv-cinder-773985-21-iscsi is: [{'id': '751d5daa-7864-4c4e-a90b-e2428fafc279', 'name': 'tempest-ServerRescueNegativeTestJSON-1610510663-router', 'tenant_id': '3fb51fc0e23f4c66a482d4d406197299', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.140'}], 'enable_snat': True}, 'gw_port_id': 'af462b70-3112-405d-a84b-10c4370a9bbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:08Z', 'updated_at': '2022-02-08T18:12:16Z', 'revision_number': 4, 'project_id': '3fb51fc0e23f4c66a482d4d406197299', 'gw_port': {'id': 'af462b70-3112-405d-a84b-10c4370a9bbe', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:c7:f7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '751d5daa-7864-4c4e-a90b-e2428fafc279', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.140', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:09Z', 'updated_at': '2022-02-08T18:12:16Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'f7548915-8b6b-47ac-982b-ba931ac61b22', 'name': '', 'network_id': 'f089911e-72de-4ff6-880b-ac3dd7927165', 'tenant_id': '3fb51fc0e23f4c66a482d4d406197299', 'mac_address': 'fa:16:3e:a0:80:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '751d5daa-7864-4c4e-a90b-e2428fafc279', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '0af67967-364e-4325-b04f-b7e157c3c3d4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:15Z', 'updated_at': '2022-02-08T18:12:15Z', 'revision_number': 1, 'project_id': '3fb51fc0e23f4c66a482d4d406197299', 'subnets': [{'id': '0af67967-364e-4325-b04f-b7e157c3c3d4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:12:17.064534 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-68224c96-f010-4162-94e5-beaa5a002d7c admin admin] Network f089911e-72de-4ff6-880b-ac3dd7927165 is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:12:17.067760 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-68224c96-f010-4162-94e5-beaa5a002d7c admin admin] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:17.101268 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68224c96-f010-4162-94e5-beaa5a002d7c admin admin] Pushing event updated for resources: {'Port': ['ID=f7548915-8b6b-47ac-982b-ba931ac61b22,revision_number=2']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:17.126092 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port d9374f34-b117-40ce-9bb7-744f0c221b6b triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:17.126482 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (d9374f34-b117-40ce-9bb7-744f0c221b6b), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:17.249168 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] Set router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:12:17.254789 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-68224c96-f010-4162-94e5-beaa5a002d7c admin admin] Router 751d5daa-7864-4c4e-a90b-e2428fafc279 has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:12:17.317881 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-284b75e6-15e5-4542-b3da-447f0db56dd3 req-c76ebf35-bc12-45ac-8874-89b3bff84bc7 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 210 time: 0.3006785 Feb 08 18:12:17.334735 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 35160) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:17.471745 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-68224c96-f010-4162-94e5-beaa5a002d7c admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:12:17.477813 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-68224c96-f010-4162-94e5-beaa5a002d7c admin admin] 10.222.0.118 "PUT /v2.0/routers/751d5daa-7864-4c4e-a90b-e2428fafc279/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.6161990 Feb 08 18:12:17.499196 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-cd154ed7-fe7d-43ba-99de-7be0e57858cd admin admin] Router 058f0c04-e3de-4d16-8a7a-a7247919133c is scheduled to L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 with binding_index 1 {{(pid=102559) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Feb 08 18:12:17.539161 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port d9374f34-b117-40ce-9bb7-744f0c221b6b is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:17.628064 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'name': 'tempest-AttachVolumeTestJSON-997005721-router', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77'}], 'enable_snat': True}, 'gw_port_id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:13Z', 'revision_number': 3, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'gw_port': {'id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ad:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:11Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:17.662370 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] Checking router: 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:12:17.662960 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] Updating router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 port ae5f46f2-7729-4ab9-95e0-646bf67653f0 binding host dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Feb 08 18:12:17.693506 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (ae5f46f2-7729-4ab9-95e0-646bf67653f0), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:17.739332 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0dea8066-e2eb-4c9d-a6c6-e79480616474 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:17.841079 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-cd154ed7-fe7d-43ba-99de-7be0e57858cd admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102559) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:12:17.851338 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] Sync routers for ids ['058f0c04-e3de-4d16-8a7a-a7247919133c'] in dv-cinder-773985-21-iscsi {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:12:17.853345 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-841c9ed7-e09a-4e35-8cd0-35052a995754 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:17.866868 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] Routers {'058f0c04-e3de-4d16-8a7a-a7247919133c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:12:17.871712 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:12:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['058f0c04-e3de-4d16-8a7a-a7247919133c'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:17.957194 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:18.069997 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] Set router 058f0c04-e3de-4d16-8a7a-a7247919133c gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:12:18.194935 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] Publish callbacks [] for port (ae5f46f2-7729-4ab9-95e0-646bf67653f0), precommit_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:18.212926 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (ae5f46f2-7729-4ab9-95e0-646bf67653f0), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:18.276668 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-cd154ed7-fe7d-43ba-99de-7be0e57858cd admin admin] Publish callbacks [] for router (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:18.280979 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 35190) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:18.281442 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-cd154ed7-fe7d-43ba-99de-7be0e57858cd admin admin] 10.222.0.118 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 7.0556746 Feb 08 18:12:18.282850 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] Attempting to bind port ae5f46f2-7729-4ab9-95e0-646bf67653f0 on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:12:18.283226 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] Attempting to bind port ae5f46f2-7729-4ab9-95e0-646bf67653f0 by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:12:18.283636 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] Attempting to bind port ae5f46f2-7729-4ab9-95e0-646bf67653f0 on network 77055816-7c88-403d-8f8a-9be2c1faa10d {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:12:18.294378 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 11, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:12:18.294811 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] Checking segment: {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102561) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:12:18.295192 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:18.295567 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] Bound using segment: {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:12:18.296487 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] Bound port: ae5f46f2-7729-4ab9-95e0-646bf67653f0, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:12:18.296876 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (ae5f46f2-7729-4ab9-95e0-646bf67653f0), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:18.357033 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0dea8066-e2eb-4c9d-a6c6-e79480616474 admin admin] Publish callbacks [] for security_group (7e189b5a-14b8-4016-823d-2d3dda92a9be), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:18.382178 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] For port ae5f46f2-7729-4ab9-95e0-646bf67653f0, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102561) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:12:18.384068 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] For port ae5f46f2-7729-4ab9-95e0-646bf67653f0, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=ae5f46f2-7729-4ab9-95e0-646bf67653f0,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102561) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:12:18.399551 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0dea8066-e2eb-4c9d-a6c6-e79480616474 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (7e189b5a-14b8-4016-823d-2d3dda92a9be), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:18.412941 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdce0035-7773-4549-8794-b7cfe1b10809 None None] Pushing event updated for resources: {'Port': ['ID=ae5f46f2-7729-4ab9-95e0-646bf67653f0,revision_number=2']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:18.420452 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (ae5f46f2-7729-4ab9-95e0-646bf67653f0), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:18.483725 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-0dea8066-e2eb-4c9d-a6c6-e79480616474 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=ce79e8f40aef4ee280bd698cc7ccaa30&name=default HTTP/1.1" status: 200 len: 2992 time: 1.1414678 Feb 08 18:12:18.490638 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 35202) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:18.518489 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'name': 'tempest-AttachVolumeShelveTestJSON-785190803-router', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106'}], 'enable_snat': True}, 'gw_port_id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:11Z', 'updated_at': '2022-02-08T18:12:16Z', 'revision_number': 3, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'gw_port': {'id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:49:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:14Z', 'updated_at': '2022-02-08T18:12:15Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:18.563761 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] Checking router: 058f0c04-e3de-4d16-8a7a-a7247919133c for host: dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:12:18.564105 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] Updating router 058f0c04-e3de-4d16-8a7a-a7247919133c port 2aaec302-cd25-4e18-b85c-4834b2fc0c69 binding host dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Feb 08 18:12:18.588284 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:18.597875 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (2aaec302-cd25-4e18-b85c-4834b2fc0c69), before_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:18.616091 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-4bc8e352-42a7-432d-9d5a-b7cfe70df333 req-8a2b6be4-1711-4963-9e71-840c560f3943 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 210 time: 0.1105487 Feb 08 18:12:18.622757 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] Routers {'3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:12:18.623015 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:12:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:18.626539 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0dea8066-e2eb-4c9d-a6c6-e79480616474 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7e189b5a-14b8-4016-823d-2d3dda92a9be,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:18.900634 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] Set router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:12:18.906658 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c7ca00e1-4443-435d-86a4-3cda49397983 admin admin] Publish callbacks [] for security_group (7e189b5a-14b8-4016-823d-2d3dda92a9be), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:18.950438 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da827513-01fa-43a6-ba55-645ebe6faeb0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:19.009825 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c7ca00e1-4443-435d-86a4-3cda49397983 admin admin] Publish callbacks [] for security_group (7e189b5a-14b8-4016-823d-2d3dda92a9be), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:19.062155 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device af462b70-3112-405d-a84b-10c4370a9bbe up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:12:19.064885 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdce0035-7773-4549-8794-b7cfe1b10809 None None] Pushing event updated for resources: {'Port': ['ID=ae5f46f2-7729-4ab9-95e0-646bf67653f0,revision_number=3']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:19.179069 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.109', 51632) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:19.274225 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-7c72bce8-5d14-41b7-b2ac-abaf443cc386 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:19.282153 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-7c72bce8-5d14-41b7-b2ac-abaf443cc386 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/networks?id=f089911e-72de-4ff6-880b-ac3dd7927165 HTTP/1.1" status: 200 len: 819 time: 0.8371804 Feb 08 18:12:19.307801 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c7ca00e1-4443-435d-86a4-3cda49397983 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (7e189b5a-14b8-4016-823d-2d3dda92a9be), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:19.310376 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c7ca00e1-4443-435d-86a4-3cda49397983 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:19.311550 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-c7ca00e1-4443-435d-86a4-3cda49397983 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/7e189b5a-14b8-4016-823d-2d3dda92a9be HTTP/1.1" status: 204 len: 168 time: 0.8161864 Feb 08 18:12:19.373089 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-905de670-0f92-484b-8c02-d633d926ba7c tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/quotas/3fb51fc0e23f4c66a482d4d406197299 HTTP/1.1" status: 200 len: 375 time: 0.0835366 Feb 08 18:12:19.434151 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7ca00e1-4443-435d-86a4-3cda49397983 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7e189b5a-14b8-4016-823d-2d3dda92a9be,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:19.476255 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port af462b70-3112-405d-a84b-10c4370a9bbe triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:19.476650 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (af462b70-3112-405d-a84b-10c4370a9bbe), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:19.524945 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] Publish callbacks [] for port (2aaec302-cd25-4e18-b85c-4834b2fc0c69), precommit_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:19.543113 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (2aaec302-cd25-4e18-b85c-4834b2fc0c69), after_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:19.613672 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [None req-da827513-01fa-43a6-ba55-645ebe6faeb0 admin admin] Allocated IP 172.20.0.1 (e430084e-9b28-426f-9937-61346814b135/86592955-e7d0-4e8a-9490-976e17240d7c/fe9dfbe9-83a8-472c-b3a3-9537d424939b) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:12:19.630361 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] Attempting to bind port 2aaec302-cd25-4e18-b85c-4834b2fc0c69 on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:12:19.630861 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] Attempting to bind port 2aaec302-cd25-4e18-b85c-4834b2fc0c69 by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}] {{(pid=102562) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:12:19.631245 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] Attempting to bind port 2aaec302-cd25-4e18-b85c-4834b2fc0c69 on network 77055816-7c88-403d-8f8a-9be2c1faa10d {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:12:19.640798 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b4b7238-a856-4415-98e3-9e386a8b62aa None None] Pushing event updated for resources: {'Port': ['ID=2aaec302-cd25-4e18-b85c-4834b2fc0c69,revision_number=2']} {{(pid=102562) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:19.661200 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 11, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:12:19.661955 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] Checking segment: {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102562) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:12:19.663126 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:19.664838 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] Bound using segment: {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'} {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:12:19.665467 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] Bound port: 2aaec302-cd25-4e18-b85c-4834b2fc0c69, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}}] {{(pid=102562) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:12:19.666874 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (2aaec302-cd25-4e18-b85c-4834b2fc0c69), before_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:19.799469 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.db [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] For port 2aaec302-cd25-4e18-b85c-4834b2fc0c69, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102562) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:12:19.812803 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.db [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] For port 2aaec302-cd25-4e18-b85c-4834b2fc0c69, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=2aaec302-cd25-4e18-b85c-4834b2fc0c69,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102562) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:12:19.837207 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (2aaec302-cd25-4e18-b85c-4834b2fc0c69), after_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:19.854619 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'name': 'tempest-AttachVolumeTestJSON-997005721-router', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77'}], 'enable_snat': True}, 'gw_port_id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:13Z', 'revision_number': 3, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'gw_port': {'id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ad:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:19.902476 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-52cf2bd4-482c-4332-8b17-75127b0abcc5 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:19.908086 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-52cf2bd4-482c-4332-8b17-75127b0abcc5 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.109 "GET /v2.0/networks?id=c6ecb925-b9a5-4524-9125-b49155fa007e HTTP/1.1" status: 200 len: 812 time: 0.7248833 Feb 08 18:12:19.967334 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3ced6d23-319d-40ae-8cca-1283548f7fd0 None None] The sync data for ids ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'] in dv-cinder-773985-21-iscsi is: [{'id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'name': 'tempest-AttachVolumeTestJSON-997005721-router', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77'}], 'enable_snat': True}, 'gw_port_id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:13Z', 'revision_number': 3, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'gw_port': {'id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ad:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:18Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:12:20.015525 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b4b7238-a856-4415-98e3-9e386a8b62aa None None] Pushing event updated for resources: {'Port': ['ID=2aaec302-cd25-4e18-b85c-4834b2fc0c69,revision_number=3']} {{(pid=102562) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:20.018029 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-4c650e4c-4956-4fbf-b62f-127f12c99d8a tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Request body: {'port': {'device_id': '6447fbdb-9f53-4284-ab18-211e412243c0', 'network_id': 'c6ecb925-b9a5-4524-9125-b49155fa007e', 'admin_state_up': True, 'tenant_id': '4947894da18b4d0580dc1cf24ecb581c'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:20.034854 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] Routers {'058f0c04-e3de-4d16-8a7a-a7247919133c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:12:20.035564 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:12:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['058f0c04-e3de-4d16-8a7a-a7247919133c'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:20.042503 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d8d1b9dc-4a61-4f81-8c2e-91aeb6aaad4f req-6136d989-9af9-4c63-b535-4b43ef70fe64 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 210 time: 0.1616600 Feb 08 18:12:20.155052 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port af462b70-3112-405d-a84b-10c4370a9bbe is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:20.156189 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (af462b70-3112-405d-a84b-10c4370a9bbe), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:20.220698 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:20.262980 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] For port af462b70-3112-405d-a84b-10c4370a9bbe, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=af462b70-3112-405d-a84b-10c4370a9bbe,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:12:20.277719 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (af462b70-3112-405d-a84b-10c4370a9bbe), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:20.305780 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 35298) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:20.387767 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-083d5215-c13d-400d-8d5f-fffe83684c59 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:20.388159 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Pushing event updated for resources: {'Port': ['ID=af462b70-3112-405d-a84b-10c4370a9bbe,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:20.388330 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] Set router 058f0c04-e3de-4d16-8a7a-a7247919133c gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:12:20.574964 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da827513-01fa-43a6-ba55-645ebe6faeb0 admin admin] Publish callbacks [] for port (fe9dfbe9-83a8-472c-b3a3-9537d424939b), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:20.608064 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-4c650e4c-4956-4fbf-b62f-127f12c99d8a tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Made reservation on behalf of 4947894da18b4d0580dc1cf24ecb581c for: {'port': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:12:20.612733 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-4c650e4c-4956-4fbf-b62f-127f12c99d8a tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:20.616701 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da827513-01fa-43a6-ba55-645ebe6faeb0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (fe9dfbe9-83a8-472c-b3a3-9537d424939b), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:20.618030 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-2904a352-e173-44f1-9224-c3dce4f58e20 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?tenant_id=3fb51fc0e23f4c66a482d4d406197299&fields=id HTTP/1.1" status: 200 len: 255 time: 0.5289738 Feb 08 18:12:20.690382 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da827513-01fa-43a6-ba55-645ebe6faeb0 admin admin] Pushing event updated for resources: {'Port': ['ID=fe9dfbe9-83a8-472c-b3a3-9537d424939b,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:20.871749 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] Sync routers for ids ['751d5daa-7864-4c4e-a90b-e2428fafc279'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:12:20.900664 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] Routers {'751d5daa-7864-4c4e-a90b-e2428fafc279'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:12:20.906235 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:12:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['751d5daa-7864-4c4e-a90b-e2428fafc279'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:20.999620 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'name': 'tempest-AttachVolumeShelveTestJSON-785190803-router', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106'}], 'enable_snat': True}, 'gw_port_id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:11Z', 'updated_at': '2022-02-08T18:12:16Z', 'revision_number': 3, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'gw_port': {'id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:49:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:14Z', 'updated_at': '2022-02-08T18:12:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:21.017044 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-4c650e4c-4956-4fbf-b62f-127f12c99d8a tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Allocated IP 172.20.0.3 (c6ecb925-b9a5-4524-9125-b49155fa007e/bb9e2714-8d92-49d4-a88e-0ba6d48e2ad3/02c57200-9a7e-48d7-947f-7ed959af8662) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:12:21.156232 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da827513-01fa-43a6-ba55-645ebe6faeb0 admin admin] Network e430084e-9b28-426f-9937-61346814b135 is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:12:21.178993 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-da827513-01fa-43a6-ba55-645ebe6faeb0 admin admin] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:21.189640 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a0e3aea2-f1d2-40f0-8fc9-d60567a78885 None None] The sync data for ids ['058f0c04-e3de-4d16-8a7a-a7247919133c'] in dv-cinder-773985-21-iscsi is: [{'id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'name': 'tempest-AttachVolumeShelveTestJSON-785190803-router', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106'}], 'enable_snat': True}, 'gw_port_id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:11Z', 'updated_at': '2022-02-08T18:12:16Z', 'revision_number': 3, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'gw_port': {'id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:49:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:14Z', 'updated_at': '2022-02-08T18:12:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}] {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:12:21.229467 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [None req-da827513-01fa-43a6-ba55-645ebe6faeb0 admin admin] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:12:21.232378 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da827513-01fa-43a6-ba55-645ebe6faeb0 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-560871'] for router_interface (3c53cb16-5d43-40f1-a3a6-2ca2f7a42984), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:21.261758 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device af462b70-3112-405d-a84b-10c4370a9bbe up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:12:21.288954 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-35aae600-0c4f-4733-8beb-cdf2877cabb8 service neutron] 10.222.0.118 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6293385 Feb 08 18:12:21.370254 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-083d5215-c13d-400d-8d5f-fffe83684c59 admin admin] Publish callbacks [] for security_group (107ad76a-f551-4869-80fd-4eff87266b2c), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:21.381349 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8006e88f-0662-442d-800a-8826d4a076b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:21.511105 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-083d5215-c13d-400d-8d5f-fffe83684c59 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (107ad76a-f551-4869-80fd-4eff87266b2c), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:21.528838 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port af462b70-3112-405d-a84b-10c4370a9bbe triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:21.528838 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (af462b70-3112-405d-a84b-10c4370a9bbe), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:21.742031 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-083d5215-c13d-400d-8d5f-fffe83684c59 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=6d572ae45ca14467aa164e3d19fad230&name=default HTTP/1.1" status: 200 len: 2992 time: 1.4156020 Feb 08 18:12:21.748791 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-083d5215-c13d-400d-8d5f-fffe83684c59 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=107ad76a-f551-4869-80fd-4eff87266b2c,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:21.768361 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 35370) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:21.791768 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] Set router 751d5daa-7864-4c4e-a90b-e2428fafc279 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:12:21.801025 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9686c217-014c-4a91-9bc4-e40a01fdec9b req-c7f5fa3b-b729-4637-9742-382e9d8e9d0e tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 210 time: 0.5569177 Feb 08 18:12:21.944782 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-ad5848e7-0f90-42b0-aeeb-4fc6c87f8329 service neutron] 10.222.0.118 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6239219 Feb 08 18:12:22.234121 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 35388) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:22.337791 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_common [None req-8006e88f-0662-442d-800a-8826d4a076b1 admin admin] Allocated IP 172.20.0.1 (7a854399-3ce6-42bd-bfc4-061132ecb9c2/73de7865-d87d-4a2a-a702-160c400f145f/e29130bd-e04d-4042-835b-4ba71dbf114e) {{(pid=102560) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:12:22.385855 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:22.394131 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port af462b70-3112-405d-a84b-10c4370a9bbe is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:22.396954 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device ae5f46f2-7729-4ab9-95e0-646bf67653f0 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:12:22.544287 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-6df7f705-b2f8-4b09-84bf-b4a4b6b83c7d None None] Provisioning complete for port fe9dfbe9-83a8-472c-b3a3-9537d424939b triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:22.544859 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-6df7f705-b2f8-4b09-84bf-b4a4b6b83c7d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (fe9dfbe9-83a8-472c-b3a3-9537d424939b), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:22.737487 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-6df7f705-b2f8-4b09-84bf-b4a4b6b83c7d None None] Port fe9dfbe9-83a8-472c-b3a3-9537d424939b cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:12:22.785661 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port ae5f46f2-7729-4ab9-95e0-646bf67653f0 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:22.796133 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (ae5f46f2-7729-4ab9-95e0-646bf67653f0), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:22.832626 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8006e88f-0662-442d-800a-8826d4a076b1 admin admin] Publish callbacks [] for port (e29130bd-e04d-4042-835b-4ba71dbf114e), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:22.913684 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '751d5daa-7864-4c4e-a90b-e2428fafc279', 'name': 'tempest-ServerRescueNegativeTestJSON-1610510663-router', 'tenant_id': '3fb51fc0e23f4c66a482d4d406197299', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.140'}], 'enable_snat': True}, 'gw_port_id': 'af462b70-3112-405d-a84b-10c4370a9bbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:08Z', 'updated_at': '2022-02-08T18:12:16Z', 'revision_number': 4, 'project_id': '3fb51fc0e23f4c66a482d4d406197299', 'gw_port': {'id': 'af462b70-3112-405d-a84b-10c4370a9bbe', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:c7:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '751d5daa-7864-4c4e-a90b-e2428fafc279', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.140', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:09Z', 'updated_at': '2022-02-08T18:12:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'f7548915-8b6b-47ac-982b-ba931ac61b22', 'name': '', 'network_id': 'f089911e-72de-4ff6-880b-ac3dd7927165', 'tenant_id': '3fb51fc0e23f4c66a482d4d406197299', 'mac_address': 'fa:16:3e:a0:80:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '751d5daa-7864-4c4e-a90b-e2428fafc279', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '0af67967-364e-4325-b04f-b7e157c3c3d4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:15Z', 'updated_at': '2022-02-08T18:12:16Z', 'revision_number': 2, 'project_id': '3fb51fc0e23f4c66a482d4d406197299', 'subnets': [{'id': '0af67967-364e-4325-b04f-b7e157c3c3d4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:22.961431 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8006e88f-0662-442d-800a-8826d4a076b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (e29130bd-e04d-4042-835b-4ba71dbf114e), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:23.038532 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] Checking router: 751d5daa-7864-4c4e-a90b-e2428fafc279 for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:12:23.039042 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] Updating router 751d5daa-7864-4c4e-a90b-e2428fafc279 port f7548915-8b6b-47ac-982b-ba931ac61b22 binding host dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Feb 08 18:12:23.098579 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8006e88f-0662-442d-800a-8826d4a076b1 admin admin] Network 7a854399-3ce6-42bd-bfc4-061132ecb9c2 is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:12:23.109120 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-8006e88f-0662-442d-800a-8826d4a076b1 admin admin] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:23.129693 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 35420) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:23.136879 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1d10caee-854f-4b70-b510-836cb6a10f45 admin admin] Publish callbacks [] for security_group (107ad76a-f551-4869-80fd-4eff87266b2c), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:23.173513 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8006e88f-0662-442d-800a-8826d4a076b1 admin admin] Received port after_create {{(pid=102560) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:12:23.173887 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8006e88f-0662-442d-800a-8826d4a076b1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-560871'] for router_interface (058f0c04-e3de-4d16-8a7a-a7247919133c), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:23.225644 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (f7548915-8b6b-47ac-982b-ba931ac61b22), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:23.516429 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-86fd4db2-c3bd-497d-99b1-eeac4e0c8332 req-eb87fe56-ff3a-4bd8-9d4c-a3854b97277e tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 210 time: 0.3635175 Feb 08 18:12:23.517275 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9661b880-70b1-4aec-943e-9acc8baa488a admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:23.576467 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7b5b75ee-9a72-4262-8c2b-2ebcc23a55dd admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:23.596069 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8006e88f-0662-442d-800a-8826d4a076b1 admin admin] Pushing event updated for resources: {'Port': ['ID=e29130bd-e04d-4042-835b-4ba71dbf114e,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:23.673861 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1d10caee-854f-4b70-b510-836cb6a10f45 admin admin] Publish callbacks [] for security_group (107ad76a-f551-4869-80fd-4eff87266b2c), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:23.855876 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b77511e1-9483-43e3-aaa4-5f7263d010c6 req-ce199d4b-b544-402e-964f-58ba520b855c tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 210 time: 0.3535881 Feb 08 18:12:23.954558 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9661b880-70b1-4aec-943e-9acc8baa488a admin admin] Publish callbacks [] for security_group (d37d6b61-2d84-4e11-83f6-b6aba8d800d5), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.022119 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-4c650e4c-4956-4fbf-b62f-127f12c99d8a tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Publish callbacks [] for port (02c57200-9a7e-48d7-947f-7ed959af8662), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.069960 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] Publish callbacks [] for port (f7548915-8b6b-47ac-982b-ba931ac61b22), precommit_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.075851 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port ae5f46f2-7729-4ab9-95e0-646bf67653f0 is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:24.076362 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (ae5f46f2-7729-4ab9-95e0-646bf67653f0), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.087635 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (f7548915-8b6b-47ac-982b-ba931ac61b22), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.088486 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9661b880-70b1-4aec-943e-9acc8baa488a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (d37d6b61-2d84-4e11-83f6-b6aba8d800d5), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.157943 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-9661b880-70b1-4aec-943e-9acc8baa488a admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=952d647b4574458f91f35e0791ae027e&name=default HTTP/1.1" status: 200 len: 2996 time: 1.8724065 Feb 08 18:12:24.158679 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 35476) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:24.162331 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-4c650e4c-4956-4fbf-b62f-127f12c99d8a tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (02c57200-9a7e-48d7-947f-7ed959af8662), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.173170 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0fe0c28-23a0-424a-abc0-c36615bf2a49 None None] Pushing event updated for resources: {'Port': ['ID=f7548915-8b6b-47ac-982b-ba931ac61b22,revision_number=3']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:24.176490 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 35478) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:24.232412 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] For port ae5f46f2-7729-4ab9-95e0-646bf67653f0, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=ae5f46f2-7729-4ab9-95e0-646bf67653f0,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:12:24.234041 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-5de35642-b311-4451-b779-655c1e17e6c8 None None] Provisioning complete for port e29130bd-e04d-4042-835b-4ba71dbf114e triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:24.234569 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-5de35642-b311-4451-b779-655c1e17e6c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (e29130bd-e04d-4042-835b-4ba71dbf114e), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.248414 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8006e88f-0662-442d-800a-8826d4a076b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (e29130bd-e04d-4042-835b-4ba71dbf114e), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.278051 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-5de35642-b311-4451-b779-655c1e17e6c8 None None] Port e29130bd-e04d-4042-835b-4ba71dbf114e cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:12:24.282349 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (ae5f46f2-7729-4ab9-95e0-646bf67653f0), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.406949 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-4c650e4c-4956-4fbf-b62f-127f12c99d8a tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Network c6ecb925-b9a5-4524-9125-b49155fa007e is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:12:24.413303 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7b5b75ee-9a72-4262-8c2b-2ebcc23a55dd admin admin] Publish callbacks [] for security_group (c2a74643-0aa3-42aa-8e5d-e566dd406ae4), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.423079 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da827513-01fa-43a6-ba55-645ebe6faeb0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (fe9dfbe9-83a8-472c-b3a3-9537d424939b), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.428578 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] Attempting to bind port f7548915-8b6b-47ac-982b-ba931ac61b22 on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:12:24.428949 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] Attempting to bind port f7548915-8b6b-47ac-982b-ba931ac61b22 by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': '7e36cc20-402b-47f5-9242-a15d0de4717c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'f089911e-72de-4ff6-880b-ac3dd7927165'}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:12:24.429307 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] Attempting to bind port f7548915-8b6b-47ac-982b-ba931ac61b22 on network f089911e-72de-4ff6-880b-ac3dd7927165 {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:12:24.432223 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Pushing event updated for resources: {'Port': ['ID=ae5f46f2-7729-4ab9-95e0-646bf67653f0,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:24.438919 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 12, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:12:24.439295 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] Checking segment: {'id': '7e36cc20-402b-47f5-9242-a15d0de4717c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'f089911e-72de-4ff6-880b-ac3dd7927165'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102561) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:12:24.439735 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.440114 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] Bound using segment: {'id': '7e36cc20-402b-47f5-9242-a15d0de4717c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'f089911e-72de-4ff6-880b-ac3dd7927165'} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:12:24.440588 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] Bound port: f7548915-8b6b-47ac-982b-ba931ac61b22, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '7e36cc20-402b-47f5-9242-a15d0de4717c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'f089911e-72de-4ff6-880b-ac3dd7927165'}}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:12:24.440959 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (f7548915-8b6b-47ac-982b-ba931ac61b22), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.471838 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7b5b75ee-9a72-4262-8c2b-2ebcc23a55dd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (c2a74643-0aa3-42aa-8e5d-e566dd406ae4), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.566309 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-cadaa33b-a21a-4d5d-9bc1-6d1c5008bb81 admin admin] Publish callbacks [] for security_group (d37d6b61-2d84-4e11-83f6-b6aba8d800d5), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.571433 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 2aaec302-cd25-4e18-b85c-4834b2fc0c69 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:12:24.594647 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c650e4c-4956-4fbf-b62f-127f12c99d8a tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Pushing event updated for resources: {'Port': ['ID=02c57200-9a7e-48d7-947f-7ed959af8662,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:24.604994 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-4c650e4c-4956-4fbf-b62f-127f12c99d8a tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:24.620492 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-7b5b75ee-9a72-4262-8c2b-2ebcc23a55dd admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=729dd7c370b74904bb7ff8fbe479f3cc&name=default HTTP/1.1" status: 200 len: 2996 time: 1.4794157 Feb 08 18:12:24.625824 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-4c650e4c-4956-4fbf-b62f-127f12c99d8a tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:12:24.641109 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-4c650e4c-4956-4fbf-b62f-127f12c99d8a tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:24.644694 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-4c650e4c-4956-4fbf-b62f-127f12c99d8a tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.647182 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 35484) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:24.720460 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b5b75ee-9a72-4262-8c2b-2ebcc23a55dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c2a74643-0aa3-42aa-8e5d-e566dd406ae4,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:24.731036 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-cadaa33b-a21a-4d5d-9bc1-6d1c5008bb81 admin admin] Publish callbacks [] for security_group (d37d6b61-2d84-4e11-83f6-b6aba8d800d5), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.770400 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] For port f7548915-8b6b-47ac-982b-ba931ac61b22, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102561) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:12:24.841767 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-fd565e6d-6f61-4cab-a365-433b442df445 admin admin] Publish callbacks [] for security_group (c2a74643-0aa3-42aa-8e5d-e566dd406ae4), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.843021 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] For port f7548915-8b6b-47ac-982b-ba931ac61b22, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=f7548915-8b6b-47ac-982b-ba931ac61b22,segment=NetworkSegment(7e36cc20-402b-47f5-9242-a15d0de4717c),segment_id=7e36cc20-402b-47f5-9242-a15d0de4717c)] {{(pid=102561) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:12:24.845895 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 2aaec302-cd25-4e18-b85c-4834b2fc0c69 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:24.845895 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (2aaec302-cd25-4e18-b85c-4834b2fc0c69), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.879744 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-cadaa33b-a21a-4d5d-9bc1-6d1c5008bb81 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (d37d6b61-2d84-4e11-83f6-b6aba8d800d5), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.883808 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-cadaa33b-a21a-4d5d-9bc1-6d1c5008bb81 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.886515 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (f7548915-8b6b-47ac-982b-ba931ac61b22), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.890402 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-cadaa33b-a21a-4d5d-9bc1-6d1c5008bb81 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/d37d6b61-2d84-4e11-83f6-b6aba8d800d5 HTTP/1.1" status: 204 len: 168 time: 0.7241907 Feb 08 18:12:24.930088 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-fd565e6d-6f61-4cab-a365-433b442df445 admin admin] Publish callbacks [] for security_group (c2a74643-0aa3-42aa-8e5d-e566dd406ae4), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.948132 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da827513-01fa-43a6-ba55-645ebe6faeb0 admin admin] Publish callbacks [] for port (fe9dfbe9-83a8-472c-b3a3-9537d424939b), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:24.973071 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cadaa33b-a21a-4d5d-9bc1-6d1c5008bb81 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d37d6b61-2d84-4e11-83f6-b6aba8d800d5,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:24.983376 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8006e88f-0662-442d-800a-8826d4a076b1 admin admin] Publish callbacks [] for port (e29130bd-e04d-4042-835b-4ba71dbf114e), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:25.001934 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8006e88f-0662-442d-800a-8826d4a076b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (e29130bd-e04d-4042-835b-4ba71dbf114e), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:25.002892 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8006e88f-0662-442d-800a-8826d4a076b1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-631683', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-559991'] for router_interface (058f0c04-e3de-4d16-8a7a-a7247919133c), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:25.012681 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] Routers {'751d5daa-7864-4c4e-a90b-e2428fafc279'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:12:25.023197 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:12:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['751d5daa-7864-4c4e-a90b-e2428fafc279'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:25.033754 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-4c650e4c-4956-4fbf-b62f-127f12c99d8a tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.109 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 5.0392165 Feb 08 18:12:25.036862 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1fa3e636-10c3-45a1-b6ec-41dcfd25d3be admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:25.081115 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-5cbccf7a-8613-4532-ac52-517c77fc66c3 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] http://10.222.0.118:9696/v2.0/extensions returned with HTTP 200 {{(pid=102559) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 08 18:12:25.090819 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-5cbccf7a-8613-4532-ac52-517c77fc66c3 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.109 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0213907 Feb 08 18:12:25.227639 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da827513-01fa-43a6-ba55-645ebe6faeb0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (fe9dfbe9-83a8-472c-b3a3-9537d424939b), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:25.230570 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da827513-01fa-43a6-ba55-645ebe6faeb0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-631683', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-559991'] for router_interface (3c53cb16-5d43-40f1-a3a6-2ca2f7a42984), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:25.296642 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9661b880-70b1-4aec-943e-9acc8baa488a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d37d6b61-2d84-4e11-83f6-b6aba8d800d5,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:25.425137 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] Set router 751d5daa-7864-4c4e-a90b-e2428fafc279 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:12:25.453721 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8006e88f-0662-442d-800a-8826d4a076b1 admin admin] Pushing event updated for resources: {'Port': ['ID=e29130bd-e04d-4042-835b-4ba71dbf114e,revision_number=2']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:25.499400 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-fd565e6d-6f61-4cab-a365-433b442df445 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (c2a74643-0aa3-42aa-8e5d-e566dd406ae4), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:25.501921 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-fd565e6d-6f61-4cab-a365-433b442df445 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:25.507664 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-fd565e6d-6f61-4cab-a365-433b442df445 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/c2a74643-0aa3-42aa-8e5d-e566dd406ae4 HTTP/1.1" status: 204 len: 168 time: 0.8092830 Feb 08 18:12:25.538654 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd565e6d-6f61-4cab-a365-433b442df445 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c2a74643-0aa3-42aa-8e5d-e566dd406ae4,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:25.581686 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51edd477-d8be-49b6-8d0c-ed8943272f07 req-5c538899-0790-4104-af4f-db215de0261f tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:25.589798 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-51edd477-d8be-49b6-8d0c-ed8943272f07 req-5c538899-0790-4104-af4f-db215de0261f tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 931 time: 0.1919589 Feb 08 18:12:25.611631 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8006e88f-0662-442d-800a-8826d4a076b1 admin admin] Network 7a854399-3ce6-42bd-bfc4-061132ecb9c2 is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:12:25.616718 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-8006e88f-0662-442d-800a-8826d4a076b1 admin admin] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:25.734845 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-51edd477-d8be-49b6-8d0c-ed8943272f07 req-bb93b712-5060-441f-9513-95cec1388753 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/security-groups?id=a70d7f73-fc20-4c96-ba3a-f48a3d3736a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1391749 Feb 08 18:12:25.790729 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1d10caee-854f-4b70-b510-836cb6a10f45 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (107ad76a-f551-4869-80fd-4eff87266b2c), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:25.800810 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1d10caee-854f-4b70-b510-836cb6a10f45 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:25.802092 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-1d10caee-854f-4b70-b510-836cb6a10f45 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/107ad76a-f551-4869-80fd-4eff87266b2c HTTP/1.1" status: 204 len: 168 time: 4.0038126 Feb 08 18:12:25.833591 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-da827513-01fa-43a6-ba55-645ebe6faeb0 admin admin] Network e430084e-9b28-426f-9937-61346814b135 is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:12:25.898641 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d10caee-854f-4b70-b510-836cb6a10f45 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=107ad76a-f551-4869-80fd-4eff87266b2c,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:25.905636 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-da827513-01fa-43a6-ba55-645ebe6faeb0 admin admin] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:25.913598 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8006e88f-0662-442d-800a-8826d4a076b1 admin admin] Router 058f0c04-e3de-4d16-8a7a-a7247919133c has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:12:25.950477 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-8832371a-4d56-4f2d-83a0-c69b620b537a tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:25.952231 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-8832371a-4d56-4f2d-83a0-c69b620b537a tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/networks?id=f089911e-72de-4ff6-880b-ac3dd7927165 HTTP/1.1" status: 200 len: 819 time: 1.9659076 Feb 08 18:12:26.051170 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da827513-01fa-43a6-ba55-645ebe6faeb0 admin admin] Pushing event updated for resources: {'Port': ['ID=fe9dfbe9-83a8-472c-b3a3-9537d424939b,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:26.060516 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-50f3be4b-f018-49b1-b88d-4331c71dd592 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/quotas/3fb51fc0e23f4c66a482d4d406197299 HTTP/1.1" status: 200 len: 375 time: 0.0894802 Feb 08 18:12:26.187840 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.109', 51647) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:26.213042 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 2aaec302-cd25-4e18-b85c-4834b2fc0c69 is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:26.214153 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (2aaec302-cd25-4e18-b85c-4834b2fc0c69), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:26.356170 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0fe0c28-23a0-424a-abc0-c36615bf2a49 None None] Pushing event updated for resources: {'Port': ['ID=f7548915-8b6b-47ac-982b-ba931ac61b22,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:26.358907 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] Request body: {'port': {'device_id': '6447fbdb-9f53-4284-ab18-211e412243c0', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77398'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:26.363231 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1fa3e636-10c3-45a1-b6ec-41dcfd25d3be admin admin] Publish callbacks [] for security_group (6c3f6905-6240-413b-8e80-f86674d84aa4), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:26.398173 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] For port 2aaec302-cd25-4e18-b85c-4834b2fc0c69, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=2aaec302-cd25-4e18-b85c-4834b2fc0c69,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:12:26.404842 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-96161754-b160-432f-9262-ca40cb3bd21c None None] Provisioning complete for port e29130bd-e04d-4042-835b-4ba71dbf114e triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:26.405251 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-96161754-b160-432f-9262-ca40cb3bd21c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (e29130bd-e04d-4042-835b-4ba71dbf114e), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:26.420819 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (2aaec302-cd25-4e18-b85c-4834b2fc0c69), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:26.447363 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8006e88f-0662-442d-800a-8826d4a076b1 admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:12:26.464625 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] Sync routers for ids ['058f0c04-e3de-4d16-8a7a-a7247919133c'] in dv-cinder-773985-21-iscsi {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:12:26.486824 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-8006e88f-0662-442d-800a-8826d4a076b1 admin admin] 10.222.0.118 "PUT /v2.0/routers/058f0c04-e3de-4d16-8a7a-a7247919133c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.1954589 Feb 08 18:12:26.487031 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] Routers {'058f0c04-e3de-4d16-8a7a-a7247919133c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:12:26.487031 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:12:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['058f0c04-e3de-4d16-8a7a-a7247919133c'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:26.566715 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1fa3e636-10c3-45a1-b6ec-41dcfd25d3be admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (6c3f6905-6240-413b-8e80-f86674d84aa4), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:26.595311 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-ad5ec962-2f38-45bc-b1f5-d16a9281f8f3 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:26.596870 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-ad5ec962-2f38-45bc-b1f5-d16a9281f8f3 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.109 "GET /v2.0/networks?id=f089911e-72de-4ff6-880b-ac3dd7927165 HTTP/1.1" status: 200 len: 819 time: 0.4012418 Feb 08 18:12:26.644187 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-1fa3e636-10c3-45a1-b6ec-41dcfd25d3be admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=bd091ad10c8f46e0af742ee1c81bbf07&name=default HTTP/1.1" status: 200 len: 2996 time: 2.2334235 Feb 08 18:12:26.652750 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-8e93c959-d8f6-4c00-a40d-1ea1f5f9cc58 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Request body: {'port': {'device_id': '3eb2132b-01b1-4916-84eb-81ab88bcfc6d', 'network_id': 'f089911e-72de-4ff6-880b-ac3dd7927165', 'admin_state_up': True, 'tenant_id': '3fb51fc0e23f4c66a482d4d406197299'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:26.656403 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 35514) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:26.725177 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Pushing event updated for resources: {'Port': ['ID=2aaec302-cd25-4e18-b85c-4834b2fc0c69,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:26.732881 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-96161754-b160-432f-9262-ca40cb3bd21c None None] Port e29130bd-e04d-4042-835b-4ba71dbf114e cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:12:26.740259 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device f7548915-8b6b-47ac-982b-ba931ac61b22 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:12:26.785022 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-2ec4baba-b0e5-4f89-8ea0-1d91af1abe2f tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?tenant_id=3fb51fc0e23f4c66a482d4d406197299&fields=id HTTP/1.1" status: 200 len: 255 time: 0.7003648 Feb 08 18:12:26.830383 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fa3e636-10c3-45a1-b6ec-41dcfd25d3be admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6c3f6905-6240-413b-8e80-f86674d84aa4,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:26.862609 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '751d5daa-7864-4c4e-a90b-e2428fafc279', 'name': 'tempest-ServerRescueNegativeTestJSON-1610510663-router', 'tenant_id': '3fb51fc0e23f4c66a482d4d406197299', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.140'}], 'enable_snat': True}, 'gw_port_id': 'af462b70-3112-405d-a84b-10c4370a9bbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:08Z', 'updated_at': '2022-02-08T18:12:16Z', 'revision_number': 4, 'project_id': '3fb51fc0e23f4c66a482d4d406197299', 'gw_port': {'id': 'af462b70-3112-405d-a84b-10c4370a9bbe', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:c7:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '751d5daa-7864-4c4e-a90b-e2428fafc279', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.140', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:09Z', 'updated_at': '2022-02-08T18:12:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'f7548915-8b6b-47ac-982b-ba931ac61b22', 'name': '', 'network_id': 'f089911e-72de-4ff6-880b-ac3dd7927165', 'tenant_id': '3fb51fc0e23f4c66a482d4d406197299', 'mac_address': 'fa:16:3e:a0:80:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '751d5daa-7864-4c4e-a90b-e2428fafc279', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '0af67967-364e-4325-b04f-b7e157c3c3d4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:15Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '3fb51fc0e23f4c66a482d4d406197299', 'subnets': [{'id': '0af67967-364e-4325-b04f-b7e157c3c3d4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:26.866634 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (02c57200-9a7e-48d7-947f-7ed959af8662), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:26.884851 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 35526) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:26.900928 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] Set router 058f0c04-e3de-4d16-8a7a-a7247919133c gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:12:27.015507 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b914ff6a-a849-452b-a007-663ee10684b1 None None] The sync data for ids ['751d5daa-7864-4c4e-a90b-e2428fafc279'] in dv-cinder-773985-21-iscsi is: [{'id': '751d5daa-7864-4c4e-a90b-e2428fafc279', 'name': 'tempest-ServerRescueNegativeTestJSON-1610510663-router', 'tenant_id': '3fb51fc0e23f4c66a482d4d406197299', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.140'}], 'enable_snat': True}, 'gw_port_id': 'af462b70-3112-405d-a84b-10c4370a9bbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:08Z', 'updated_at': '2022-02-08T18:12:16Z', 'revision_number': 4, 'project_id': '3fb51fc0e23f4c66a482d4d406197299', 'gw_port': {'id': 'af462b70-3112-405d-a84b-10c4370a9bbe', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:c7:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '751d5daa-7864-4c4e-a90b-e2428fafc279', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.140', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:09Z', 'updated_at': '2022-02-08T18:12:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'f7548915-8b6b-47ac-982b-ba931ac61b22', 'name': '', 'network_id': 'f089911e-72de-4ff6-880b-ac3dd7927165', 'tenant_id': '3fb51fc0e23f4c66a482d4d406197299', 'mac_address': 'fa:16:3e:a0:80:22', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '751d5daa-7864-4c4e-a90b-e2428fafc279', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': '0af67967-364e-4325-b04f-b7e157c3c3d4', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:15Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '3fb51fc0e23f4c66a482d4d406197299', 'subnets': [{'id': '0af67967-364e-4325-b04f-b7e157c3c3d4', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:12:27.079079 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port f7548915-8b6b-47ac-982b-ba931ac61b22 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:27.079800 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (f7548915-8b6b-47ac-982b-ba931ac61b22), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:27.211732 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-986edcee-d4cb-49e7-bf08-cf937b7733dc None None] Provisioning complete for port fe9dfbe9-83a8-472c-b3a3-9537d424939b triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:27.212185 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-986edcee-d4cb-49e7-bf08-cf937b7733dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (fe9dfbe9-83a8-472c-b3a3-9537d424939b), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:27.219558 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c5217dae-be03-473f-8794-b90ac643c559 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:27.255205 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-da827513-01fa-43a6-ba55-645ebe6faeb0 admin admin] Router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102559) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:12:27.324320 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-732fa98a-772a-4d45-b925-c0eff4df7111 admin admin] Publish callbacks [] for security_group (6c3f6905-6240-413b-8e80-f86674d84aa4), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:27.348822 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'name': 'tempest-AttachVolumeShelveTestJSON-785190803-router', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106'}], 'enable_snat': True}, 'gw_port_id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:11Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'gw_port': {'id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:49:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:14Z', 'updated_at': '2022-02-08T18:12:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'e29130bd-e04d-4042-835b-4ba71dbf114e', 'name': '', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'mac_address': 'fa:16:3e:aa:1e:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '73de7865-d87d-4a2a-a702-160c400f145f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:21Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 2, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'subnets': [{'id': '73de7865-d87d-4a2a-a702-160c400f145f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:27.398399 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-986edcee-d4cb-49e7-bf08-cf937b7733dc None None] Port fe9dfbe9-83a8-472c-b3a3-9537d424939b cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:12:27.404597 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port f7548915-8b6b-47ac-982b-ba931ac61b22 is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:27.405223 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (f7548915-8b6b-47ac-982b-ba931ac61b22), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:27.431283 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] Checking router: 058f0c04-e3de-4d16-8a7a-a7247919133c for host: dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:12:27.431852 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] Updating router 058f0c04-e3de-4d16-8a7a-a7247919133c port e29130bd-e04d-4042-835b-4ba71dbf114e binding host dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Feb 08 18:12:27.465579 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa555158-5b52-4c77-88a8-32d85f1c4415 req-9c6f9e86-e387-4f43-9b7d-2ea28fba8b5d tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:27.483631 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-aa555158-5b52-4c77-88a8-32d85f1c4415 req-9c6f9e86-e387-4f43-9b7d-2ea28fba8b5d tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 931 time: 0.5906460 Feb 08 18:12:27.510003 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-732fa98a-772a-4d45-b925-c0eff4df7111 admin admin] Publish callbacks [] for security_group (6c3f6905-6240-413b-8e80-f86674d84aa4), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:27.511291 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (e29130bd-e04d-4042-835b-4ba71dbf114e), before_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:27.530580 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] For port f7548915-8b6b-47ac-982b-ba931ac61b22, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=f7548915-8b6b-47ac-982b-ba931ac61b22,segment=NetworkSegment(7e36cc20-402b-47f5-9242-a15d0de4717c),segment_id=7e36cc20-402b-47f5-9242-a15d0de4717c)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:12:27.539841 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (f7548915-8b6b-47ac-982b-ba931ac61b22), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:27.542319 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device ae5f46f2-7729-4ab9-95e0-646bf67653f0 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:12:27.589856 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-8e93c959-d8f6-4c00-a40d-1ea1f5f9cc58 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Made reservation on behalf of 3fb51fc0e23f4c66a482d4d406197299 for: {'port': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:12:27.605424 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-8e93c959-d8f6-4c00-a40d-1ea1f5f9cc58 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:27.754416 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Pushing event updated for resources: {'Port': ['ID=f7548915-8b6b-47ac-982b-ba931ac61b22,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:27.779170 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-da827513-01fa-43a6-ba55-645ebe6faeb0 admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102559) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:12:27.789653 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-aa555158-5b52-4c77-88a8-32d85f1c4415 req-0ef24a46-4bc8-47d8-a794-59fd58208dae tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/security-groups?id=a70d7f73-fc20-4c96-ba3a-f48a3d3736a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3045597 Feb 08 18:12:27.792395 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-732fa98a-772a-4d45-b925-c0eff4df7111 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (6c3f6905-6240-413b-8e80-f86674d84aa4), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:27.794436 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port ae5f46f2-7729-4ab9-95e0-646bf67653f0 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:27.795409 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-732fa98a-772a-4d45-b925-c0eff4df7111 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:27.795902 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (ae5f46f2-7729-4ab9-95e0-646bf67653f0), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:27.796522 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-732fa98a-772a-4d45-b925-c0eff4df7111 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/6c3f6905-6240-413b-8e80-f86674d84aa4 HTTP/1.1" status: 204 len: 168 time: 1.1388910 Feb 08 18:12:27.819450 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] Sync routers for ids ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:12:27.839899 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-da827513-01fa-43a6-ba55-645ebe6faeb0 admin admin] 10.222.0.118 "PUT /v2.0/routers/3c53cb16-5d43-40f1-a3a6-2ca2f7a42984/add_router_interface HTTP/1.1" status: 200 len: 503 time: 10.9409876 Feb 08 18:12:27.847136 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-a4aa2f2b-7290-4f04-8f6f-ff6289569e93 service neutron] http://10.222.0.118:9696/v2.0/extensions returned with HTTP 200 {{(pid=102559) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 08 18:12:27.854442 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-a4aa2f2b-7290-4f04-8f6f-ff6289569e93 service neutron] 10.222.0.118 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.4438312 Feb 08 18:12:27.891347 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-732fa98a-772a-4d45-b925-c0eff4df7111 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6c3f6905-6240-413b-8e80-f86674d84aa4,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:27.947847 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] Routers {'3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:12:27.950101 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:12:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:27.969097 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 35552) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:28.238221 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] Set router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:12:28.240906 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port ae5f46f2-7729-4ab9-95e0-646bf67653f0 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:28.287686 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_common [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-8e93c959-d8f6-4c00-a40d-1ea1f5f9cc58 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Allocated IP 172.20.0.10 (f089911e-72de-4ff6-880b-ac3dd7927165/0af67967-364e-4325-b04f-b7e157c3c3d4/f63fc38b-d10b-4316-b77f-d1816d07ca90) {{(pid=102560) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:12:28.364448 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c5217dae-be03-473f-8794-b90ac643c559 admin admin] Publish callbacks [] for security_group (e305743f-35ae-4b99-bc3b-7ea0d4a07250), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:28.457260 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c5217dae-be03-473f-8794-b90ac643c559 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (e305743f-35ae-4b99-bc3b-7ea0d4a07250), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:28.505551 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] Publish callbacks [] for port (e29130bd-e04d-4042-835b-4ba71dbf114e), precommit_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:28.519750 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (e29130bd-e04d-4042-835b-4ba71dbf114e), after_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:28.668528 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 2aaec302-cd25-4e18-b85c-4834b2fc0c69 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:12:28.804948 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] Attempting to bind port e29130bd-e04d-4042-835b-4ba71dbf114e on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:12:28.804948 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] Attempting to bind port e29130bd-e04d-4042-835b-4ba71dbf114e by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': '87601f46-1ba0-4a2e-93d3-e5859bcfbefa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1053, 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2'}] {{(pid=102562) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:12:28.805756 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] Attempting to bind port e29130bd-e04d-4042-835b-4ba71dbf114e on network 7a854399-3ce6-42bd-bfc4-061132ecb9c2 {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:12:28.833794 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 12, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:12:28.833794 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] Checking segment: {'id': '87601f46-1ba0-4a2e-93d3-e5859bcfbefa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1053, 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102562) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:12:28.834097 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:28.834492 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] Bound using segment: {'id': '87601f46-1ba0-4a2e-93d3-e5859bcfbefa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1053, 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2'} {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:12:28.835012 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] Bound port: e29130bd-e04d-4042-835b-4ba71dbf114e, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '87601f46-1ba0-4a2e-93d3-e5859bcfbefa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1053, 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2'}}] {{(pid=102562) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:12:28.835396 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (e29130bd-e04d-4042-835b-4ba71dbf114e), before_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:28.900499 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-8e93c959-d8f6-4c00-a40d-1ea1f5f9cc58 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Publish callbacks [] for port (f63fc38b-d10b-4316-b77f-d1816d07ca90), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:28.955216 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-95692f8b-7bb4-4a0d-8a13-2546f80a0159 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-912634043-network', 'tenant_id': '79419e16041640a5b8905aecada9c0bd'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:29.031776 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-95692f8b-7bb4-4a0d-8a13-2546f80a0159 admin admin] Made reservation on behalf of 79419e16041640a5b8905aecada9c0bd for: {'network': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:12:29.045144 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.db [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] For port e29130bd-e04d-4042-835b-4ba71dbf114e, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102562) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:12:29.055019 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-95692f8b-7bb4-4a0d-8a13-2546f80a0159 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for network (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:29.062221 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.db [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] For port e29130bd-e04d-4042-835b-4ba71dbf114e, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=e29130bd-e04d-4042-835b-4ba71dbf114e,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102562) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:12:29.088599 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-95692f8b-7bb4-4a0d-8a13-2546f80a0159 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:29.088832 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (e29130bd-e04d-4042-835b-4ba71dbf114e), after_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:29.131431 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7657abe6-9842-4259-bbd3-13fdadf42935 None None] Pushing event updated for resources: {'Port': ['ID=e29130bd-e04d-4042-835b-4ba71dbf114e,revision_number=3']} {{(pid=102562) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:29.153604 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 2aaec302-cd25-4e18-b85c-4834b2fc0c69 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:29.154184 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (2aaec302-cd25-4e18-b85c-4834b2fc0c69), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:29.172157 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] Routers {'058f0c04-e3de-4d16-8a7a-a7247919133c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:12:29.176138 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:12:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['058f0c04-e3de-4d16-8a7a-a7247919133c'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:29.322389 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-fbf8c516-28a9-4480-9c7f-78ee609bac5c None None] Provisioning complete for port e29130bd-e04d-4042-835b-4ba71dbf114e triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:29.323173 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-fbf8c516-28a9-4480-9c7f-78ee609bac5c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (e29130bd-e04d-4042-835b-4ba71dbf114e), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:29.331729 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'name': 'tempest-AttachVolumeTestJSON-997005721-router', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77'}], 'enable_snat': True}, 'gw_port_id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:23Z', 'revision_number': 4, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'gw_port': {'id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ad:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'fe9dfbe9-83a8-472c-b3a3-9537d424939b', 'name': '', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'mac_address': 'fa:16:3e:dd:46:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:19Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 2, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'subnets': [{'id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:29.352793 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-95692f8b-7bb4-4a0d-8a13-2546f80a0159 admin admin] Publish callbacks [] for security_group (a930213c-b78d-4de0-b692-a45ab4559fb3), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:29.357177 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 35572) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:29.407725 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-95692f8b-7bb4-4a0d-8a13-2546f80a0159 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (a930213c-b78d-4de0-b692-a45ab4559fb3), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:29.412087 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7657abe6-9842-4259-bbd3-13fdadf42935 None None] Pushing event updated for resources: {'Port': ['ID=e29130bd-e04d-4042-835b-4ba71dbf114e,revision_number=4']} {{(pid=102562) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:29.421712 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-c5217dae-be03-473f-8794-b90ac643c559 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=1e6db5c9009541e0b111ebd0ad56ac9e&name=default HTTP/1.1" status: 200 len: 2996 time: 2.3674121 Feb 08 18:12:29.424315 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b89464df-38fa-4b49-bd43-ecf7e018524b admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:29.432750 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 35574) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:29.440908 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-fa20fbec-f36f-4b53-8695-b2b764f7c81c service neutron] 10.222.0.118 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.5659809 Feb 08 18:12:29.490480 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5217dae-be03-473f-8794-b90ac643c559 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e305743f-35ae-4b99-bc3b-7ea0d4a07250,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:29.498011 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] Set router 058f0c04-e3de-4d16-8a7a-a7247919133c gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:12:29.510321 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 02c57200-9a7e-48d7-947f-7ed959af8662 {{(pid=102559) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:12:29.523778 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] Publish callbacks [] for port (02c57200-9a7e-48d7-947f-7ed959af8662), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:29.527939 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] Checking router: 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:12:29.534368 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] Updating router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 port fe9dfbe9-83a8-472c-b3a3-9537d424939b binding host dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Feb 08 18:12:29.556130 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.provisioning_blocks [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] Transition to ACTIVE for port object 02c57200-9a7e-48d7-947f-7ed959af8662 will not be triggered until provisioned by entity L2. {{(pid=102559) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Feb 08 18:12:29.571036 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (02c57200-9a7e-48d7-947f-7ed959af8662), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:29.585821 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95692f8b-7bb4-4a0d-8a13-2546f80a0159 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a930213c-b78d-4de0-b692-a45ab4559fb3,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:29.649362 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (fe9dfbe9-83a8-472c-b3a3-9537d424939b), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:29.758479 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] Pushing event updated for resources: {'Port': ['ID=02c57200-9a7e-48d7-947f-7ed959af8662,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:29.802950 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 2aaec302-cd25-4e18-b85c-4834b2fc0c69 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:29.804334 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device f7548915-8b6b-47ac-982b-ba931ac61b22 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:12:29.838378 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b89464df-38fa-4b49-bd43-ecf7e018524b admin admin] Publish callbacks [] for security_group (deeef8df-b3e2-4e96-b1aa-1f30bdad4675), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:29.841061 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-95692f8b-7bb4-4a0d-8a13-2546f80a0159 admin admin] vlan segment allocate from pool success with {'vlan_id': 1067, 'physical_network': 'physnet1'} {{(pid=102560) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Feb 08 18:12:29.862404 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-fbf8c516-28a9-4480-9c7f-78ee609bac5c None None] Current status of the port e29130bd-e04d-4042-835b-4ba71dbf114e is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:29.863107 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-fbf8c516-28a9-4480-9c7f-78ee609bac5c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (e29130bd-e04d-4042-835b-4ba71dbf114e), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:29.866500 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b89464df-38fa-4b49-bd43-ecf7e018524b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (deeef8df-b3e2-4e96-b1aa-1f30bdad4675), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:29.918044 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-b89464df-38fa-4b49-bd43-ecf7e018524b admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=5f8a959456bc4135bd1c2fb754fb9293&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5520680 Feb 08 18:12:29.926028 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b89464df-38fa-4b49-bd43-ecf7e018524b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=deeef8df-b3e2-4e96-b1aa-1f30bdad4675,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:29.942928 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-8e93c959-d8f6-4c00-a40d-1ea1f5f9cc58 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (f63fc38b-d10b-4316-b77f-d1816d07ca90), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:29.974020 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 35582) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:29.990158 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-95692f8b-7bb4-4a0d-8a13-2546f80a0159 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (fb6acaa2-48ff-4126-a574-8dbc61d891f2), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:29.990498 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.segments_db [None req-95692f8b-7bb4-4a0d-8a13-2546f80a0159 admin admin] Added segment fb6acaa2-48ff-4126-a574-8dbc61d891f2 of type vlan for network ac3916d4-9872-41ed-bd38-bd02d3afee04 Feb 08 18:12:30.047613 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-07af9147-f964-4e87-a1cd-a610b8f31ad0 admin admin] Publish callbacks [] for security_group (e305743f-35ae-4b99-bc3b-7ea0d4a07250), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:30.070440 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] Attempting to bind port 02c57200-9a7e-48d7-947f-7ed959af8662 on host hv-cinder-77398 for vnic_type normal with profile {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:12:30.072865 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] Attempting to bind port 02c57200-9a7e-48d7-947f-7ed959af8662 by drivers openvswitch,hyperv on host hv-cinder-77398 at level 0 using segments [{'id': '36b36f15-bf90-46bb-ac3a-109acbbc7fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1093, 'network_id': 'c6ecb925-b9a5-4524-9125-b49155fa007e'}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:12:30.075911 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] Attempting to bind port 02c57200-9a7e-48d7-947f-7ed959af8662 on network c6ecb925-b9a5-4524-9125-b49155fa007e {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:12:30.091601 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] Port 02c57200-9a7e-48d7-947f-7ed959af8662 on network c6ecb925-b9a5-4524-9125-b49155fa007e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77398 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Feb 08 18:12:30.095158 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] Attempting to bind port 02c57200-9a7e-48d7-947f-7ed959af8662 on network c6ecb925-b9a5-4524-9125-b49155fa007e {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:12:30.113367 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] Checking agent: {'id': '045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77398', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'started_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 12, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:12:30.115816 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] Checking segment: {'id': '36b36f15-bf90-46bb-ac3a-109acbbc7fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1093, 'network_id': 'c6ecb925-b9a5-4524-9125-b49155fa007e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102559) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:12:30.117083 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] Bound using segment: {'id': '36b36f15-bf90-46bb-ac3a-109acbbc7fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1093, 'network_id': 'c6ecb925-b9a5-4524-9125-b49155fa007e'} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:12:30.118944 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] Bound port: 02c57200-9a7e-48d7-947f-7ed959af8662, host: hv-cinder-77398, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '36b36f15-bf90-46bb-ac3a-109acbbc7fd3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1093, 'network_id': 'c6ecb925-b9a5-4524-9125-b49155fa007e'}}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:12:30.120642 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (02c57200-9a7e-48d7-947f-7ed959af8662), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:30.171711 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 35586) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:30.200328 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-07af9147-f964-4e87-a1cd-a610b8f31ad0 admin admin] Publish callbacks [] for security_group (e305743f-35ae-4b99-bc3b-7ea0d4a07250), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:30.322214 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-320c2965-8031-4acb-a7e7-e13060b6c43c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1480792638', 'description': 'tempest-description--471192434'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:30.359539 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-eb40875b-8a73-4e1d-8060-057785e6184f service neutron] 10.222.0.118 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.9165506 Feb 08 18:12:30.395427 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'name': 'tempest-AttachVolumeShelveTestJSON-785190803-router', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106'}], 'enable_snat': True}, 'gw_port_id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:11Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'gw_port': {'id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:49:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:14Z', 'updated_at': '2022-02-08T18:12:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'e29130bd-e04d-4042-835b-4ba71dbf114e', 'name': '', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'mac_address': 'fa:16:3e:aa:1e:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '73de7865-d87d-4a2a-a702-160c400f145f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:21Z', 'updated_at': '2022-02-08T18:12:29Z', 'revision_number': 4, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'subnets': [{'id': '73de7865-d87d-4a2a-a702-160c400f145f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:30.491132 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4595eb25-1cdf-4a80-b504-e1acaf265aa1 None None] The sync data for ids ['058f0c04-e3de-4d16-8a7a-a7247919133c'] in dv-cinder-773985-21-iscsi is: [{'id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'name': 'tempest-AttachVolumeShelveTestJSON-785190803-router', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106'}], 'enable_snat': True}, 'gw_port_id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:11Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'gw_port': {'id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:49:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:14Z', 'updated_at': '2022-02-08T18:12:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'e29130bd-e04d-4042-835b-4ba71dbf114e', 'name': '', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'mac_address': 'fa:16:3e:aa:1e:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '73de7865-d87d-4a2a-a702-160c400f145f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:21Z', 'updated_at': '2022-02-08T18:12:29Z', 'revision_number': 4, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'subnets': [{'id': '73de7865-d87d-4a2a-a702-160c400f145f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:12:30.528864 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-fbf8c516-28a9-4480-9c7f-78ee609bac5c None None] For port e29130bd-e04d-4042-835b-4ba71dbf114e, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=e29130bd-e04d-4042-835b-4ba71dbf114e,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:12:30.538895 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-fbf8c516-28a9-4480-9c7f-78ee609bac5c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (e29130bd-e04d-4042-835b-4ba71dbf114e), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:30.543488 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e93c959-d8f6-4c00-a40d-1ea1f5f9cc58 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Pushing event updated for resources: {'Port': ['ID=f63fc38b-d10b-4316-b77f-d1816d07ca90,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:30.583924 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port f7548915-8b6b-47ac-982b-ba931ac61b22 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:30.584464 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (f7548915-8b6b-47ac-982b-ba931ac61b22), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:30.591535 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-01966f73-1d98-4980-9002-f02289cd0302 admin admin] Publish callbacks [] for security_group (deeef8df-b3e2-4e96-b1aa-1f30bdad4675), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:30.652381 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-320c2965-8031-4acb-a7e7-e13060b6c43c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:30.686887 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-95692f8b-7bb4-4a0d-8a13-2546f80a0159 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8770558521384'] for network (ac3916d4-9872-41ed-bd38-bd02d3afee04), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:30.698725 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] For port 02c57200-9a7e-48d7-947f-7ed959af8662, host hv-cinder-77398, cleared binding levels {{(pid=102559) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:12:30.763165 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-07af9147-f964-4e87-a1cd-a610b8f31ad0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (e305743f-35ae-4b99-bc3b-7ea0d4a07250), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:30.775495 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-07af9147-f964-4e87-a1cd-a610b8f31ad0 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:30.778997 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-07af9147-f964-4e87-a1cd-a610b8f31ad0 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/e305743f-35ae-4b99-bc3b-7ea0d4a07250 HTTP/1.1" status: 204 len: 168 time: 1.2425663 Feb 08 18:12:30.796341 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-95692f8b-7bb4-4a0d-8a13-2546f80a0159 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for network (ac3916d4-9872-41ed-bd38-bd02d3afee04), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:30.797347 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-95692f8b-7bb4-4a0d-8a13-2546f80a0159 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:30.797860 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-95692f8b-7bb4-4a0d-8a13-2546f80a0159 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:30.826533 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-8e93c959-d8f6-4c00-a40d-1ea1f5f9cc58 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Network f089911e-72de-4ff6-880b-ac3dd7927165 is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:12:30.863920 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] For port 02c57200-9a7e-48d7-947f-7ed959af8662, host hv-cinder-77398, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=02c57200-9a7e-48d7-947f-7ed959af8662,segment=NetworkSegment(36b36f15-bf90-46bb-ac3a-109acbbc7fd3),segment_id=36b36f15-bf90-46bb-ac3a-109acbbc7fd3)] {{(pid=102559) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:12:30.880367 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-01966f73-1d98-4980-9002-f02289cd0302 admin admin] Publish callbacks [] for security_group (deeef8df-b3e2-4e96-b1aa-1f30bdad4675), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:30.923761 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (02c57200-9a7e-48d7-947f-7ed959af8662), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:30.929386 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-b50408c3-438c-4742-812e-b54df9ee6d34 None None] Provisioning complete for port e29130bd-e04d-4042-835b-4ba71dbf114e triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:30.931697 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b50408c3-438c-4742-812e-b54df9ee6d34 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (e29130bd-e04d-4042-835b-4ba71dbf114e), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:30.984521 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fbf8c516-28a9-4480-9c7f-78ee609bac5c None None] Pushing event updated for resources: {'Port': ['ID=e29130bd-e04d-4042-835b-4ba71dbf114e,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:30.984935 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-8e93c959-d8f6-4c00-a40d-1ea1f5f9cc58 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:30.998980 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07af9147-f964-4e87-a1cd-a610b8f31ad0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e305743f-35ae-4b99-bc3b-7ea0d4a07250,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:31.028788 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-8e93c959-d8f6-4c00-a40d-1ea1f5f9cc58 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Received port after_create {{(pid=102560) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:12:31.047172 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-8e93c959-d8f6-4c00-a40d-1ea1f5f9cc58 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:31.052555 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-8e93c959-d8f6-4c00-a40d-1ea1f5f9cc58 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:31.126894 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-8e93c959-d8f6-4c00-a40d-1ea1f5f9cc58 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.109 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 4.4764087 Feb 08 18:12:31.186574 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] Pushing event updated for resources: {'Port': ['ID=02c57200-9a7e-48d7-947f-7ed959af8662,revision_number=3']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:31.275672 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port f7548915-8b6b-47ac-982b-ba931ac61b22 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:31.359079 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] Publish callbacks [] for port (fe9dfbe9-83a8-472c-b3a3-9537d424939b), precommit_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:31.385901 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (fe9dfbe9-83a8-472c-b3a3-9537d424939b), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:31.408024 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:31.408688 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:31.435316 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-369c23cc-820a-45f0-8590-a647ea25a42f service neutron] 10.222.0.109 "PUT /v2.0/ports/02c57200-9a7e-48d7-947f-7ed959af8662 HTTP/1.1" status: 200 len: 1093 time: 5.9849801 Feb 08 18:12:31.435445 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-b50408c3-438c-4742-812e-b54df9ee6d34 None None] Current status of the port e29130bd-e04d-4042-835b-4ba71dbf114e is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:31.480961 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6447fbdb-9f53-4284-ab18-211e412243c0', 'tag': '02c57200-9a7e-48d7-947f-7ed959af8662'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:12:31.619830 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device e29130bd-e04d-4042-835b-4ba71dbf114e up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:12:31.692282 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 35618) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:31.701329 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-bd9cde14-becf-4ad4-9ca4-30da14216271 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1412299109', 'description': 'tempest-description--1880052629'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:31.863672 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] Request body: {'port': {'device_id': '3eb2132b-01b1-4916-84eb-81ab88bcfc6d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77398'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:31.941762 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-95692f8b-7bb4-4a0d-8a13-2546f80a0159 admin admin] 10.222.0.118 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 3.9716647 Feb 08 18:12:31.942668 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 35632) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:31.989132 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0514eae5-1fde-4364-905d-702200ca6acb req-e1bb2a90-27c0-4f3e-ba56-0585bc96511f tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:31.991097 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0514eae5-1fde-4364-905d-702200ca6acb req-e1bb2a90-27c0-4f3e-ba56-0585bc96511f tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 943 time: 0.8149016 Feb 08 18:12:31.997447 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-bd9cde14-becf-4ad4-9ca4-30da14216271 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:32.021441 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-54b25bf9-ab39-4f90-9cec-73f5c22fa950 admin admin] Request body: {'subnet': {'network_id': 'ac3916d4-9872-41ed-bd38-bd02d3afee04', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-912634043-subnet', 'tenant_id': '79419e16041640a5b8905aecada9c0bd', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:32.052025 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31983199-6bb6-404c-804c-79345b685215 None None] Pushing event updated for resources: {'Port': ['ID=fe9dfbe9-83a8-472c-b3a3-9537d424939b,revision_number=3']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:32.055419 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e80dfb78-702e-43e4-87f3-0200260e6378 req-256de2d3-154c-48a3-9185-198e712a8e62 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 210 time: 0.1816335 Feb 08 18:12:32.056619 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-01966f73-1d98-4980-9002-f02289cd0302 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (deeef8df-b3e2-4e96-b1aa-1f30bdad4675), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:32.070278 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-01966f73-1d98-4980-9002-f02289cd0302 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:32.075028 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-01966f73-1d98-4980-9002-f02289cd0302 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/deeef8df-b3e2-4e96-b1aa-1f30bdad4675 HTTP/1.1" status: 204 len: 168 time: 2.0973847 Feb 08 18:12:32.117352 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] Attempting to bind port fe9dfbe9-83a8-472c-b3a3-9537d424939b on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:12:32.128007 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] Attempting to bind port fe9dfbe9-83a8-472c-b3a3-9537d424939b by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': 'acdceaea-bf94-4e23-8e9f-0f5d9197e75f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1082, 'network_id': 'e430084e-9b28-426f-9937-61346814b135'}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:12:32.128652 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] Attempting to bind port fe9dfbe9-83a8-472c-b3a3-9537d424939b on network e430084e-9b28-426f-9937-61346814b135 {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:12:32.159475 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01966f73-1d98-4980-9002-f02289cd0302 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=deeef8df-b3e2-4e96-b1aa-1f30bdad4675,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:32.163363 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 12, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:12:32.165504 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] Checking segment: {'id': 'acdceaea-bf94-4e23-8e9f-0f5d9197e75f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1082, 'network_id': 'e430084e-9b28-426f-9937-61346814b135'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102561) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:12:32.175801 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:32.175801 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] Bound using segment: {'id': 'acdceaea-bf94-4e23-8e9f-0f5d9197e75f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1082, 'network_id': 'e430084e-9b28-426f-9937-61346814b135'} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:12:32.175801 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] Bound port: fe9dfbe9-83a8-472c-b3a3-9537d424939b, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'acdceaea-bf94-4e23-8e9f-0f5d9197e75f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1082, 'network_id': 'e430084e-9b28-426f-9937-61346814b135'}}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:12:32.175801 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (fe9dfbe9-83a8-472c-b3a3-9537d424939b), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:32.179053 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95692f8b-7bb4-4a0d-8a13-2546f80a0159 admin admin] Pushing event updated for resources: {'Network': ['ID=ac3916d4-9872-41ed-bd38-bd02d3afee04,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:32.214798 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ccad4b46-b85b-453e-976c-9b3604271bc7 None None] Provisioning complete for port fe9dfbe9-83a8-472c-b3a3-9537d424939b triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:32.216838 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ccad4b46-b85b-453e-976c-9b3604271bc7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (fe9dfbe9-83a8-472c-b3a3-9537d424939b), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:32.248177 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-3d696e28-5cd9-4050-8a8f-51e348e192f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:32.249988 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-3d696e28-5cd9-4050-8a8f-51e348e192f9 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=4947894da18b4d0580dc1cf24ecb581c&device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 1127 time: 0.5594044 Feb 08 18:12:32.268616 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Network ac3916d4-9872-41ed-bd38-bd02d3afee04 details requested by agent ovs-agent-dv-cinder-773985-21-iscsi with host dv-cinder-773985-21-iscsi {{(pid=102561) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Feb 08 18:12:32.288681 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-09e963c8-3a88-470e-ac7a-2cfac9916ad0" -d '{"events": [{"name": "network-changed", "server_uuid": "6447fbdb-9f53-4284-ab18-211e412243c0", "tag": "02c57200-9a7e-48d7-947f-7ed959af8662"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:12:32.312288 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-54b25bf9-ab39-4f90-9cec-73f5c22fa950 admin admin] Made reservation on behalf of 79419e16041640a5b8905aecada9c0bd for: {'subnet': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:12:32.318168 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-54b25bf9-ab39-4f90-9cec-73f5c22fa950 admin admin] Publish callbacks [] for subnet (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:32.428903 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ccad4b46-b85b-453e-976c-9b3604271bc7 None None] Port fe9dfbe9-83a8-472c-b3a3-9537d424939b cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:12:32.436748 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-847cc24d-e94c-49c7-b0b8-5d1e3f615b63 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=02c57200-9a7e-48d7-947f-7ed959af8662 HTTP/1.1" status: 200 len: 217 time: 0.1613560 Feb 08 18:12:32.442089 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (f63fc38b-d10b-4316-b77f-d1816d07ca90), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:32.553408 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-320c2965-8031-4acb-a7e7-e13060b6c43c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group (996a6093-6720-4c3e-aa49-14509ff61ad7), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:32.574250 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port e29130bd-e04d-4042-835b-4ba71dbf114e triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:32.574795 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (e29130bd-e04d-4042-835b-4ba71dbf114e), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:32.615287 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0514eae5-1fde-4364-905d-702200ca6acb req-e75448cc-6f6d-4107-bd46-0f3ec60a2b97 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/security-groups?id=a70d7f73-fc20-4c96-ba3a-f48a3d3736a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5589187 Feb 08 18:12:32.669241 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] For port fe9dfbe9-83a8-472c-b3a3-9537d424939b, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102561) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:12:32.675915 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] For port fe9dfbe9-83a8-472c-b3a3-9537d424939b, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=fe9dfbe9-83a8-472c-b3a3-9537d424939b,segment=NetworkSegment(acdceaea-bf94-4e23-8e9f-0f5d9197e75f),segment_id=acdceaea-bf94-4e23-8e9f-0f5d9197e75f)] {{(pid=102561) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:12:32.687057 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-320c2965-8031-4acb-a7e7-e13060b6c43c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (996a6093-6720-4c3e-aa49-14509ff61ad7), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:32.796514 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (fe9dfbe9-83a8-472c-b3a3-9537d424939b), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:32.860470 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-43820c6e-4c97-4336-b409-80b25889e687 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:32.863157 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31983199-6bb6-404c-804c-79345b685215 None None] Pushing event updated for resources: {'Port': ['ID=fe9dfbe9-83a8-472c-b3a3-9537d424939b,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:32.864213 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-43820c6e-4c97-4336-b409-80b25889e687 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=bb9e2714-8d92-49d4-a88e-0ba6d48e2ad3 HTTP/1.1" status: 200 len: 852 time: 0.3432684 Feb 08 18:12:33.022445 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-bd9cde14-becf-4ad4-9ca4-30da14216271 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group (c2d6b890-d2af-425a-a791-9710f0f7e35e), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:33.098413 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-bd9cde14-becf-4ad4-9ca4-30da14216271 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (c2d6b890-d2af-425a-a791-9710f0f7e35e), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:33.104804 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:12:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-65673e64-ba8a-4061-92f3-15dab6a63dec x-openstack-request-id: req-65673e64-ba8a-4061-92f3-15dab6a63dec {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:12:33.105289 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6447fbdb-9f53-4284-ab18-211e412243c0", "tag": "02c57200-9a7e-48d7-947f-7ed959af8662", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:12:33.106262 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-65673e64-ba8a-4061-92f3-15dab6a63dec {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:12:33.106262 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6447fbdb-9f53-4284-ab18-211e412243c0', 'tag': '02c57200-9a7e-48d7-947f-7ed959af8662', 'status': 'completed', 'code': 200} Feb 08 18:12:33.157041 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] Routers {'3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:12:33.165903 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:12:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:33.225704 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.109', 51654) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:33.236019 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-54b25bf9-ab39-4f90-9cec-73f5c22fa950 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for subnet (a58df055-0c8a-41e0-888e-ae6d4ec79821), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:33.270748 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-320c2965-8031-4acb-a7e7-e13060b6c43c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Pushing event updated for resources: {'SecurityGroup': ['ID=996a6093-6720-4c3e-aa49-14509ff61ad7,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:33.384061 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-320c2965-8031-4acb-a7e7-e13060b6c43c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:33.393901 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-320c2965-8031-4acb-a7e7-e13060b6c43c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 3.1445463 Feb 08 18:12:33.408015 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 35672) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:33.410608 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-d485f8b9-7d64-4a4e-b99d-24cc5f723137 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=c6ecb925-b9a5-4524-9125-b49155fa007e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.3771231 Feb 08 18:12:33.416640 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-47a4ea6a-f9b3-4ea3-9b68-3ae0c8238cc8 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Request body: {'security_group_rule': {'security_group_id': '996a6093-6720-4c3e-aa49-14509ff61ad7', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:33.430832 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port e29130bd-e04d-4042-835b-4ba71dbf114e is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:33.523138 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] Set router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:12:33.526372 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8c076697-e3f6-437a-a3e7-3552b8587c33 req-ea31f3cc-6ed8-4945-a0b4-ca0118df6b0c tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 210 time: 0.2190783 Feb 08 18:12:33.592976 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-bd9cde14-becf-4ad4-9ca4-30da14216271 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:33.595084 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-bd9cde14-becf-4ad4-9ca4-30da14216271 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 1.9004874 Feb 08 18:12:33.603243 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-47a4ea6a-f9b3-4ea3-9b68-3ae0c8238cc8 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group_rule (67d50286-5850-4277-840a-0ed6dba039ff), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:33.640416 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 35674) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:33.656886 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-f2145641-48ec-46c3-8aa4-6e4e29044651 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Request body: {'security_group_rule': {'security_group_id': 'c2d6b890-d2af-425a-a791-9710f0f7e35e', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:33.678367 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd9cde14-becf-4ad4-9ca4-30da14216271 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Pushing event updated for resources: {'SecurityGroup': ['ID=c2d6b890-d2af-425a-a791-9710f0f7e35e,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:33.732684 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-47a4ea6a-f9b3-4ea3-9b68-3ae0c8238cc8 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group_rule (67d50286-5850-4277-840a-0ed6dba039ff), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:33.743180 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-47a4ea6a-f9b3-4ea3-9b68-3ae0c8238cc8 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (67d50286-5850-4277-840a-0ed6dba039ff), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:33.803782 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47a4ea6a-f9b3-4ea3-9b68-3ae0c8238cc8 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=67d50286-5850-4277-840a-0ed6dba039ff,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:33.838855 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f2145641-48ec-46c3-8aa4-6e4e29044651 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group_rule (5192abde-6149-452e-b4c5-1a7dd6c24a9e), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:33.875265 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-54b25bf9-ab39-4f90-9cec-73f5c22fa950 admin admin] Checking segment: {'id': 'fb6acaa2-48ff-4126-a574-8dbc61d891f2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1067, 'network_id': 'ac3916d4-9872-41ed-bd38-bd02d3afee04'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102560) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:12:33.876342 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54b25bf9-ab39-4f90-9cec-73f5c22fa950 admin admin] Network hostable DHCP agents. Network: ac3916d4-9872-41ed-bd38-bd02d3afee04, hostable agents: ['006b5388-ac7d-4794-a124-14bb8e5d8fec'], hosted agents: [] {{(pid=102560) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Feb 08 18:12:33.913217 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-edd3b8bd-7599-4ce1-8351-9a497fe3b7cf None None] Provisioning complete for port fe9dfbe9-83a8-472c-b3a3-9537d424939b triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:33.918303 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-edd3b8bd-7599-4ce1-8351-9a497fe3b7cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (fe9dfbe9-83a8-472c-b3a3-9537d424939b), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:33.956708 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-2adb4a60-24db-46df-b9f8-8d2a0e3b0a50 service neutron] 10.222.0.109 "GET /v2.0/networks/c6ecb925-b9a5-4524-9125-b49155fa007e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4947324 Feb 08 18:12:33.960553 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-54b25bf9-ab39-4f90-9cec-73f5c22fa950 admin admin] Network ac3916d4-9872-41ed-bd38-bd02d3afee04 is scheduled to be hosted by DHCP agent 006b5388-ac7d-4794-a124-14bb8e5d8fec with binding_index 1 {{(pid=102560) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Feb 08 18:12:33.970119 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-47a4ea6a-f9b3-4ea3-9b68-3ae0c8238cc8 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:33.978128 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-47a4ea6a-f9b3-4ea3-9b68-3ae0c8238cc8 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.5645788 Feb 08 18:12:33.979260 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 35688) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:33.998726 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54b25bf9-ab39-4f90-9cec-73f5c22fa950 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a58df055-0c8a-41e0-888e-ae6d4ec79821,revision_number=0']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:34.045635 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-a35f7e9c-8a5f-498c-b778-ae24c6f4a94e tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:34.047410 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-a35f7e9c-8a5f-498c-b778-ae24c6f4a94e tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.109 "GET /v2.0/networks?id=f089911e-72de-4ff6-880b-ac3dd7927165 HTTP/1.1" status: 200 len: 819 time: 0.8062739 Feb 08 18:12:34.063614 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-54b25bf9-ab39-4f90-9cec-73f5c22fa950 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773985-21-iscsi, ac3916d4-9872-41ed-bd38-bd02d3afee04) {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:34.068711 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f2145641-48ec-46c3-8aa4-6e4e29044651 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group_rule (5192abde-6149-452e-b4c5-1a7dd6c24a9e), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:34.081177 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-5d542372-5673-4bdd-a776-da428c0ca48d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Request body: {'security_group_rule': {'security_group_id': '996a6093-6720-4c3e-aa49-14509ff61ad7', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:34.096152 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-54b25bf9-ab39-4f90-9cec-73f5c22fa950 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:34.098711 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-bc2422c2-806d-403c-a9e0-421d705911e1 None None] Network ac3916d4-9872-41ed-bd38-bd02d3afee04 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:12:34.099000 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-54b25bf9-ab39-4f90-9cec-73f5c22fa950 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:34.111307 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f2145641-48ec-46c3-8aa4-6e4e29044651 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (5192abde-6149-452e-b4c5-1a7dd6c24a9e), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:34.144000 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-fd9c503f-91c7-4aa0-a170-9fc634b0c31b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Request body: {'port': {'device_id': 'eb0ad33a-c04e-4d37-ab65-6b2bd025791d', 'network_id': 'f089911e-72de-4ff6-880b-ac3dd7927165', 'admin_state_up': True, 'tenant_id': '3fb51fc0e23f4c66a482d4d406197299'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:34.253687 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2145641-48ec-46c3-8aa4-6e4e29044651 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5192abde-6149-452e-b4c5-1a7dd6c24a9e,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:34.276253 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f2145641-48ec-46c3-8aa4-6e4e29044651 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:34.279266 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-f2145641-48ec-46c3-8aa4-6e4e29044651 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.6336968 Feb 08 18:12:34.284130 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 35702) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:34.292776 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-54b25bf9-ab39-4f90-9cec-73f5c22fa950 admin admin] 10.222.0.118 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 2.2754312 Feb 08 18:12:34.296719 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-fd4e2aa6-cc38-4149-9312-39f257936ca6 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Request body: {'security_group_rule': {'security_group_id': 'c2d6b890-d2af-425a-a791-9710f0f7e35e', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:34.324961 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-fd9c503f-91c7-4aa0-a170-9fc634b0c31b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Made reservation on behalf of 3fb51fc0e23f4c66a482d4d406197299 for: {'port': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:12:34.331362 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-fd9c503f-91c7-4aa0-a170-9fc634b0c31b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:34.362334 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f4bb25f0-74e1-4bc8-9adf-bbdd8522967f req-d93b9170-377a-420c-885e-3f861b6ee54e service neutron] 10.222.0.109 "GET /v2.0/networks/c6ecb925-b9a5-4524-9125-b49155fa007e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3814116 Feb 08 18:12:34.385289 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5d542372-5673-4bdd-a776-da428c0ca48d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group_rule (2ab09b93-3e11-42aa-b63d-2b00a0f72786), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:34.461480 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-035d2ad0-5777-4aa1-9238-6baf6a185678 req-d9e57902-764b-44f9-af46-b214fb08c64e tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:34.474266 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-035d2ad0-5777-4aa1-9238-6baf6a185678 req-d9e57902-764b-44f9-af46-b214fb08c64e tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 943 time: 0.6210732 Feb 08 18:12:34.503222 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-994b681c-41dc-4a48-8983-3307987c9ede None None] Network ac3916d4-9872-41ed-bd38-bd02d3afee04 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:12:34.607214 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fd4e2aa6-cc38-4149-9312-39f257936ca6 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group_rule (3ed9d37a-c82a-48f0-80fd-c296623be9d6), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:34.745421 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9bf94c77-d2cb-4eb7-98b8-2d6cdd21c035 req-343e22e3-d8cd-448b-a837-5cb5c0f58ee1 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 210 time: 0.0758567 Feb 08 18:12:34.770680 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09e963c8-3a88-470e-ac7a-2cfac9916ad0 req-ba148690-6052-405c-9019-7f3d83995ae7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:34.771922 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-09e963c8-3a88-470e-ac7a-2cfac9916ad0 req-ba148690-6052-405c-9019-7f3d83995ae7 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=4947894da18b4d0580dc1cf24ecb581c&device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 1127 time: 0.2646575 Feb 08 18:12:34.776496 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5d542372-5673-4bdd-a776-da428c0ca48d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group_rule (2ab09b93-3e11-42aa-b63d-2b00a0f72786), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:34.777202 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f63fc38b-d10b-4316-b77f-d1816d07ca90 {{(pid=102560) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:12:34.783002 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fd4e2aa6-cc38-4149-9312-39f257936ca6 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group_rule (3ed9d37a-c82a-48f0-80fd-c296623be9d6), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:34.787565 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5d542372-5673-4bdd-a776-da428c0ca48d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (2ab09b93-3e11-42aa-b63d-2b00a0f72786), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:34.797815 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] Publish callbacks [] for port (f63fc38b-d10b-4316-b77f-d1816d07ca90), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:34.800627 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d542372-5673-4bdd-a776-da428c0ca48d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2ab09b93-3e11-42aa-b63d-2b00a0f72786,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:34.819452 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fd4e2aa6-cc38-4149-9312-39f257936ca6 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (3ed9d37a-c82a-48f0-80fd-c296623be9d6), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:34.873196 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-edd3b8bd-7599-4ce1-8351-9a497fe3b7cf None None] Current status of the port fe9dfbe9-83a8-472c-b3a3-9537d424939b is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:34.873196 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-edd3b8bd-7599-4ce1-8351-9a497fe3b7cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (fe9dfbe9-83a8-472c-b3a3-9537d424939b), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:34.882316 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.provisioning_blocks [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] Transition to ACTIVE for port object f63fc38b-d10b-4316-b77f-d1816d07ca90 will not be triggered until provisioned by entity L2. {{(pid=102560) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Feb 08 18:12:34.912954 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (f63fc38b-d10b-4316-b77f-d1816d07ca90), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:35.076780 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-edd3b8bd-7599-4ce1-8351-9a497fe3b7cf None None] For port fe9dfbe9-83a8-472c-b3a3-9537d424939b, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=fe9dfbe9-83a8-472c-b3a3-9537d424939b,segment=NetworkSegment(acdceaea-bf94-4e23-8e9f-0f5d9197e75f),segment_id=acdceaea-bf94-4e23-8e9f-0f5d9197e75f)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:12:35.114073 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd4e2aa6-cc38-4149-9312-39f257936ca6 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3ed9d37a-c82a-48f0-80fd-c296623be9d6,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:35.117932 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5d542372-5673-4bdd-a776-da428c0ca48d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:35.125261 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'name': 'tempest-AttachVolumeTestJSON-997005721-router', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77'}], 'enable_snat': True}, 'gw_port_id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:23Z', 'revision_number': 4, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'gw_port': {'id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ad:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'fe9dfbe9-83a8-472c-b3a3-9537d424939b', 'name': '', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'mac_address': 'fa:16:3e:dd:46:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:19Z', 'updated_at': '2022-02-08T18:12:32Z', 'revision_number': 4, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'subnets': [{'id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:35.143524 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-5d542372-5673-4bdd-a776-da428c0ca48d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.1591580 Feb 08 18:12:35.176804 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 35730) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:35.193455 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-c10296ae-4c74-492f-9b8f-a7b84da5c82e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Request body: {'floatingip': {'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:35.254367 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3140a616-b0f1-4db5-8516-525d6fb083ba None None] The sync data for ids ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'] in dv-cinder-773985-21-iscsi is: [{'id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'name': 'tempest-AttachVolumeTestJSON-997005721-router', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77'}], 'enable_snat': True}, 'gw_port_id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:23Z', 'revision_number': 4, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'gw_port': {'id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ad:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'fe9dfbe9-83a8-472c-b3a3-9537d424939b', 'name': '', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'mac_address': 'fa:16:3e:dd:46:e7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:19Z', 'updated_at': '2022-02-08T18:12:32Z', 'revision_number': 4, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'subnets': [{'id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:12:35.260691 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-edd3b8bd-7599-4ce1-8351-9a497fe3b7cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (fe9dfbe9-83a8-472c-b3a3-9537d424939b), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:35.261205 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fd4e2aa6-cc38-4149-9312-39f257936ca6 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:35.266446 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-fd4e2aa6-cc38-4149-9312-39f257936ca6 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.9730246 Feb 08 18:12:35.291172 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 35734) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:35.323325 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-c30822f0-9c4f-4ba9-8efb-186b577d350c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Request body: {'floatingip': {'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:35.338970 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_common [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-fd9c503f-91c7-4aa0-a170-9fc634b0c31b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Allocated IP 172.20.0.3 (f089911e-72de-4ff6-880b-ac3dd7927165/0af67967-364e-4325-b04f-b7e157c3c3d4/062ed5c0-df28-461b-87fe-826944e42c54) {{(pid=102560) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:12:35.408794 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c10296ae-4c74-492f-9b8f-a7b84da5c82e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for floatingip (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:35.463898 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09e963c8-3a88-470e-ac7a-2cfac9916ad0 req-b99e6957-1f63-4914-83db-e960b628311e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:35.465735 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-09e963c8-3a88-470e-ac7a-2cfac9916ad0 req-b99e6957-1f63-4914-83db-e960b628311e service neutron] 10.222.0.109 "GET /v2.0/networks?id=c6ecb925-b9a5-4524-9125-b49155fa007e HTTP/1.1" status: 200 len: 914 time: 0.6684673 Feb 08 18:12:35.509030 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] Attempting to bind port f63fc38b-d10b-4316-b77f-d1816d07ca90 on host hv-cinder-77398 for vnic_type normal with profile {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:12:35.509227 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] Attempting to bind port f63fc38b-d10b-4316-b77f-d1816d07ca90 by drivers openvswitch,hyperv on host hv-cinder-77398 at level 0 using segments [{'id': '7e36cc20-402b-47f5-9242-a15d0de4717c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'f089911e-72de-4ff6-880b-ac3dd7927165'}] {{(pid=102560) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:12:35.509967 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] Attempting to bind port f63fc38b-d10b-4316-b77f-d1816d07ca90 on network f089911e-72de-4ff6-880b-ac3dd7927165 {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:12:35.550317 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] Port f63fc38b-d10b-4316-b77f-d1816d07ca90 on network f089911e-72de-4ff6-880b-ac3dd7927165 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77398 {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Feb 08 18:12:35.550650 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] Attempting to bind port f63fc38b-d10b-4316-b77f-d1816d07ca90 on network f089911e-72de-4ff6-880b-ac3dd7927165 {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:12:35.569931 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-035d2ad0-5777-4aa1-9238-6baf6a185678 req-d234e601-610d-444c-802b-646a21eaf55a tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/security-groups?id=a70d7f73-fc20-4c96-ba3a-f48a3d3736a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.0929489 Feb 08 18:12:35.591448 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edd3b8bd-7599-4ce1-8351-9a497fe3b7cf None None] Pushing event updated for resources: {'Port': ['ID=fe9dfbe9-83a8-472c-b3a3-9537d424939b,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:35.625241 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] Checking agent: {'id': '045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77398', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'started_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 12, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:12:35.625733 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] Checking segment: {'id': '7e36cc20-402b-47f5-9242-a15d0de4717c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'f089911e-72de-4ff6-880b-ac3dd7927165'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102560) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:12:35.633784 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] Bound using segment: {'id': '7e36cc20-402b-47f5-9242-a15d0de4717c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'f089911e-72de-4ff6-880b-ac3dd7927165'} {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:12:35.635498 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] Bound port: f63fc38b-d10b-4316-b77f-d1816d07ca90, host: hv-cinder-77398, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7e36cc20-402b-47f5-9242-a15d0de4717c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'f089911e-72de-4ff6-880b-ac3dd7927165'}}] {{(pid=102560) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:12:35.638182 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (f63fc38b-d10b-4316-b77f-d1816d07ca90), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:35.691930 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] Pushing event updated for resources: {'Port': ['ID=f63fc38b-d10b-4316-b77f-d1816d07ca90,revision_number=2']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:35.731109 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device fe9dfbe9-83a8-472c-b3a3-9537d424939b up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:12:35.881793 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c30822f0-9c4f-4ba9-8efb-186b577d350c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for floatingip (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:35.975237 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] For port f63fc38b-d10b-4316-b77f-d1816d07ca90, host hv-cinder-77398, cleared binding levels {{(pid=102560) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:12:35.978555 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port fe9dfbe9-83a8-472c-b3a3-9537d424939b triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:35.979210 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (fe9dfbe9-83a8-472c-b3a3-9537d424939b), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:36.001314 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-09e963c8-3a88-470e-ac7a-2cfac9916ad0 req-cb5dbb96-94d7-41b8-81b7-1b80e9752abf service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=02c57200-9a7e-48d7-947f-7ed959af8662 HTTP/1.1" status: 200 len: 217 time: 0.1511192 Feb 08 18:12:36.099422 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-fcb213e6-b74b-43ea-81d5-63f214bbd665 req-eccff158-cacc-4236-bafa-1a03f5987990 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 210 time: 0.2109060 Feb 08 18:12:36.122387 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] For port f63fc38b-d10b-4316-b77f-d1816d07ca90, host hv-cinder-77398, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=f63fc38b-d10b-4316-b77f-d1816d07ca90,segment=NetworkSegment(7e36cc20-402b-47f5-9242-a15d0de4717c),segment_id=7e36cc20-402b-47f5-9242-a15d0de4717c)] {{(pid=102560) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:12:36.275989 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (f63fc38b-d10b-4316-b77f-d1816d07ca90), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:36.406652 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09e963c8-3a88-470e-ac7a-2cfac9916ad0 req-52e042cf-7a7f-4d1e-8d9a-8ff413756a29 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:36.411354 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-09e963c8-3a88-470e-ac7a-2cfac9916ad0 req-52e042cf-7a7f-4d1e-8d9a-8ff413756a29 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=bb9e2714-8d92-49d4-a88e-0ba6d48e2ad3 HTTP/1.1" status: 200 len: 852 time: 0.1741557 Feb 08 18:12:36.433134 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port fe9dfbe9-83a8-472c-b3a3-9537d424939b is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:36.495549 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-09e963c8-3a88-470e-ac7a-2cfac9916ad0 req-5606a02f-e242-456e-b2d3-9900b4841d20 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=c6ecb925-b9a5-4524-9125-b49155fa007e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0705771 Feb 08 18:12:36.523193 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:36.526947 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:36.528872 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] 10.222.0.109 "PUT /v2.0/ports/f63fc38b-d10b-4316-b77f-d1816d07ca90 HTTP/1.1" status: 200 len: 1094 time: 4.6827207 Feb 08 18:12:36.531382 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c30822f0-9c4f-4ba9-8efb-186b577d350c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:36.539947 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3eb2132b-01b1-4916-84eb-81ab88bcfc6d', 'tag': 'f63fc38b-d10b-4316-b77f-d1816d07ca90'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:12:36.591602 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c10296ae-4c74-492f-9b8f-a7b84da5c82e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:36.841695 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 35776) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:36.864508 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [None req-c10296ae-4c74-492f-9b8f-a7b84da5c82e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Allocated IP 172.27.1.172 (77055816-7c88-403d-8f8a-9be2c1faa10d/18547c52-7b23-42cd-bb53-214663ed102b/b74985b8-8fa2-411c-b4e8-fb2dcf0abb7b) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:12:36.870251 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-4cc266e6-dc15-4bf0-a30c-624ff8dc2395 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1866582682-network', 'tenant_id': '9864def12f7141c481b97b022905c17c'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:36.871485 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-09e963c8-3a88-470e-ac7a-2cfac9916ad0 req-59dc9892-6399-4bea-b78b-0282f0f0ef7d service neutron] 10.222.0.109 "GET /v2.0/networks/c6ecb925-b9a5-4524-9125-b49155fa007e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3625596 Feb 08 18:12:36.992734 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe716af3-8adb-4812-9b2b-666b51ec6bca service neutron] Pushing event updated for resources: {'Port': ['ID=f63fc38b-d10b-4316-b77f-d1816d07ca90,revision_number=3']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:37.082320 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c840385f-cb50-4c76-98f9-0499105ad0ac" -d '{"events": [{"name": "network-changed", "server_uuid": "3eb2132b-01b1-4916-84eb-81ab88bcfc6d", "tag": "f63fc38b-d10b-4316-b77f-d1816d07ca90"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:12:37.144485 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c10296ae-4c74-492f-9b8f-a7b84da5c82e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for port (b74985b8-8fa2-411c-b4e8-fb2dcf0abb7b), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:37.154720 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-fd9c503f-91c7-4aa0-a170-9fc634b0c31b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Publish callbacks [] for port (062ed5c0-df28-461b-87fe-826944e42c54), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:37.156957 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4cc266e6-dc15-4bf0-a30c-624ff8dc2395 admin admin] Made reservation on behalf of 9864def12f7141c481b97b022905c17c for: {'network': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:12:37.159376 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4cc266e6-dc15-4bf0-a30c-624ff8dc2395 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for network (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:37.184832 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4cc266e6-dc15-4bf0-a30c-624ff8dc2395 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:37.201088 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-b7246f39-4a4a-478c-8784-316a110b12f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:37.202713 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-b7246f39-4a4a-478c-8784-316a110b12f3 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=3fb51fc0e23f4c66a482d4d406197299&device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 1128 time: 0.4713807 Feb 08 18:12:37.219191 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-09e963c8-3a88-470e-ac7a-2cfac9916ad0 req-bd7fbf29-1b9d-40bf-bca3-09897cb3a64e service neutron] 10.222.0.109 "GET /v2.0/networks/c6ecb925-b9a5-4524-9125-b49155fa007e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3258197 Feb 08 18:12:37.298689 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c10296ae-4c74-492f-9b8f-a7b84da5c82e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (b74985b8-8fa2-411c-b4e8-fb2dcf0abb7b), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:37.366380 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c10296ae-4c74-492f-9b8f-a7b84da5c82e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Pushing event updated for resources: {'Port': ['ID=b74985b8-8fa2-411c-b4e8-fb2dcf0abb7b,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:37.380978 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c10296ae-4c74-492f-9b8f-a7b84da5c82e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Network 77055816-7c88-403d-8f8a-9be2c1faa10d is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:12:37.384070 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-c10296ae-4c74-492f-9b8f-a7b84da5c82e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:37.389356 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c10296ae-4c74-492f-9b8f-a7b84da5c82e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:12:37.405551 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [None req-c30822f0-9c4f-4ba9-8efb-186b577d350c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Allocated IP 172.27.1.121 (77055816-7c88-403d-8f8a-9be2c1faa10d/18547c52-7b23-42cd-bb53-214663ed102b/bc50087f-d187-4c22-8863-0b6b8ed2d365) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:12:37.558148 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c10296ae-4c74-492f-9b8f-a7b84da5c82e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for floatingip (693198c9-5ae8-4773-8f2e-6a69445aaeef), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:37.558866 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device fe9dfbe9-83a8-472c-b3a3-9537d424939b up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:12:37.656470 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port fe9dfbe9-83a8-472c-b3a3-9537d424939b triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:37.656835 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (fe9dfbe9-83a8-472c-b3a3-9537d424939b), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:37.716631 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:12:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-15fa673a-cc6a-4803-8382-08d8fbd2acd2 x-openstack-request-id: req-15fa673a-cc6a-4803-8382-08d8fbd2acd2 {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:12:37.717258 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3eb2132b-01b1-4916-84eb-81ab88bcfc6d", "tag": "f63fc38b-d10b-4316-b77f-d1816d07ca90", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:12:37.717258 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-15fa673a-cc6a-4803-8382-08d8fbd2acd2 {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:12:37.717659 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3eb2132b-01b1-4916-84eb-81ab88bcfc6d', 'tag': 'f63fc38b-d10b-4316-b77f-d1816d07ca90', 'status': 'completed', 'code': 200} Feb 08 18:12:37.721573 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c10296ae-4c74-492f-9b8f-a7b84da5c82e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (b74985b8-8fa2-411c-b4e8-fb2dcf0abb7b), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:37.725709 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0ab879e-f266-41d3-a970-91c83179c11f req-4324034e-d44d-4a4b-a998-4a6deaf1cb49 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:37.731293 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e0ab879e-f266-41d3-a970-91c83179c11f req-4324034e-d44d-4a4b-a998-4a6deaf1cb49 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 943 time: 0.8906145 Feb 08 18:12:37.731554 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-261bccf1-3393-4ced-8427-ebe78b5b8554 req-c4b68a15-38fa-41d7-a457-d7699c9e4196 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 210 time: 0.0582976 Feb 08 18:12:37.737464 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-3ee06b38-6357-48e8-b4fd-7b785951800e service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=f63fc38b-d10b-4316-b77f-d1816d07ca90 HTTP/1.1" status: 200 len: 217 time: 0.5241046 Feb 08 18:12:37.752936 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c30822f0-9c4f-4ba9-8efb-186b577d350c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for port (bc50087f-d187-4c22-8863-0b6b8ed2d365), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:37.801030 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-fd9c503f-91c7-4aa0-a170-9fc634b0c31b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (062ed5c0-df28-461b-87fe-826944e42c54), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:37.807634 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port fe9dfbe9-83a8-472c-b3a3-9537d424939b is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:37.866148 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e0ab879e-f266-41d3-a970-91c83179c11f req-4181c813-06cd-49d6-b161-3aad1f6d58c6 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/security-groups?id=a70d7f73-fc20-4c96-ba3a-f48a3d3736a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1257892 Feb 08 18:12:37.876673 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c30822f0-9c4f-4ba9-8efb-186b577d350c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (bc50087f-d187-4c22-8863-0b6b8ed2d365), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:37.894920 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-fd9c503f-91c7-4aa0-a170-9fc634b0c31b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Network f089911e-72de-4ff6-880b-ac3dd7927165 is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:12:37.903555 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-fd9c503f-91c7-4aa0-a170-9fc634b0c31b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:37.909154 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-fd9c503f-91c7-4aa0-a170-9fc634b0c31b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Received port after_create {{(pid=102560) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:12:37.914254 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-fd9c503f-91c7-4aa0-a170-9fc634b0c31b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:37.914945 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-fd9c503f-91c7-4aa0-a170-9fc634b0c31b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:37.919249 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd9c503f-91c7-4aa0-a170-9fc634b0c31b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Pushing event updated for resources: {'Port': ['ID=062ed5c0-df28-461b-87fe-826944e42c54,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:37.928746 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 35814) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:37.955977 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-fd9c503f-91c7-4aa0-a170-9fc634b0c31b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.109 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.8218307 Feb 08 18:12:37.966744 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4cc266e6-dc15-4bf0-a30c-624ff8dc2395 admin admin] Publish callbacks [] for security_group (ce70a01f-0a1d-499d-83e1-9b1da7be129f), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:37.971608 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4cc266e6-dc15-4bf0-a30c-624ff8dc2395 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (ce70a01f-0a1d-499d-83e1-9b1da7be129f), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:37.979866 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c30822f0-9c4f-4ba9-8efb-186b577d350c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Network 77055816-7c88-403d-8f8a-9be2c1faa10d is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:12:37.994014 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-c30822f0-9c4f-4ba9-8efb-186b577d350c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:38.004417 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c10296ae-4c74-492f-9b8f-a7b84da5c82e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for port (b74985b8-8fa2-411c-b4e8-fb2dcf0abb7b), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:38.008310 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c30822f0-9c4f-4ba9-8efb-186b577d350c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:12:38.008469 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4cc266e6-dc15-4bf0-a30c-624ff8dc2395 admin admin] vlan segment allocate from pool success with {'vlan_id': 1068, 'physical_network': 'physnet1'} {{(pid=102560) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Feb 08 18:12:38.016947 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c10296ae-4c74-492f-9b8f-a7b84da5c82e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (b74985b8-8fa2-411c-b4e8-fb2dcf0abb7b), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:38.019130 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cc266e6-dc15-4bf0-a30c-624ff8dc2395 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ce70a01f-0a1d-499d-83e1-9b1da7be129f,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:38.021185 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c30822f0-9c4f-4ba9-8efb-186b577d350c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Pushing event updated for resources: {'Port': ['ID=bc50087f-d187-4c22-8863-0b6b8ed2d365,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:38.034163 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4cc266e6-dc15-4bf0-a30c-624ff8dc2395 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (7430dc22-0c92-48f0-988b-fb8d14520888), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:38.034512 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.segments_db [None req-4cc266e6-dc15-4bf0-a30c-624ff8dc2395 admin admin] Added segment 7430dc22-0c92-48f0-988b-fb8d14520888 of type vlan for network 323515f2-988e-49dd-9abc-a81ed116b9e3 Feb 08 18:12:38.085046 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-dd680782-6704-4583-b984-b205faf8e7db admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:38.090305 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c10296ae-4c74-492f-9b8f-a7b84da5c82e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-560746'] for floatingip (693198c9-5ae8-4773-8f2e-6a69445aaeef), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:38.106142 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4cc266e6-dc15-4bf0-a30c-624ff8dc2395 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8770558521384'] for network (323515f2-988e-49dd-9abc-a81ed116b9e3), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:38.107766 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c10296ae-4c74-492f-9b8f-a7b84da5c82e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Pushing event updated for resources: {'Port': ['ID=b74985b8-8fa2-411c-b4e8-fb2dcf0abb7b,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:38.115534 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c30822f0-9c4f-4ba9-8efb-186b577d350c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for floatingip (6ff4a76f-ba78-4441-b8c0-8ae1abf97277), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:38.123845 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c10296ae-4c74-492f-9b8f-a7b84da5c82e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for floatingip (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:38.131425 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-c10296ae-4c74-492f-9b8f-a7b84da5c82e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 2.9524357 Feb 08 18:12:38.152320 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4cc266e6-dc15-4bf0-a30c-624ff8dc2395 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for network (323515f2-988e-49dd-9abc-a81ed116b9e3), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:38.153424 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4cc266e6-dc15-4bf0-a30c-624ff8dc2395 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:38.154036 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4cc266e6-dc15-4bf0-a30c-624ff8dc2395 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:38.163795 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c30822f0-9c4f-4ba9-8efb-186b577d350c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (bc50087f-d187-4c22-8863-0b6b8ed2d365), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:38.233430 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-4cc266e6-dc15-4bf0-a30c-624ff8dc2395 admin admin] 10.222.0.118 "POST /v2.0/networks HTTP/1.1" status: 201 len: 899 time: 1.3699417 Feb 08 18:12:38.246514 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 35822) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:38.268080 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-e579e2bd-2a52-47d1-9b2c-1dcb1a65c52a admin admin] Request body: {'subnet': {'network_id': '323515f2-988e-49dd-9abc-a81ed116b9e3', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1866582682-subnet', 'tenant_id': '9864def12f7141c481b97b022905c17c', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:38.271007 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cc266e6-dc15-4bf0-a30c-624ff8dc2395 admin admin] Pushing event updated for resources: {'Network': ['ID=323515f2-988e-49dd-9abc-a81ed116b9e3,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:38.290842 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-dd680782-6704-4583-b984-b205faf8e7db admin admin] Publish callbacks [] for security_group (d630e55e-1749-498c-8a71-94ab1619278e), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:38.299978 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-dd680782-6704-4583-b984-b205faf8e7db admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (d630e55e-1749-498c-8a71-94ab1619278e), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:38.302478 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Network 323515f2-988e-49dd-9abc-a81ed116b9e3 details requested by agent ovs-agent-dv-cinder-773985-21-iscsi with host dv-cinder-773985-21-iscsi {{(pid=102561) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Feb 08 18:12:38.313665 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e579e2bd-2a52-47d1-9b2c-1dcb1a65c52a admin admin] Made reservation on behalf of 9864def12f7141c481b97b022905c17c for: {'subnet': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:12:38.315995 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e579e2bd-2a52-47d1-9b2c-1dcb1a65c52a admin admin] Publish callbacks [] for subnet (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:38.375841 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c30822f0-9c4f-4ba9-8efb-186b577d350c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for port (bc50087f-d187-4c22-8863-0b6b8ed2d365), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:38.394116 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c30822f0-9c4f-4ba9-8efb-186b577d350c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (bc50087f-d187-4c22-8863-0b6b8ed2d365), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:38.399847 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-dd680782-6704-4583-b984-b205faf8e7db admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=14ab8b7f4ac34a639eedf82ea9a15a9a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4682539 Feb 08 18:12:38.400652 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd680782-6704-4583-b984-b205faf8e7db admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d630e55e-1749-498c-8a71-94ab1619278e,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:38.404846 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 35838) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:38.468684 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c30822f0-9c4f-4ba9-8efb-186b577d350c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-560746'] for floatingip (6ff4a76f-ba78-4441-b8c0-8ae1abf97277), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:38.498508 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-cb3d4c03-c71b-4867-b58a-f4ae261fa089 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?name=tempest-securitygroup--1480792638&fields=id&tenant_id=357dab3d3db74ef9a8ee50fdd8a8bdcd HTTP/1.1" status: 200 len: 267 time: 0.1570935 Feb 08 18:12:38.506904 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0b27e15b-eb9d-46cc-b326-45bcbc44b031 admin admin] Publish callbacks [] for security_group (d630e55e-1749-498c-8a71-94ab1619278e), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:38.514469 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c30822f0-9c4f-4ba9-8efb-186b577d350c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Pushing event updated for resources: {'Port': ['ID=bc50087f-d187-4c22-8863-0b6b8ed2d365,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:38.531677 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c30822f0-9c4f-4ba9-8efb-186b577d350c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for floatingip (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:38.533039 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-c30822f0-9c4f-4ba9-8efb-186b577d350c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 3.2381978 Feb 08 18:12:38.566520 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0b27e15b-eb9d-46cc-b326-45bcbc44b031 admin admin] Publish callbacks [] for security_group (d630e55e-1749-498c-8a71-94ab1619278e), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:38.634696 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-6f7f3c24-f0d9-47d6-b3ec-6d87b0bf0dbd tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:38.643986 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-6f7f3c24-f0d9-47d6-b3ec-6d87b0bf0dbd tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/networks?id=7a854399-3ce6-42bd-bfc4-061132ecb9c2 HTTP/1.1" status: 200 len: 816 time: 0.1443560 Feb 08 18:12:38.666656 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e579e2bd-2a52-47d1-9b2c-1dcb1a65c52a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for subnet (b755255e-fdfa-4a0a-90bd-4d7685ee12a1), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:38.695089 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-23870d54-634a-46ae-95ca-dbe5943264f0 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/quotas/357dab3d3db74ef9a8ee50fdd8a8bdcd HTTP/1.1" status: 200 len: 375 time: 0.0480261 Feb 08 18:12:38.700858 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0b27e15b-eb9d-46cc-b326-45bcbc44b031 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (d630e55e-1749-498c-8a71-94ab1619278e), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:38.703761 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0b27e15b-eb9d-46cc-b326-45bcbc44b031 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:38.710862 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-0b27e15b-eb9d-46cc-b326-45bcbc44b031 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/d630e55e-1749-498c-8a71-94ab1619278e HTTP/1.1" status: 204 len: 168 time: 0.3048468 Feb 08 18:12:38.786321 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b27e15b-eb9d-46cc-b326-45bcbc44b031 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d630e55e-1749-498c-8a71-94ab1619278e,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:38.788046 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-39bcd3a1-9437-4edc-b1dc-302888770a65 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?tenant_id=357dab3d3db74ef9a8ee50fdd8a8bdcd&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0915844 Feb 08 18:12:38.841502 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e579e2bd-2a52-47d1-9b2c-1dcb1a65c52a admin admin] Pushing event updated for resources: {'Subnet': ['ID=b755255e-fdfa-4a0a-90bd-4d7685ee12a1,revision_number=0']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:38.875849 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e579e2bd-2a52-47d1-9b2c-1dcb1a65c52a admin admin] Checking segment: {'id': '7430dc22-0c92-48f0-988b-fb8d14520888', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1068, 'network_id': '323515f2-988e-49dd-9abc-a81ed116b9e3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102560) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:12:38.876228 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e579e2bd-2a52-47d1-9b2c-1dcb1a65c52a admin admin] Network hostable DHCP agents. Network: 323515f2-988e-49dd-9abc-a81ed116b9e3, hostable agents: ['006b5388-ac7d-4794-a124-14bb8e5d8fec'], hosted agents: [] {{(pid=102560) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Feb 08 18:12:38.930365 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-69585ed1-1e19-4a9d-8a3f-6b828f33e658 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?name=tempest-securitygroup--1412299109&fields=id&tenant_id=630172c388404c75bda3d0ba2d9d5834 HTTP/1.1" status: 200 len: 267 time: 0.1169276 Feb 08 18:12:38.939114 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-574c2ad8-cb66-42b9-b6b7-1e7f20fc2747 service neutron] 10.222.0.118 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1238699 Feb 08 18:12:38.997489 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e579e2bd-2a52-47d1-9b2c-1dcb1a65c52a admin admin] Network 323515f2-988e-49dd-9abc-a81ed116b9e3 is scheduled to be hosted by DHCP agent 006b5388-ac7d-4794-a124-14bb8e5d8fec with binding_index 1 {{(pid=102560) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Feb 08 18:12:39.013012 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-e579e2bd-2a52-47d1-9b2c-1dcb1a65c52a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773985-21-iscsi, 323515f2-988e-49dd-9abc-a81ed116b9e3) {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:39.024834 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d750ff61-e6e1-408b-986f-dd96a8313366 None None] Network 323515f2-988e-49dd-9abc-a81ed116b9e3 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:12:39.032562 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e579e2bd-2a52-47d1-9b2c-1dcb1a65c52a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:39.033259 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e579e2bd-2a52-47d1-9b2c-1dcb1a65c52a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:39.090814 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-e579e2bd-2a52-47d1-9b2c-1dcb1a65c52a admin admin] 10.222.0.118 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.8382068 Feb 08 18:12:39.109306 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-e6405e6e-c3ed-4f46-a7ec-f654f038bbf2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:39.112781 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-e6405e6e-c3ed-4f46-a7ec-f654f038bbf2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/networks?id=e430084e-9b28-426f-9937-61346814b135 HTTP/1.1" status: 200 len: 810 time: 0.1805515 Feb 08 18:12:39.123114 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-38f455f9-c9e1-42c5-91ce-5698be6aa9c3 service neutron] 10.222.0.118 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1743643 Feb 08 18:12:39.140374 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-8874276b-a229-4f2b-86d2-9d8f9a6ddd52 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/quotas/630172c388404c75bda3d0ba2d9d5834 HTTP/1.1" status: 200 len: 375 time: 0.0228033 Feb 08 18:12:39.143108 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ad699717-9ee4-4578-a430-bba587237c45 None None] Network 323515f2-988e-49dd-9abc-a81ed116b9e3 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:12:39.154201 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 35876) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:39.174587 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-812cf465-f069-4a3e-888e-fb57113eac20 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:39.227182 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-56c32414-0a27-4028-ab61-793d0f9ab827 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?tenant_id=630172c388404c75bda3d0ba2d9d5834&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0794935 Feb 08 18:12:39.250861 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 35878) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:39.328080 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_v2 [None req-09a4693f-d2e1-40ee-b734-657d6cb887c4 admin admin] Deleting subnet a58df055-0c8a-41e0-888e-ae6d4ec79821 {{(pid=102559) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Feb 08 18:12:39.331223 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-812cf465-f069-4a3e-888e-fb57113eac20 admin admin] Publish callbacks [] for security_group (ded6c443-9be2-4b46-9451-53cb6af8b05e), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:39.333793 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-09a4693f-d2e1-40ee-b734-657d6cb887c4 admin admin] Publish callbacks [] for subnet (a58df055-0c8a-41e0-888e-ae6d4ec79821), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:39.354063 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-812cf465-f069-4a3e-888e-fb57113eac20 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (ded6c443-9be2-4b46-9451-53cb6af8b05e), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:39.359033 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-2da9d5e6-b523-4bd4-911a-a8bf513f6f3b service neutron] 10.222.0.118 "GET /v2.0/networks/e430084e-9b28-426f-9937-61346814b135?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1158893 Feb 08 18:12:39.435563 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-09a4693f-d2e1-40ee-b734-657d6cb887c4 admin admin] Publish callbacks [] for subnet (a58df055-0c8a-41e0-888e-ae6d4ec79821), precommit_delete_associations {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:39.443315 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-812cf465-f069-4a3e-888e-fb57113eac20 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=6ff6bf3ccec949ea80be5d08108a00bd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2856019 Feb 08 18:12:39.444046 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 35888) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:39.454292 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-812cf465-f069-4a3e-888e-fb57113eac20 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ded6c443-9be2-4b46-9451-53cb6af8b05e,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:39.457762 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-09a4693f-d2e1-40ee-b734-657d6cb887c4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1801023'] for subnet (a58df055-0c8a-41e0-888e-ae6d4ec79821), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:39.464410 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-653538ec-3720-496a-9e05-5a758f018346 service neutron] 10.222.0.118 "GET /v2.0/networks/e430084e-9b28-426f-9937-61346814b135?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0992606 Feb 08 18:12:39.505718 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bdb19ff-d76b-4151-b354-11c5b458cc3f req-12ed1163-eaf9-4ad1-802c-93c8065d0a10 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:39.507277 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7bdb19ff-d76b-4151-b354-11c5b458cc3f req-12ed1163-eaf9-4ad1-802c-93c8065d0a10 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 931 time: 0.1473074 Feb 08 18:12:39.515567 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-59d13214-373d-4010-b975-c4bd5e3b672f admin admin] Publish callbacks [] for security_group (ded6c443-9be2-4b46-9451-53cb6af8b05e), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:39.541826 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-59d13214-373d-4010-b975-c4bd5e3b672f admin admin] Publish callbacks [] for security_group (ded6c443-9be2-4b46-9451-53cb6af8b05e), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:39.571289 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7bdb19ff-d76b-4151-b354-11c5b458cc3f req-2a6549ed-a227-40c4-8ea1-2115714e5c08 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0513759 Feb 08 18:12:39.573781 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-09a4693f-d2e1-40ee-b734-657d6cb887c4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1801156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for subnet (a58df055-0c8a-41e0-888e-ae6d4ec79821), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:39.613049 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-59d13214-373d-4010-b975-c4bd5e3b672f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (ded6c443-9be2-4b46-9451-53cb6af8b05e), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:39.616570 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-59d13214-373d-4010-b975-c4bd5e3b672f admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:39.617759 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09a4693f-d2e1-40ee-b734-657d6cb887c4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a58df055-0c8a-41e0-888e-ae6d4ec79821,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:39.626817 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-59d13214-373d-4010-b975-c4bd5e3b672f admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/ded6c443-9be2-4b46-9451-53cb6af8b05e HTTP/1.1" status: 204 len: 168 time: 0.1641996 Feb 08 18:12:39.636768 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59d13214-373d-4010-b975-c4bd5e3b672f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ded6c443-9be2-4b46-9451-53cb6af8b05e,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:39.677555 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-09a4693f-d2e1-40ee-b734-657d6cb887c4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:39.687859 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 35896) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:39.704345 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-09a4693f-d2e1-40ee-b734-657d6cb887c4 admin admin] 10.222.0.118 "DELETE /v2.0/subnets/a58df055-0c8a-41e0-888e-ae6d4ec79821 HTTP/1.1" status: 204 len: 168 time: 0.4470265 Feb 08 18:12:39.793381 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98168893-6704-4639-8cba-5ada932a6a99 req-59459b19-96c9-4620-8020-d1d84d3b4fee tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:39.797460 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-98168893-6704-4639-8cba-5ada932a6a99 req-59459b19-96c9-4620-8020-d1d84d3b4fee tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 943 time: 0.1348863 Feb 08 18:12:39.871678 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8fe88c11-3003-463f-8695-045faa250059 req-5951da50-a8cc-403d-8311-c8de04185060 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 210 time: 0.0770218 Feb 08 18:12:39.908980 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-98168893-6704-4639-8cba-5ada932a6a99 req-9f85b3dd-52a4-4d8b-a567-8b3de2f3a9c0 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/security-groups?id=a70d7f73-fc20-4c96-ba3a-f48a3d3736a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1036119 Feb 08 18:12:39.910102 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1860329'] for network (ac3916d4-9872-41ed-bd38-bd02d3afee04), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:39.979522 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:12:40.010096 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0840e64e-72b9-43cd-b576-3aa0d0d87356 req-a99f3604-7694-45ff-8d3c-9b3238e67a82 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 210 time: 0.0638137 Feb 08 18:12:40.038516 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1721768', 'neutron.services.segments.db._delete_segments_for_network-8770558865089'] for network (ac3916d4-9872-41ed-bd38-bd02d3afee04), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:40.068369 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=102560) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:12:40.068721 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102560) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:12:40.069467 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102560) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:12:40.069800 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] Subscribe: > port after_create 55550000 {{(pid=102560) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:12:40.070142 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] Subscribe: > port after_delete 55550000 {{(pid=102560) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:12:40.070471 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] Subscribe: > port after_update 55550000 {{(pid=102560) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:12:40.070822 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=102560) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:12:40.071156 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102560) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:12:40.071487 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102560) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:12:40.071806 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=102560) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:12:40.237569 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102560) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:12:40.238334 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102560) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:12:40.239082 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=102560) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:12:40.239596 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=102560) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:12:40.240107 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ac3916d4-9872-41ed-bd38-bd02d3afee04']}} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:40.260899 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] Request body: {'port': {'device_id': 'eb0ad33a-c04e-4d37-ab65-6b2bd025791d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77398'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:40.328420 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fb6acaa2-48ff-4126-a574-8dbc61d891f2') {'for_net_delete': True} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:40.328768 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fb6acaa2-48ff-4126-a574-8dbc61d891f2') {} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:40.355033 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8770558866122', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-64533840'] for segment (fb6acaa2-48ff-4126-a574-8dbc61d891f2), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:40.415432 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (fb6acaa2-48ff-4126-a574-8dbc61d891f2), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:40.419625 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-d2c9a210-a312-441d-9535-bddcf5fbfe33 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:40.421404 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-d2c9a210-a312-441d-9535-bddcf5fbfe33 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=0af67967-364e-4325-b04f-b7e157c3c3d4 HTTP/1.1" status: 200 len: 859 time: 0.1652570 Feb 08 18:12:40.439666 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (062ed5c0-df28-461b-87fe-826944e42c54), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:40.442230 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] Releasing vlan 1067 on physical network physnet1 to pool {{(pid=102560) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Feb 08 18:12:40.442806 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-64531704'] for segment (fb6acaa2-48ff-4126-a574-8dbc61d891f2), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: from cryptography.utils import int_from_bytes Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: from cryptography.utils import int_from_bytes Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: Traceback (most recent call last): Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: timer() Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: cb(*args, **kw) Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: return func(*args, **kwargs) Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: self._notify() Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: self.callback(batched_events) Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: event.method(event) Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: aggregate_uuid = self.p_client.list_aggregates( Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: return f(self, *a, **k) Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: return self._get(url).json() Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: return self._client.get(url, endpoint_filter=self._ks_filter, Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: return self.request(url, 'GET', **kwargs) Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: base_url = self.get_endpoint(auth, allow=allow, Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 08 18:12:40.494437 dv-cinder-773985-21-iscsi neutron-server[102560]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 08 18:12:40.572070 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-6fe758c0-ec42-436f-873d-d50aa85cc143 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=f089911e-72de-4ff6-880b-ac3dd7927165&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1435716 Feb 08 18:12:40.676059 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1721777', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-560760'] for network (ac3916d4-9872-41ed-bd38-bd02d3afee04), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:40.702407 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:40.707067 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] 10.222.0.118 "DELETE /v2.0/networks/ac3916d4-9872-41ed-bd38-bd02d3afee04 HTTP/1.1" status: 204 len: 168 time: 1.0178077 Feb 08 18:12:40.712210 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 35958) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:40.766797 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ef42581-9e17-4fa1-803c-b6ca44074e6e req-d499b49a-b91b-4cf3-a3e9-e5febd55aa88 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:40.769537 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1ef42581-9e17-4fa1-803c-b6ca44074e6e req-d499b49a-b91b-4cf3-a3e9-e5febd55aa88 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 931 time: 0.1058214 Feb 08 18:12:40.846702 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6dbe7c7-d61f-49ff-b4b2-9ad968043759 admin admin] Pushing event deleted for resources: {'Network': ['ID=ac3916d4-9872-41ed-bd38-bd02d3afee04,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:40.903285 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1ef42581-9e17-4fa1-803c-b6ca44074e6e req-62346eb8-10fd-4dfb-8723-375dd09f51e2 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1174083 Feb 08 18:12:40.938142 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-a0286e5d-bb10-434d-83a7-1d37682e6ab8 service neutron] 10.222.0.109 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3542354 Feb 08 18:12:41.119763 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.109', 51662) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:41.552877 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_v2 [None req-1fb9334d-5e06-4d60-b17a-2f194f062ae5 admin admin] Deleting subnet b755255e-fdfa-4a0a-90bd-4d7685ee12a1 {{(pid=102560) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Feb 08 18:12:41.559487 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 35998) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:41.574684 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1fb9334d-5e06-4d60-b17a-2f194f062ae5 admin admin] Publish callbacks [] for subnet (b755255e-fdfa-4a0a-90bd-4d7685ee12a1), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:41.592727 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d22a664d-5d66-4e38-99f0-324dadfef789 req-496d8105-0aa2-4fa9-843a-2cc26246dfa1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 210 time: 0.5681820 Feb 08 18:12:41.649717 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1fb9334d-5e06-4d60-b17a-2f194f062ae5 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-64533851'] for subnet (b755255e-fdfa-4a0a-90bd-4d7685ee12a1), precommit_delete_associations {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:41.779036 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1f2d9630-907c-4715-9fb5-9d4d791b85ec req-501aa90b-35d5-48a3-93b3-0a9fed2d9845 service neutron] 10.222.0.109 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8134062 Feb 08 18:12:41.785461 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d036d699-8a24-4525-a191-cc13ff31bcb7 req-9095b77d-2fc7-4885-a8a3-d1dfb5f646eb tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 210 time: 0.0627620 Feb 08 18:12:41.786947 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1fb9334d-5e06-4d60-b17a-2f194f062ae5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1801023'] for subnet (b755255e-fdfa-4a0a-90bd-4d7685ee12a1), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:41.833033 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-b5464f98-0610-40ff-baba-fbe760b8ea0b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:41.834593 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-b5464f98-0610-40ff-baba-fbe760b8ea0b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.109 "GET /v2.0/networks?id=e430084e-9b28-426f-9937-61346814b135 HTTP/1.1" status: 200 len: 810 time: 0.6984701 Feb 08 18:12:41.840982 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-1e64065d-dfa6-40d8-9fc5-9bff46bc0d5c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:41.842506 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-1e64065d-dfa6-40d8-9fc5-9bff46bc0d5c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.109 "GET /v2.0/networks?id=7a854399-3ce6-42bd-bfc4-061132ecb9c2 HTTP/1.1" status: 200 len: 816 time: 0.8845685 Feb 08 18:12:41.847673 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-66b5795c-8ac1-41ac-9894-d975aaec6758 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:41.849849 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-330c9c9b-0793-40b0-a570-4eb98a9c59fb req-86b16e1b-91e6-4713-b42a-eb8ce5e039e4 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:41.851507 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-330c9c9b-0793-40b0-a570-4eb98a9c59fb req-86b16e1b-91e6-4713-b42a-eb8ce5e039e4 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 943 time: 0.7307663 Feb 08 18:12:42.006024 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 062ed5c0-df28-461b-87fe-826944e42c54 {{(pid=102560) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:12:42.018887 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-934ecee6-bf40-405e-bab0-8b07a39dc47d tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.109 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=630172c388404c75bda3d0ba2d9d5834 HTTP/1.1" status: 200 len: 380 time: 0.1644497 Feb 08 18:12:42.022280 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-330c9c9b-0793-40b0-a570-4eb98a9c59fb req-79169b1d-e16b-42f1-885c-fb6067d04d45 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/security-groups?id=a70d7f73-fc20-4c96-ba3a-f48a3d3736a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1564567 Feb 08 18:12:42.032965 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] Publish callbacks [] for port (062ed5c0-df28-461b-87fe-826944e42c54), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:42.038223 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1fb9334d-5e06-4d60-b17a-2f194f062ae5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1801156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-64531538', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-64597460'] for subnet (b755255e-fdfa-4a0a-90bd-4d7685ee12a1), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:42.038424 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-773d9b2a-748a-4ddd-971f-49f67afa0f06 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.109 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=357dab3d3db74ef9a8ee50fdd8a8bdcd HTTP/1.1" status: 200 len: 380 time: 0.1747062 Feb 08 18:12:42.042492 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c840385f-cb50-4c76-98f9-0499105ad0ac req-cc09bf4d-0289-402e-bfdc-735cf5dabf50 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:42.044166 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c840385f-cb50-4c76-98f9-0499105ad0ac req-cc09bf4d-0289-402e-bfdc-735cf5dabf50 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=3fb51fc0e23f4c66a482d4d406197299&device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 1128 time: 0.1863334 Feb 08 18:12:42.048951 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-8802c8e6-6fb5-432d-b0d1-96be35be4a0b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Request body: {'port': {'device_id': 'd6973742-7d30-4603-8075-2a02f14da9ea', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'admin_state_up': True, 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'security_groups': ['c2d6b890-d2af-425a-a791-9710f0f7e35e']}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:42.060135 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-10a94b9d-ff3b-4777-b622-9e42fe74a485 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Request body: {'port': {'device_id': '75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'admin_state_up': True, 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'security_groups': ['996a6093-6720-4c3e-aa49-14509ff61ad7']}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:42.114096 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fb9334d-5e06-4d60-b17a-2f194f062ae5 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b755255e-fdfa-4a0a-90bd-4d7685ee12a1,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:42.118969 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1fb9334d-5e06-4d60-b17a-2f194f062ae5 admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:42.124816 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-1fb9334d-5e06-4d60-b17a-2f194f062ae5 admin admin] 10.222.0.118 "DELETE /v2.0/subnets/b755255e-fdfa-4a0a-90bd-4d7685ee12a1 HTTP/1.1" status: 204 len: 168 time: 1.4095159 Feb 08 18:12:42.129014 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 36024) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:42.141393 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.provisioning_blocks [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] Transition to ACTIVE for port object 062ed5c0-df28-461b-87fe-826944e42c54 will not be triggered until provisioned by entity L2. {{(pid=102560) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Feb 08 18:12:42.190287 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-64531588'] for port (062ed5c0-df28-461b-87fe-826944e42c54), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:42.276537 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-10a94b9d-ff3b-4777-b622-9e42fe74a485 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Made reservation on behalf of 357dab3d3db74ef9a8ee50fdd8a8bdcd for: {'port': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:12:42.280074 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-10a94b9d-ff3b-4777-b622-9e42fe74a485 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:42.302258 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-66b5795c-8ac1-41ac-9894-d975aaec6758 admin admin] Publish callbacks [] for security_group (8a2b4a75-0b1c-4bae-bfe6-f0942e6a820a), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:42.311272 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-8802c8e6-6fb5-432d-b0d1-96be35be4a0b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Made reservation on behalf of 630172c388404c75bda3d0ba2d9d5834 for: {'port': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:12:42.315280 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-8802c8e6-6fb5-432d-b0d1-96be35be4a0b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:42.331160 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-66b5795c-8ac1-41ac-9894-d975aaec6758 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (8a2b4a75-0b1c-4bae-bfe6-f0942e6a820a), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:42.339520 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85be8955-d309-4de0-8800-745ec5a65011 req-8e345dfe-3245-472c-84d4-ac3936839c67 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:42.341005 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-85be8955-d309-4de0-8800-745ec5a65011 req-8e345dfe-3245-472c-84d4-ac3936839c67 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 931 time: 0.3283381 Feb 08 18:12:42.422137 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-81541e24-1d24-4279-9e39-88fc13f5d00e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1860329'] for network (323515f2-988e-49dd-9abc-a81ed116b9e3), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:42.455584 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] Pushing event updated for resources: {'Port': ['ID=062ed5c0-df28-461b-87fe-826944e42c54,revision_number=2']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:42.500341 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-66b5795c-8ac1-41ac-9894-d975aaec6758 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=d5e8646d337c488ca60ad92b082a34de&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9267704 Feb 08 18:12:42.511590 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 36034) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:42.530314 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-10a94b9d-ff3b-4777-b622-9e42fe74a485 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Allocated IP 172.20.0.3 (7a854399-3ce6-42bd-bfc4-061132ecb9c2/73de7865-d87d-4a2a-a702-160c400f145f/2f2d1cfd-91ec-450a-bfe2-52d21f9196e8) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:12:42.545234 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66b5795c-8ac1-41ac-9894-d975aaec6758 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8a2b4a75-0b1c-4bae-bfe6-f0942e6a820a,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:42.557480 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c840385f-cb50-4c76-98f9-0499105ad0ac req-f53f280e-a094-48ab-ab3f-93ffceb4a4aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:42.559208 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c840385f-cb50-4c76-98f9-0499105ad0ac req-f53f280e-a094-48ab-ab3f-93ffceb4a4aa service neutron] 10.222.0.109 "GET /v2.0/networks?id=f089911e-72de-4ff6-880b-ac3dd7927165 HTTP/1.1" status: 200 len: 921 time: 0.4940419 Feb 08 18:12:42.580976 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-8802c8e6-6fb5-432d-b0d1-96be35be4a0b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Allocated IP 172.20.0.14 (e430084e-9b28-426f-9937-61346814b135/86592955-e7d0-4e8a-9490-976e17240d7c/fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:12:42.597687 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-85be8955-d309-4de0-8800-745ec5a65011 req-236d1f1d-aa9d-47c9-a9c8-4556dede74f5 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2248006 Feb 08 18:12:42.677523 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c840385f-cb50-4c76-98f9-0499105ad0ac req-8169d3b3-dba1-415f-88cf-d52641df3117 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=f63fc38b-d10b-4316-b77f-d1816d07ca90 HTTP/1.1" status: 200 len: 217 time: 0.1077323 Feb 08 18:12:42.703871 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] Attempting to bind port 062ed5c0-df28-461b-87fe-826944e42c54 on host hv-cinder-77398 for vnic_type normal with profile {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:12:42.704504 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] Attempting to bind port 062ed5c0-df28-461b-87fe-826944e42c54 by drivers openvswitch,hyperv on host hv-cinder-77398 at level 0 using segments [{'id': '7e36cc20-402b-47f5-9242-a15d0de4717c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'f089911e-72de-4ff6-880b-ac3dd7927165'}] {{(pid=102560) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:12:42.704893 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] Attempting to bind port 062ed5c0-df28-461b-87fe-826944e42c54 on network f089911e-72de-4ff6-880b-ac3dd7927165 {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:12:42.725920 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-81541e24-1d24-4279-9e39-88fc13f5d00e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1721768', 'neutron.services.segments.db._delete_segments_for_network-8770558865089'] for network (323515f2-988e-49dd-9abc-a81ed116b9e3), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:42.736908 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] Port 062ed5c0-df28-461b-87fe-826944e42c54 on network f089911e-72de-4ff6-880b-ac3dd7927165 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77398 {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Feb 08 18:12:42.737225 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] Attempting to bind port 062ed5c0-df28-461b-87fe-826944e42c54 on network f089911e-72de-4ff6-880b-ac3dd7927165 {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:12:42.760810 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] Checking agent: {'id': '045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77398', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'started_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 12, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:12:42.761190 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] Checking segment: {'id': '7e36cc20-402b-47f5-9242-a15d0de4717c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'f089911e-72de-4ff6-880b-ac3dd7927165'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102560) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:12:42.761485 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] Bound using segment: {'id': '7e36cc20-402b-47f5-9242-a15d0de4717c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'f089911e-72de-4ff6-880b-ac3dd7927165'} {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:12:42.761919 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] Bound port: 062ed5c0-df28-461b-87fe-826944e42c54, host: hv-cinder-77398, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '7e36cc20-402b-47f5-9242-a15d0de4717c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'f089911e-72de-4ff6-880b-ac3dd7927165'}}] {{(pid=102560) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:12:42.762275 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (062ed5c0-df28-461b-87fe-826944e42c54), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:42.768129 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1bb12a31-d702-4272-bf2e-551597a77d77 admin admin] Publish callbacks [] for security_group (8a2b4a75-0b1c-4bae-bfe6-f0942e6a820a), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:42.768637 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-81541e24-1d24-4279-9e39-88fc13f5d00e admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['323515f2-988e-49dd-9abc-a81ed116b9e3']}} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:42.785953 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-81541e24-1d24-4279-9e39-88fc13f5d00e admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7430dc22-0c92-48f0-988b-fb8d14520888') {'for_net_delete': True} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:42.786250 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-81541e24-1d24-4279-9e39-88fc13f5d00e admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7430dc22-0c92-48f0-988b-fb8d14520888') {} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:42.797811 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c840385f-cb50-4c76-98f9-0499105ad0ac req-edb4c548-71da-4bc2-89d6-805089bb6489 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:42.799407 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c840385f-cb50-4c76-98f9-0499105ad0ac req-edb4c548-71da-4bc2-89d6-805089bb6489 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=0af67967-364e-4325-b04f-b7e157c3c3d4 HTTP/1.1" status: 200 len: 859 time: 0.1086268 Feb 08 18:12:42.802069 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-81541e24-1d24-4279-9e39-88fc13f5d00e admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8770558866122', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-64533840'] for segment (7430dc22-0c92-48f0-988b-fb8d14520888), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:42.816630 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-65f3ed66-1e2d-4e4c-afd1-8af943762754 req-68a98cab-b4c4-42b5-ade6-0cecc6302d2b tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 210 time: 0.0525446 Feb 08 18:12:42.857647 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c840385f-cb50-4c76-98f9-0499105ad0ac req-9838ea6b-7167-4fdb-8b6e-25efeaf71558 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=f089911e-72de-4ff6-880b-ac3dd7927165&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0483885 Feb 08 18:12:42.864870 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-81541e24-1d24-4279-9e39-88fc13f5d00e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (7430dc22-0c92-48f0-988b-fb8d14520888), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:42.913364 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-10a94b9d-ff3b-4777-b622-9e42fe74a485 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:42.916066 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-81541e24-1d24-4279-9e39-88fc13f5d00e admin admin] Releasing vlan 1068 on physical network physnet1 to pool {{(pid=102560) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Feb 08 18:12:42.916479 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-81541e24-1d24-4279-9e39-88fc13f5d00e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-64531704'] for segment (7430dc22-0c92-48f0-988b-fb8d14520888), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: Traceback (most recent call last): Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: timer() Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: cb(*args, **kw) Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: return func(*args, **kwargs) Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: self._notify() Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: self.callback(batched_events) Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: event.method(event) Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: aggregate_uuid = self.p_client.list_aggregates( Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: return f(self, *a, **k) Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: return self._get(url).json() Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: return self._client.get(url, endpoint_filter=self._ks_filter, Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: return self.request(url, 'GET', **kwargs) Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: base_url = self.get_endpoint(auth, allow=allow, Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 08 18:12:42.918147 dv-cinder-773985-21-iscsi neutron-server[102560]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 08 18:12:42.952285 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1bb12a31-d702-4272-bf2e-551597a77d77 admin admin] Publish callbacks [] for security_group (8a2b4a75-0b1c-4bae-bfe6-f0942e6a820a), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:43.008177 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-83b309c0-293f-477f-bffb-ed12ed5c7c26 req-c0f8bd56-c372-4b56-ac83-ef449a38ad57 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 210 time: 0.0746160 Feb 08 18:12:43.016725 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-10a94b9d-ff3b-4777-b622-9e42fe74a485 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:43.018246 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] For port 062ed5c0-df28-461b-87fe-826944e42c54, host hv-cinder-77398, cleared binding levels {{(pid=102560) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:12:43.043518 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-81541e24-1d24-4279-9e39-88fc13f5d00e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1721777', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-560760'] for network (323515f2-988e-49dd-9abc-a81ed116b9e3), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:43.064114 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-81541e24-1d24-4279-9e39-88fc13f5d00e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:43.071585 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-81541e24-1d24-4279-9e39-88fc13f5d00e admin admin] 10.222.0.118 "DELETE /v2.0/networks/323515f2-988e-49dd-9abc-a81ed116b9e3 HTTP/1.1" status: 204 len: 168 time: 0.9373102 Feb 08 18:12:43.074062 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] For port 062ed5c0-df28-461b-87fe-826944e42c54, host hv-cinder-77398, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=062ed5c0-df28-461b-87fe-826944e42c54,segment=NetworkSegment(7e36cc20-402b-47f5-9242-a15d0de4717c),segment_id=7e36cc20-402b-47f5-9242-a15d0de4717c)] {{(pid=102560) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:12:43.087249 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-10a94b9d-ff3b-4777-b622-9e42fe74a485 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Network 7a854399-3ce6-42bd-bfc4-061132ecb9c2 is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:12:43.094512 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-10a94b9d-ff3b-4777-b622-9e42fe74a485 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:43.102186 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81541e24-1d24-4279-9e39-88fc13f5d00e admin admin] Pushing event deleted for resources: {'Network': ['ID=323515f2-988e-49dd-9abc-a81ed116b9e3,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:43.104707 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-64531588'] for port (062ed5c0-df28-461b-87fe-826944e42c54), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:43.108744 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-10a94b9d-ff3b-4777-b622-9e42fe74a485 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:12:43.113684 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c840385f-cb50-4c76-98f9-0499105ad0ac req-4b4fcfcd-fcad-4788-8a94-9fbff61543ed service neutron] 10.222.0.109 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2451487 Feb 08 18:12:43.114946 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-10a94b9d-ff3b-4777-b622-9e42fe74a485 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:43.115580 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-10a94b9d-ff3b-4777-b622-9e42fe74a485 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:43.186958 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10a94b9d-ff3b-4777-b622-9e42fe74a485 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Pushing event updated for resources: {'Port': ['ID=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:43.202501 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:43.203111 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:43.204680 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] 10.222.0.109 "PUT /v2.0/ports/062ed5c0-df28-461b-87fe-826944e42c54 HTTP/1.1" status: 200 len: 1093 time: 2.9497826 Feb 08 18:12:43.205135 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'eb0ad33a-c04e-4d37-ab65-6b2bd025791d', 'tag': '062ed5c0-df28-461b-87fe-826944e42c54'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:12:43.207579 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1d44d369-f1f1-4fb8-9bd6-6eb110a24650" -d '{"events": [{"name": "network-changed", "server_uuid": "eb0ad33a-c04e-4d37-ab65-6b2bd025791d", "tag": "062ed5c0-df28-461b-87fe-826944e42c54"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:12:43.236550 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-10a94b9d-ff3b-4777-b622-9e42fe74a485 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.109 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1807120 Feb 08 18:12:43.262364 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] Request body: {'port': {'device_id': '75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77398'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:43.267644 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1bb12a31-d702-4272-bf2e-551597a77d77 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (8a2b4a75-0b1c-4bae-bfe6-f0942e6a820a), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:43.272031 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1bb12a31-d702-4272-bf2e-551597a77d77 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:43.275977 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1672f61d-42a7-4911-be1c-e535b12dc082 service neutron] Pushing event updated for resources: {'Port': ['ID=062ed5c0-df28-461b-87fe-826944e42c54,revision_number=3']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:43.298974 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-1bb12a31-d702-4272-bf2e-551597a77d77 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/8a2b4a75-0b1c-4bae-bfe6-f0942e6a820a HTTP/1.1" status: 204 len: 168 time: 0.7644050 Feb 08 18:12:43.310198 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-8802c8e6-6fb5-432d-b0d1-96be35be4a0b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for port (fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:43.329866 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:12:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-caa86b04-2c70-4df3-a880-e77650b456b2 x-openstack-request-id: req-caa86b04-2c70-4df3-a880-e77650b456b2 {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:12:43.330160 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "eb0ad33a-c04e-4d37-ab65-6b2bd025791d", "tag": "062ed5c0-df28-461b-87fe-826944e42c54", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:12:43.330433 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-caa86b04-2c70-4df3-a880-e77650b456b2 {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:12:43.330936 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'eb0ad33a-c04e-4d37-ab65-6b2bd025791d', 'tag': '062ed5c0-df28-461b-87fe-826944e42c54', 'status': 'completed', 'code': 200} Feb 08 18:12:43.359720 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c840385f-cb50-4c76-98f9-0499105ad0ac req-9597d45a-6ac1-43c2-ba8b-865b975216f2 service neutron] 10.222.0.109 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2197499 Feb 08 18:12:43.363567 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1bb12a31-d702-4272-bf2e-551597a77d77 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8a2b4a75-0b1c-4bae-bfe6-f0942e6a820a,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:43.377408 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-b9074ed1-6f4d-49cc-a4d6-d7ac9e98c48a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:43.379750 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-b9074ed1-6f4d-49cc-a4d6-d7ac9e98c48a service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=3fb51fc0e23f4c66a482d4d406197299&device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 1127 time: 0.1173267 Feb 08 18:12:43.410881 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a494a395-b8df-4445-9bc4-6567a1427a16 req-ca317a0a-eba3-4350-86fc-d75d6068278c tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:43.415346 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a494a395-b8df-4445-9bc4-6567a1427a16 req-ca317a0a-eba3-4350-86fc-d75d6068278c tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 943 time: 0.2720079 Feb 08 18:12:43.446713 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-b13513b6-f464-40ff-a71b-5cd2a06856bc service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=062ed5c0-df28-461b-87fe-826944e42c54 HTTP/1.1" status: 200 len: 217 time: 0.0559807 Feb 08 18:12:43.466527 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-fae54877-07a7-44a0-a774-41c0941a861d None None] Provisioning complete for port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:43.467089 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-fae54877-07a7-44a0-a774-41c0941a861d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:43.484735 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:43.497657 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-8802c8e6-6fb5-432d-b0d1-96be35be4a0b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:43.514522 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-cdc2989b-a692-4324-b7d4-69527e644fc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:43.518061 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-cdc2989b-a692-4324-b7d4-69527e644fc1 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=0af67967-364e-4325-b04f-b7e157c3c3d4 HTTP/1.1" status: 200 len: 859 time: 0.0612056 Feb 08 18:12:43.535250 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 36066) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:43.537866 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-fae54877-07a7-44a0-a774-41c0941a861d None None] Port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:12:43.564702 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-9b24b5e2-3173-4607-ab85-287968831e99 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=f089911e-72de-4ff6-880b-ac3dd7927165&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0407479 Feb 08 18:12:43.579197 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a494a395-b8df-4445-9bc4-6567a1427a16 req-fe698ba4-e25d-41f9-865c-cf8deae59bf1 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/security-groups?id=a70d7f73-fc20-4c96-ba3a-f48a3d3736a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1506567 Feb 08 18:12:43.591332 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-8802c8e6-6fb5-432d-b0d1-96be35be4a0b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Network e430084e-9b28-426f-9937-61346814b135 is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:12:43.599439 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-8802c8e6-6fb5-432d-b0d1-96be35be4a0b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:12:43.605152 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-8802c8e6-6fb5-432d-b0d1-96be35be4a0b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:12:43.610695 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-8802c8e6-6fb5-432d-b0d1-96be35be4a0b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:43.611523 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-8802c8e6-6fb5-432d-b0d1-96be35be4a0b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:43.634731 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8802c8e6-6fb5-432d-b0d1-96be35be4a0b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Pushing event updated for resources: {'Port': ['ID=fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:43.699906 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-8802c8e6-6fb5-432d-b0d1-96be35be4a0b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.109 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.6598415 Feb 08 18:12:43.707112 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-7858ee7f-6f28-4cba-9a47-97b21729c9de admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=79419e16041640a5b8905aecada9c0bd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1705575 Feb 08 18:12:43.710425 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 36072) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:43.731825 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] Request body: {'port': {'device_id': 'd6973742-7d30-4603-8075-2a02f14da9ea', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77398'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:43.789112 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-b109a023-478a-4c46-b714-b4ee6d6cfb0d service neutron] 10.222.0.109 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2153096 Feb 08 18:12:43.820735 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2649ce10-f3aa-46df-9796-125d49ee5015 req-dabc6979-6533-4dd0-a90c-835292849ec2 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:43.822162 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-2649ce10-f3aa-46df-9796-125d49ee5015 req-dabc6979-6533-4dd0-a90c-835292849ec2 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 943 time: 0.1183567 Feb 08 18:12:43.883517 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 36080) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:43.922382 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:43.924519 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-3998f28e-1b3c-4d74-91bb-409b26a3c591 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:43.947348 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-2649ce10-f3aa-46df-9796-125d49ee5015 req-6f0693a5-5bec-450e-97f5-83ea57830dd9 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1106832 Feb 08 18:12:43.967193 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-b5ada931-b326-4eb9-80ce-d6f82f37198b admin admin] Publish callbacks [] for security_group (a930213c-b78d-4de0-b692-a45ab4559fb3), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:43.998089 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ced1a4d1-c6ef-45dc-8b01-7aefacc00a93 req-f97caa03-9db6-4eda-99df-6b09abf57eea service neutron] 10.222.0.109 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1932340 Feb 08 18:12:44.084739 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-5305e104-2827-41d2-a793-f6d1a5db013f None None] Provisioning complete for port fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:44.085345 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-5305e104-2827-41d2-a793-f6d1a5db013f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:44.090507 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 02c57200-9a7e-48d7-947f-7ed959af8662 details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:12:44.100430 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d44d369-f1f1-4fb8-9bd6-6eb110a24650 req-f9100dea-0118-4f4d-8211-962976c6ecc1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:44.102182 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1d44d369-f1f1-4fb8-9bd6-6eb110a24650 req-f9100dea-0118-4f4d-8211-962976c6ecc1 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=3fb51fc0e23f4c66a482d4d406197299&device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 1127 time: 0.0526016 Feb 08 18:12:44.127499 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 {{(pid=102559) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:12:44.151419 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-b5ada931-b326-4eb9-80ce-d6f82f37198b admin admin] Publish callbacks [] for security_group (a930213c-b78d-4de0-b692-a45ab4559fb3), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:44.154192 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] Publish callbacks [] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:44.200525 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-5305e104-2827-41d2-a793-f6d1a5db013f None None] Port fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:12:44.209185 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.provisioning_blocks [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] Transition to ACTIVE for port object 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 will not be triggered until provisioned by entity L2. {{(pid=102559) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Feb 08 18:12:44.288260 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 02c57200-9a7e-48d7-947f-7ed959af8662, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=02c57200-9a7e-48d7-947f-7ed959af8662,segment=NetworkSegment(36b36f15-bf90-46bb-ac3a-109acbbc7fd3),segment_id=36b36f15-bf90-46bb-ac3a-109acbbc7fd3)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:12:44.293033 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:44.303884 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': '02c57200-9a7e-48d7-947f-7ed959af8662', 'network_id': 'c6ecb925-b9a5-4524-9125-b49155fa007e', 'port_id': '02c57200-9a7e-48d7-947f-7ed959af8662', 'mac_address': 'fa:16:3e:8e:2e:64', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1093, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bb9e2714-8d92-49d4-a88e-0ba6d48e2ad3', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:12:44.359632 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 02c57200-9a7e-48d7-947f-7ed959af8662 is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:44.359982 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (02c57200-9a7e-48d7-947f-7ed959af8662), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:44.379964 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 02c57200-9a7e-48d7-947f-7ed959af8662 {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:12:44.382008 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49e96f8b-61f7-43cb-a6d7-15d0500b558f req-f3970c8e-c79d-46c5-bc28-0b9ab769bbcb tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:44.392451 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-49e96f8b-61f7-43cb-a6d7-15d0500b558f req-f3970c8e-c79d-46c5-bc28-0b9ab769bbcb tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 931 time: 0.4179409 Feb 08 18:12:44.411661 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 02c57200-9a7e-48d7-947f-7ed959af8662, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=02c57200-9a7e-48d7-947f-7ed959af8662,segment=NetworkSegment(36b36f15-bf90-46bb-ac3a-109acbbc7fd3),segment_id=36b36f15-bf90-46bb-ac3a-109acbbc7fd3)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:12:44.419221 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (02c57200-9a7e-48d7-947f-7ed959af8662), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:44.483821 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-3998f28e-1b3c-4d74-91bb-409b26a3c591 admin admin] Publish callbacks [] for security_group (0254cda0-c913-4ae6-a861-02ba785bf0d6), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:44.509100 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-3998f28e-1b3c-4d74-91bb-409b26a3c591 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (0254cda0-c913-4ae6-a861-02ba785bf0d6), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:44.512391 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] Pushing event updated for resources: {'Port': ['ID=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:44.539676 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-645f3daf-cc14-4f3a-bf28-f9f52df95041 req-9a9b63c6-55eb-48e8-8de5-cec2885a37a4 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:44.541712 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-645f3daf-cc14-4f3a-bf28-f9f52df95041 req-9a9b63c6-55eb-48e8-8de5-cec2885a37a4 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 932 time: 0.4075348 Feb 08 18:12:44.549084 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=02c57200-9a7e-48d7-947f-7ed959af8662,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:44.569327 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d44d369-f1f1-4fb8-9bd6-6eb110a24650 req-aff7e278-67b4-4ba3-8cd6-ffc32fbccb66 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:44.571002 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1d44d369-f1f1-4fb8-9bd6-6eb110a24650 req-aff7e278-67b4-4ba3-8cd6-ffc32fbccb66 service neutron] 10.222.0.109 "GET /v2.0/networks?id=f089911e-72de-4ff6-880b-ac3dd7927165 HTTP/1.1" status: 200 len: 921 time: 0.4620512 Feb 08 18:12:44.648393 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1d44d369-f1f1-4fb8-9bd6-6eb110a24650 req-434b620a-e935-4c8e-9bf8-e5b80378da0c service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=062ed5c0-df28-461b-87fe-826944e42c54 HTTP/1.1" status: 200 len: 217 time: 0.0531805 Feb 08 18:12:44.687396 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['02c57200-9a7e-48d7-947f-7ed959af8662'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:12:44.706239 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-645f3daf-cc14-4f3a-bf28-f9f52df95041 req-12f05ddf-2e88-4325-8201-f6416ae86e5a tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1456184 Feb 08 18:12:44.745047 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-b5ada931-b326-4eb9-80ce-d6f82f37198b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (a930213c-b78d-4de0-b692-a45ab4559fb3), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:44.747896 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-b5ada931-b326-4eb9-80ce-d6f82f37198b admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:44.751827 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-b5ada931-b326-4eb9-80ce-d6f82f37198b admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/a930213c-b78d-4de0-b692-a45ab4559fb3 HTTP/1.1" status: 204 len: 168 time: 1.0318849 Feb 08 18:12:44.755759 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d44d369-f1f1-4fb8-9bd6-6eb110a24650 req-62b8feb3-7896-4d30-82a1-f73b5064c546 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:44.765354 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1d44d369-f1f1-4fb8-9bd6-6eb110a24650 req-62b8feb3-7896-4d30-82a1-f73b5064c546 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=0af67967-364e-4325-b04f-b7e157c3c3d4 HTTP/1.1" status: 200 len: 859 time: 0.1086631 Feb 08 18:12:44.832665 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-3998f28e-1b3c-4d74-91bb-409b26a3c591 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=7395eb86d4034886b66fdf0b811e2404&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9454052 Feb 08 18:12:44.835968 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] Attempting to bind port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 on host hv-cinder-77398 for vnic_type normal with profile {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:12:44.836302 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] Attempting to bind port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 by drivers openvswitch,hyperv on host hv-cinder-77398 at level 0 using segments [{'id': '87601f46-1ba0-4a2e-93d3-e5859bcfbefa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1053, 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2'}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:12:44.836628 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] Attempting to bind port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 on network 7a854399-3ce6-42bd-bfc4-061132ecb9c2 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:12:44.842141 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 36106) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:44.844990 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1d44d369-f1f1-4fb8-9bd6-6eb110a24650 req-5ee9568a-be99-4fb4-b584-239101172cd2 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=f089911e-72de-4ff6-880b-ac3dd7927165&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0702240 Feb 08 18:12:44.845799 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-49e96f8b-61f7-43cb-a6d7-15d0500b558f req-51da1d34-e838-4c8e-a678-a9d01d8b0ecd tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4524992 Feb 08 18:12:44.859054 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3998f28e-1b3c-4d74-91bb-409b26a3c591 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0254cda0-c913-4ae6-a861-02ba785bf0d6,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:44.875552 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] Port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 on network 7a854399-3ce6-42bd-bfc4-061132ecb9c2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77398 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Feb 08 18:12:44.875876 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] Attempting to bind port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 on network 7a854399-3ce6-42bd-bfc4-061132ecb9c2 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:12:44.930885 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] Checking agent: {'id': '045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77398', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'started_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 12, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:12:44.931650 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] Checking segment: {'id': '87601f46-1ba0-4a2e-93d3-e5859bcfbefa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1053, 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102559) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:12:44.931650 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] Bound using segment: {'id': '87601f46-1ba0-4a2e-93d3-e5859bcfbefa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1053, 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2'} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:12:44.931969 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] Bound port: 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8, host: hv-cinder-77398, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '87601f46-1ba0-4a2e-93d3-e5859bcfbefa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1053, 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2'}}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:12:44.932314 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:44.938375 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5ada931-b326-4eb9-80ce-d6f82f37198b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a930213c-b78d-4de0-b692-a45ab4559fb3,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:44.981482 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7a00e289-ceb7-41be-bd42-55315c941f3e admin admin] Publish callbacks [] for security_group (0254cda0-c913-4ae6-a861-02ba785bf0d6), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:45.080788 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-becc506f-7db2-41de-a9e9-85bf0cf8381e req-9430e420-a1b4-4b21-b12d-c75e63c9db39 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:45.082311 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-becc506f-7db2-41de-a9e9-85bf0cf8381e req-9430e420-a1b4-4b21-b12d-c75e63c9db39 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 944 time: 0.2022896 Feb 08 18:12:45.097645 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7a00e289-ceb7-41be-bd42-55315c941f3e admin admin] Publish callbacks [] for security_group (0254cda0-c913-4ae6-a861-02ba785bf0d6), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:45.109834 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1d44d369-f1f1-4fb8-9bd6-6eb110a24650 req-6209b3e0-5176-4072-8866-4cdd06e2b99c service neutron] 10.222.0.109 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2285550 Feb 08 18:12:45.156331 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 36114) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:45.188179 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-becc506f-7db2-41de-a9e9-85bf0cf8381e req-9eb2298e-d374-4853-8568-73c6cbec59a1 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/security-groups?id=a70d7f73-fc20-4c96-ba3a-f48a3d3736a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0993879 Feb 08 18:12:45.206929 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb {{(pid=102559) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:12:45.213308 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] For port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8, host hv-cinder-77398, cleared binding levels {{(pid=102559) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:12:45.222499 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] Publish callbacks [] for port (fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:45.239594 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1d44d369-f1f1-4fb8-9bd6-6eb110a24650 req-0e988342-6a23-497e-831c-8ba02cf3fc23 service neutron] 10.222.0.109 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1120350 Feb 08 18:12:45.242846 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] For port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8, host hv-cinder-77398, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102559) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:12:45.262615 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:45.279201 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beaa47d5-8375-4a59-b1c2-d68ffdce22f4 req-3858f67a-3450-4f72-8c5f-5265a6a87580 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:45.280752 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-beaa47d5-8375-4a59-b1c2-d68ffdce22f4 req-3858f67a-3450-4f72-8c5f-5265a6a87580 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 943 time: 0.2202573 Feb 08 18:12:45.284263 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.provisioning_blocks [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] Transition to ACTIVE for port object fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb will not be triggered until provisioned by entity L2. {{(pid=102559) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Feb 08 18:12:45.294331 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 36118) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:45.306901 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7a00e289-ceb7-41be-bd42-55315c941f3e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (0254cda0-c913-4ae6-a861-02ba785bf0d6), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:45.309397 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7a00e289-ceb7-41be-bd42-55315c941f3e admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:45.310470 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-7a00e289-ceb7-41be-bd42-55315c941f3e admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/0254cda0-c913-4ae6-a861-02ba785bf0d6 HTTP/1.1" status: 204 len: 168 time: 0.4637728 Feb 08 18:12:45.315964 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:45.316830 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:45.318022 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] 10.222.0.109 "PUT /v2.0/ports/2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 HTTP/1.1" status: 200 len: 1093 time: 2.0717950 Feb 08 18:12:45.339229 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5', 'tag': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:12:45.342377 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3107436e-c02c-44a6-b49e-35896cb8dd6f" -d '{"events": [{"name": "network-changed", "server_uuid": "75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5", "tag": "2f2d1cfd-91ec-450a-bfe2-52d21f9196e8"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:12:45.345579 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-ff95cb18-a6fc-4889-85f9-8ee884f62e53 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=9864def12f7141c481b97b022905c17c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0476182 Feb 08 18:12:45.345714 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:45.347100 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 36126) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:45.391935 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-afbe6da9-c722-4df2-9b76-da70e93f1c6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:45.425859 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b14b28e5-8ca4-42d3-8138-dbd88f6f6af7 admin admin] Publish callbacks [] for security_group (ce70a01f-0a1d-499d-83e1-9b1da7be129f), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:45.472735 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:12:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d2fadbdd-e1b2-4cbf-b92b-62deac5c35fb x-openstack-request-id: req-d2fadbdd-e1b2-4cbf-b92b-62deac5c35fb {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:12:45.472735 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5", "tag": "2f2d1cfd-91ec-450a-bfe2-52d21f9196e8", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:12:45.472735 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-d2fadbdd-e1b2-4cbf-b92b-62deac5c35fb {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:12:45.472735 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5', 'tag': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8', 'status': 'completed', 'code': 200} Feb 08 18:12:45.472735 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a00e289-ceb7-41be-bd42-55315c941f3e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0254cda0-c913-4ae6-a861-02ba785bf0d6,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:45.472735 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-371ab41e-f8b1-4af6-9ccd-6affe4ba40f1 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:45.473713 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b14b28e5-8ca4-42d3-8138-dbd88f6f6af7 admin admin] Publish callbacks [] for security_group (ce70a01f-0a1d-499d-83e1-9b1da7be129f), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:45.559993 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea390f95-1146-47b1-b1c6-c91e2ba41e38 service neutron] Pushing event updated for resources: {'Port': ['ID=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8,revision_number=3']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:45.620862 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b14b28e5-8ca4-42d3-8138-dbd88f6f6af7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (ce70a01f-0a1d-499d-83e1-9b1da7be129f), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:45.625926 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b14b28e5-8ca4-42d3-8138-dbd88f6f6af7 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:45.629910 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-b14b28e5-8ca4-42d3-8138-dbd88f6f6af7 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/ce70a01f-0a1d-499d-83e1-9b1da7be129f HTTP/1.1" status: 204 len: 168 time: 0.2791357 Feb 08 18:12:45.637705 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b14b28e5-8ca4-42d3-8138-dbd88f6f6af7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ce70a01f-0a1d-499d-83e1-9b1da7be129f,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:45.723674 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-beaa47d5-8375-4a59-b1c2-d68ffdce22f4 req-21fdfdde-ab3d-40f1-afb0-85fc0bdb3e3c tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4179425 Feb 08 18:12:45.769124 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] Attempting to bind port fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb on host hv-cinder-77398 for vnic_type normal with profile {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:12:45.769770 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] Attempting to bind port fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb by drivers openvswitch,hyperv on host hv-cinder-77398 at level 0 using segments [{'id': 'acdceaea-bf94-4e23-8e9f-0f5d9197e75f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1082, 'network_id': 'e430084e-9b28-426f-9937-61346814b135'}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:12:45.771503 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] Attempting to bind port fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb on network e430084e-9b28-426f-9937-61346814b135 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:12:45.830680 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] Port fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb on network e430084e-9b28-426f-9937-61346814b135 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77398 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Feb 08 18:12:45.831236 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] Attempting to bind port fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb on network e430084e-9b28-426f-9937-61346814b135 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:12:45.835471 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-b9ae19af-e3b4-492d-ad77-0d43962cb6f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:45.837193 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-b9ae19af-e3b4-492d-ad77-0d43962cb6f4 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=357dab3d3db74ef9a8ee50fdd8a8bdcd&device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 1127 time: 0.4104400 Feb 08 18:12:45.856591 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] Pushing event updated for resources: {'Port': ['ID=fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:45.878129 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] Checking agent: {'id': '045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77398', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'started_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 12, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:12:45.878859 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] Checking segment: {'id': 'acdceaea-bf94-4e23-8e9f-0f5d9197e75f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1082, 'network_id': 'e430084e-9b28-426f-9937-61346814b135'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102559) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:12:45.879475 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] Bound using segment: {'id': 'acdceaea-bf94-4e23-8e9f-0f5d9197e75f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1082, 'network_id': 'e430084e-9b28-426f-9937-61346814b135'} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:12:45.880134 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] Bound port: fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb, host: hv-cinder-77398, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'acdceaea-bf94-4e23-8e9f-0f5d9197e75f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1082, 'network_id': 'e430084e-9b28-426f-9937-61346814b135'}}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:12:45.880701 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:45.919729 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-0ce33e20-7969-4eae-9fa2-d54e97c920f0 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 HTTP/1.1" status: 200 len: 217 time: 0.0644979 Feb 08 18:12:45.921661 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-371ab41e-f8b1-4af6-9ccd-6affe4ba40f1 admin admin] Publish callbacks [] for security_group (3a16f3e5-ffd8-4775-b293-c30d0c41d814), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:45.943094 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa34077f-65b9-48f7-a794-58f7b445d74d req-75b504ab-e604-49b7-81ce-1dd7e4276230 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:45.954117 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-fa34077f-65b9-48f7-a794-58f7b445d74d req-75b504ab-e604-49b7-81ce-1dd7e4276230 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 944 time: 0.1135139 Feb 08 18:12:45.966151 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-371ab41e-f8b1-4af6-9ccd-6affe4ba40f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (3a16f3e5-ffd8-4775-b293-c30d0c41d814), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:46.027488 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-fa34077f-65b9-48f7-a794-58f7b445d74d req-c0067d71-e554-487d-87fa-bfb689707987 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0722768 Feb 08 18:12:46.094168 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-2ffda62d-8ffe-487b-be01-67135b98bdab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:46.094413 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device f63fc38b-d10b-4316-b77f-d1816d07ca90 details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:12:46.096753 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-2ffda62d-8ffe-487b-be01-67135b98bdab service neutron] 10.222.0.109 "GET /v2.0/subnets?id=73de7865-d87d-4a2a-a702-160c400f145f HTTP/1.1" status: 200 len: 855 time: 0.1677024 Feb 08 18:12:46.104031 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-371ab41e-f8b1-4af6-9ccd-6affe4ba40f1 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=04b0e93f4387490bb7eb20dfd58b73e6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9386582 Feb 08 18:12:46.104126 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 36156) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:46.108589 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-371ab41e-f8b1-4af6-9ccd-6affe4ba40f1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3a16f3e5-ffd8-4775-b293-c30d0c41d814,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:46.131667 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 02c57200-9a7e-48d7-947f-7ed959af8662 up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:12:46.168731 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] For port fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb, host hv-cinder-77398, cleared binding levels {{(pid=102559) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:12:46.196684 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5150619-99bd-4d62-8737-f92e52028f79 req-798fc0d2-6296-4b4c-ab42-dc9360bcd8fd tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:46.198142 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a5150619-99bd-4d62-8737-f92e52028f79 req-798fc0d2-6296-4b4c-ab42-dc9360bcd8fd tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.2250960 Feb 08 18:12:46.200932 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] For port fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb, host hv-cinder-77398, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb,segment=NetworkSegment(acdceaea-bf94-4e23-8e9f-0f5d9197e75f),segment_id=acdceaea-bf94-4e23-8e9f-0f5d9197e75f)] {{(pid=102559) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:12:46.206402 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-46ed7bcc-d18b-4f38-a4b1-8bfd37848642 admin admin] Publish callbacks [] for security_group (3a16f3e5-ffd8-4775-b293-c30d0c41d814), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:46.263381 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-46ed7bcc-d18b-4f38-a4b1-8bfd37848642 admin admin] Publish callbacks [] for security_group (3a16f3e5-ffd8-4775-b293-c30d0c41d814), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:46.271093 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:46.277271 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning for port 02c57200-9a7e-48d7-947f-7ed959af8662 completed by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Feb 08 18:12:46.307650 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port f63fc38b-d10b-4316-b77f-d1816d07ca90, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=f63fc38b-d10b-4316-b77f-d1816d07ca90,segment=NetworkSegment(7e36cc20-402b-47f5-9242-a15d0de4717c),segment_id=7e36cc20-402b-47f5-9242-a15d0de4717c)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:12:46.313641 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:46.315005 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:46.316496 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] 10.222.0.109 "PUT /v2.0/ports/fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb HTTP/1.1" status: 200 len: 1094 time: 2.6050067 Feb 08 18:12:46.329099 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': 'f63fc38b-d10b-4316-b77f-d1816d07ca90', 'network_id': 'f089911e-72de-4ff6-880b-ac3dd7927165', 'port_id': 'f63fc38b-d10b-4316-b77f-d1816d07ca90', 'mac_address': 'fa:16:3e:12:3d:7f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1065, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0af67967-364e-4325-b04f-b7e157c3c3d4', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:12:46.337863 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port 02c57200-9a7e-48d7-947f-7ed959af8662 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:46.338574 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (02c57200-9a7e-48d7-947f-7ed959af8662), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:46.393881 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25288a29-bc73-4d56-a719-582839ef42aa service neutron] Pushing event updated for resources: {'Port': ['ID=fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb,revision_number=3']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:46.425580 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port f63fc38b-d10b-4316-b77f-d1816d07ca90 is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:46.435814 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (f63fc38b-d10b-4316-b77f-d1816d07ca90), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:46.458193 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ebe25cbe-a5a0-4a38-b10a-bd6b100668b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:46.460659 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-ebe25cbe-a5a0-4a38-b10a-bd6b100668b1 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=7a854399-3ce6-42bd-bfc4-061132ecb9c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.3531153 Feb 08 18:12:46.477633 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86f00e41-a914-46bd-9664-91e5b9fe6a0a req-812eb9f6-88b4-41e2-87c7-704a70fecc73 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:46.479418 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f63fc38b-d10b-4316-b77f-d1816d07ca90 {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:12:46.482192 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-86f00e41-a914-46bd-9664-91e5b9fe6a0a req-812eb9f6-88b4-41e2-87c7-704a70fecc73 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 944 time: 0.1388650 Feb 08 18:12:46.500815 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-46ed7bcc-d18b-4f38-a4b1-8bfd37848642 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (3a16f3e5-ffd8-4775-b293-c30d0c41d814), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:46.503763 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-46ed7bcc-d18b-4f38-a4b1-8bfd37848642 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:46.508767 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-46ed7bcc-d18b-4f38-a4b1-8bfd37848642 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/3a16f3e5-ffd8-4775-b293-c30d0c41d814 HTTP/1.1" status: 204 len: 168 time: 0.4047866 Feb 08 18:12:46.535333 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46ed7bcc-d18b-4f38-a4b1-8bfd37848642 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3a16f3e5-ffd8-4775-b293-c30d0c41d814,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:46.575670 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-86f00e41-a914-46bd-9664-91e5b9fe6a0a req-1ea85c19-d590-4e0b-b258-dd9ea95b6627 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/security-groups?id=a70d7f73-fc20-4c96-ba3a-f48a3d3736a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0841091 Feb 08 18:12:46.578648 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port f63fc38b-d10b-4316-b77f-d1816d07ca90, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=f63fc38b-d10b-4316-b77f-d1816d07ca90,segment=NetworkSegment(7e36cc20-402b-47f5-9242-a15d0de4717c),segment_id=7e36cc20-402b-47f5-9242-a15d0de4717c)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:12:46.583348 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a5150619-99bd-4d62-8737-f92e52028f79 req-ad0d4991-3b13-4788-8667-9e68f1fe9afc tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3580048 Feb 08 18:12:46.608397 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (f63fc38b-d10b-4316-b77f-d1816d07ca90), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:46.646322 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-6036c4be-7e8d-4316-b178-2c69f11ffa72 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:46.648487 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-6036c4be-7e8d-4316-b178-2c69f11ffa72 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=630172c388404c75bda3d0ba2d9d5834&device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 1128 time: 0.2427702 Feb 08 18:12:46.693477 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 02c57200-9a7e-48d7-947f-7ed959af8662 is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:46.694217 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (02c57200-9a7e-48d7-947f-7ed959af8662), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:46.706291 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-c4f74ea5-0233-4315-be7d-1df7ef89260b service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb HTTP/1.1" status: 200 len: 217 time: 0.0481536 Feb 08 18:12:46.709001 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-10ad4073-d576-429c-9a3e-4147cdbed432 service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2374775 Feb 08 18:12:46.742564 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=f63fc38b-d10b-4316-b77f-d1816d07ca90,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:46.783716 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6447fbdb-9f53-4284-ab18-211e412243c0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '02c57200-9a7e-48d7-947f-7ed959af8662'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:12:46.830364 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-b4f31407-d268-472f-828b-14a7a247b424 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:46.832313 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-b4f31407-d268-472f-828b-14a7a247b424 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=86592955-e7d0-4e8a-9490-976e17240d7c HTTP/1.1" status: 200 len: 849 time: 0.1148584 Feb 08 18:12:46.899259 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['f63fc38b-d10b-4316-b77f-d1816d07ca90'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:12:46.912268 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7f9ea2ad-feea-4476-bee2-3e684b62661d req-66dcac34-db72-4711-85b0-852123273d1f service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1928964 Feb 08 18:12:46.930695 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-f83bc7c8-5fae-4ae5-b7b9-bdd3bce45a8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:46.932667 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-f83bc7c8-5fae-4ae5-b7b9-bdd3bce45a8e service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=e430084e-9b28-426f-9937-61346814b135&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0916185 Feb 08 18:12:46.956359 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b41d505-99d0-4e49-a859-542db2edf9ca req-4a4bbf06-8875-4d35-92af-09a16d0c4e8d tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:46.958721 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1b41d505-99d0-4e49-a859-542db2edf9ca req-4a4bbf06-8875-4d35-92af-09a16d0c4e8d tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 943 time: 0.0922656 Feb 08 18:12:46.985392 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 02c57200-9a7e-48d7-947f-7ed959af8662, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=02c57200-9a7e-48d7-947f-7ed959af8662,segment=NetworkSegment(36b36f15-bf90-46bb-ac3a-109acbbc7fd3),segment_id=36b36f15-bf90-46bb-ac3a-109acbbc7fd3)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:12:47.046511 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (02c57200-9a7e-48d7-947f-7ed959af8662), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:47.086447 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3107436e-c02c-44a6-b49e-35896cb8dd6f req-c42e34ee-43c3-4caf-ba96-5aa0d02acad8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:47.088073 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3107436e-c02c-44a6-b49e-35896cb8dd6f req-c42e34ee-43c3-4caf-ba96-5aa0d02acad8 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=357dab3d3db74ef9a8ee50fdd8a8bdcd&device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 1127 time: 0.1240749 Feb 08 18:12:47.088409 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1b41d505-99d0-4e49-a859-542db2edf9ca req-7b9c7ac4-2c5f-4804-a81b-eea30712da22 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1233330 Feb 08 18:12:47.129763 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 36202) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:47.151325 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-36f827bf-8d5e-4ada-86e8-5105411a022d admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:47.161766 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-9d11da8b-88aa-4925-ac75-a468d9a85ee0 service neutron] 10.222.0.109 "GET /v2.0/networks/e430084e-9b28-426f-9937-61346814b135?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2222629 Feb 08 18:12:47.191805 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=02c57200-9a7e-48d7-947f-7ed959af8662,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:47.285275 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-36f827bf-8d5e-4ada-86e8-5105411a022d admin admin] Publish callbacks [] for security_group (5ab1a64a-c9dc-446f-8841-18a72e0d6c76), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:47.292829 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-36f827bf-8d5e-4ada-86e8-5105411a022d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (5ab1a64a-c9dc-446f-8841-18a72e0d6c76), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:47.332872 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3107436e-c02c-44a6-b49e-35896cb8dd6f req-9ef63791-a49f-4d0e-9287-cf8373d2f7ad service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:47.334355 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3107436e-c02c-44a6-b49e-35896cb8dd6f req-9ef63791-a49f-4d0e-9287-cf8373d2f7ad service neutron] 10.222.0.109 "GET /v2.0/networks?id=7a854399-3ce6-42bd-bfc4-061132ecb9c2 HTTP/1.1" status: 200 len: 918 time: 0.2252874 Feb 08 18:12:47.341779 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36f827bf-8d5e-4ada-86e8-5105411a022d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5ab1a64a-c9dc-446f-8841-18a72e0d6c76,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:47.358645 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a704cfe6-f38d-4ecc-a161-52df7ee0ca9e req-8d5a6fff-fd6f-4871-bb08-bdb3764f0454 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:47.366548 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a704cfe6-f38d-4ecc-a161-52df7ee0ca9e req-8d5a6fff-fd6f-4871-bb08-bdb3764f0454 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 944 time: 0.1759412 Feb 08 18:12:47.370137 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-36f827bf-8d5e-4ada-86e8-5105411a022d admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=fa718a15db194b08ae45f9f82dc378d0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2390363 Feb 08 18:12:47.373982 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 36212) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:47.418235 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3107436e-c02c-44a6-b49e-35896cb8dd6f req-ae2e2d05-5aea-4d18-891a-1cb2b221b698 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 HTTP/1.1" status: 200 len: 217 time: 0.0764024 Feb 08 18:12:47.425315 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-373950ea-0157-4963-9077-82badfdb8b7f admin admin] Publish callbacks [] for security_group (5ab1a64a-c9dc-446f-8841-18a72e0d6c76), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:47.452438 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-373950ea-0157-4963-9077-82badfdb8b7f admin admin] Publish callbacks [] for security_group (5ab1a64a-c9dc-446f-8841-18a72e0d6c76), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:47.466655 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd6973742-7d30-4603-8075-2a02f14da9ea', 'tag': 'fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:12:47.469029 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e17f404c-24dc-4a39-bb94-d303b1da7d4d" -d '{"events": [{"name": "network-changed", "server_uuid": "d6973742-7d30-4603-8075-2a02f14da9ea", "tag": "fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:12:47.473148 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6fbcbbd7-54e1-4c04-a332-ea72504d43be req-78643025-a8ad-4cbc-9b30-9b9c77b42079 service neutron] 10.222.0.109 "GET /v2.0/networks/e430084e-9b28-426f-9937-61346814b135?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3031273 Feb 08 18:12:47.526824 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3107436e-c02c-44a6-b49e-35896cb8dd6f req-69e34573-1792-42b3-9dd0-06f81cfeed50 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:47.530285 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3107436e-c02c-44a6-b49e-35896cb8dd6f req-69e34573-1792-42b3-9dd0-06f81cfeed50 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=73de7865-d87d-4a2a-a702-160c400f145f HTTP/1.1" status: 200 len: 855 time: 0.1030331 Feb 08 18:12:47.532442 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:12:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-25dc4d98-0e5b-473a-a713-958e17a4a971 x-openstack-request-id: req-25dc4d98-0e5b-473a-a713-958e17a4a971 {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:12:47.533801 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-373950ea-0157-4963-9077-82badfdb8b7f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (5ab1a64a-c9dc-446f-8841-18a72e0d6c76), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:47.535176 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-930645a7-d16d-4900-8bac-29eda765eb85" -d '{"events": [{"server_uuid": "6447fbdb-9f53-4284-ab18-211e412243c0", "name": "network-vif-plugged", "status": "completed", "tag": "02c57200-9a7e-48d7-947f-7ed959af8662"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:12:47.537511 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-373950ea-0157-4963-9077-82badfdb8b7f admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:47.541270 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-373950ea-0157-4963-9077-82badfdb8b7f admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/5ab1a64a-c9dc-446f-8841-18a72e0d6c76 HTTP/1.1" status: 204 len: 168 time: 0.1662967 Feb 08 18:12:47.541753 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d6973742-7d30-4603-8075-2a02f14da9ea", "tag": "fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:12:47.542021 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-25dc4d98-0e5b-473a-a713-958e17a4a971 {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:12:47.542435 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd6973742-7d30-4603-8075-2a02f14da9ea', 'tag': 'fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb', 'status': 'completed', 'code': 200} Feb 08 18:12:47.560192 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-373950ea-0157-4963-9077-82badfdb8b7f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5ab1a64a-c9dc-446f-8841-18a72e0d6c76,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:47.561425 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a704cfe6-f38d-4ecc-a161-52df7ee0ca9e req-c31d02e3-b1df-4084-aa58-466fbf654cd5 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1938794 Feb 08 18:12:47.656110 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3107436e-c02c-44a6-b49e-35896cb8dd6f req-7a4a9f25-6251-4069-8486-37fc09269262 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:47.658102 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3107436e-c02c-44a6-b49e-35896cb8dd6f req-7a4a9f25-6251-4069-8486-37fc09269262 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=7a854399-3ce6-42bd-bfc4-061132ecb9c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0953071 Feb 08 18:12:47.659677 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e17f404c-24dc-4a39-bb94-d303b1da7d4d req-beb97d8a-6788-4e3e-8af8-9a8ca098f53d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:47.661044 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e17f404c-24dc-4a39-bb94-d303b1da7d4d req-beb97d8a-6788-4e3e-8af8-9a8ca098f53d service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=630172c388404c75bda3d0ba2d9d5834&device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 1128 time: 0.0872588 Feb 08 18:12:47.809859 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-6b5e16a8-9deb-47f7-be08-b7891e848a29 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:47.908954 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 36236) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:47.943075 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:48.039286 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:12:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3f2c850e-1451-41e0-a1f2-f4455e9113c7 x-openstack-request-id: req-3f2c850e-1451-41e0-a1f2-f4455e9113c7 {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:12:48.039786 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6447fbdb-9f53-4284-ab18-211e412243c0", "name": "network-vif-plugged", "status": "completed", "tag": "02c57200-9a7e-48d7-947f-7ed959af8662", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:12:48.040223 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-3f2c850e-1451-41e0-a1f2-f4455e9113c7 {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:12:48.040816 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6447fbdb-9f53-4284-ab18-211e412243c0', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '02c57200-9a7e-48d7-947f-7ed959af8662', 'code': 200} Feb 08 18:12:48.063989 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e17f404c-24dc-4a39-bb94-d303b1da7d4d req-c25be8fb-c178-487f-b780-ec021d7c28a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:48.065560 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e17f404c-24dc-4a39-bb94-d303b1da7d4d req-c25be8fb-c178-487f-b780-ec021d7c28a5 service neutron] 10.222.0.109 "GET /v2.0/networks?id=e430084e-9b28-426f-9937-61346814b135 HTTP/1.1" status: 200 len: 912 time: 0.3946993 Feb 08 18:12:48.108547 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 062ed5c0-df28-461b-87fe-826944e42c54 details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:12:48.111220 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device f63fc38b-d10b-4316-b77f-d1816d07ca90 up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:12:48.140675 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c422e38-b59f-4fad-a638-d9d088a69859 req-c563ac23-1749-4790-9521-95fcf1d05fe6 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:48.147547 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7c422e38-b59f-4fad-a638-d9d088a69859 req-c563ac23-1749-4790-9521-95fcf1d05fe6 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 945 time: 0.4855151 Feb 08 18:12:48.153241 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e17f404c-24dc-4a39-bb94-d303b1da7d4d req-4813e9dc-b5de-446d-b83d-b2314ab71553 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb HTTP/1.1" status: 200 len: 217 time: 0.0740805 Feb 08 18:12:48.208023 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3107436e-c02c-44a6-b49e-35896cb8dd6f req-06d1eb8f-3d17-485b-9e6c-7bcc96c0ce9d service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5359426 Feb 08 18:12:48.268063 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e17f404c-24dc-4a39-bb94-d303b1da7d4d req-a1b8c349-70ef-477f-b38c-0e7aaeb321d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:48.269313 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e17f404c-24dc-4a39-bb94-d303b1da7d4d req-a1b8c349-70ef-477f-b38c-0e7aaeb321d3 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=86592955-e7d0-4e8a-9490-976e17240d7c HTTP/1.1" status: 200 len: 849 time: 0.1035755 Feb 08 18:12:48.273744 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d6b4270b-cd19-4248-98c2-8aa1c6f4aba8 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:48.329265 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 062ed5c0-df28-461b-87fe-826944e42c54, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=062ed5c0-df28-461b-87fe-826944e42c54,segment=NetworkSegment(7e36cc20-402b-47f5-9242-a15d0de4717c),segment_id=7e36cc20-402b-47f5-9242-a15d0de4717c)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:12:48.346934 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7c422e38-b59f-4fad-a638-d9d088a69859 req-b06470ab-92ce-44bd-b036-9a058bf11e75 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/security-groups?id=a70d7f73-fc20-4c96-ba3a-f48a3d3736a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1983392 Feb 08 18:12:48.348395 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': '062ed5c0-df28-461b-87fe-826944e42c54', 'network_id': 'f089911e-72de-4ff6-880b-ac3dd7927165', 'port_id': '062ed5c0-df28-461b-87fe-826944e42c54', 'mac_address': 'fa:16:3e:0f:c6:87', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1065, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0af67967-364e-4325-b04f-b7e157c3c3d4', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:12:48.449507 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3107436e-c02c-44a6-b49e-35896cb8dd6f req-5d1bbe2e-ba47-4432-a6ea-31d3c5c35041 service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2347617 Feb 08 18:12:48.462481 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e17f404c-24dc-4a39-bb94-d303b1da7d4d req-b6949fe1-7e94-4906-88ed-b7d95df3e44e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:48.464225 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e17f404c-24dc-4a39-bb94-d303b1da7d4d req-b6949fe1-7e94-4906-88ed-b7d95df3e44e service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=e430084e-9b28-426f-9937-61346814b135&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.1875951 Feb 08 18:12:48.466603 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-693d002c-8496-4260-b939-7cdbb554ed86 req-dc767549-3efd-4610-befc-589fb7ec0997 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:48.469159 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-693d002c-8496-4260-b939-7cdbb554ed86 req-dc767549-3efd-4610-befc-589fb7ec0997 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.3220720 Feb 08 18:12:48.545238 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning for port f63fc38b-d10b-4316-b77f-d1816d07ca90 completed by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Feb 08 18:12:48.552466 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port f63fc38b-d10b-4316-b77f-d1816d07ca90 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:48.552849 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (f63fc38b-d10b-4316-b77f-d1816d07ca90), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:48.579945 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76c47b8d-e46e-42df-88bf-9618096dc7db req-4b018585-76a4-4f61-8550-000f0c1c7860 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:48.581666 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-76c47b8d-e46e-42df-88bf-9618096dc7db req-4b018585-76a4-4f61-8550-000f0c1c7860 service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 1129 time: 0.3040278 Feb 08 18:12:48.595926 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 062ed5c0-df28-461b-87fe-826944e42c54 is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:48.596714 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (062ed5c0-df28-461b-87fe-826944e42c54), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:48.602153 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d48939b-624a-47d9-ad5c-f0a4cfb54466 req-e859869a-f8aa-4eeb-a85b-03125c54d858 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:48.611360 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-76c47b8d-e46e-42df-88bf-9618096dc7db req-e7d34bb6-65ea-41b5-b3f0-89e1b16ae04f service neutron] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:48.612159 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7d48939b-624a-47d9-ad5c-f0a4cfb54466 req-e859869a-f8aa-4eeb-a85b-03125c54d858 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 943 time: 0.1651235 Feb 08 18:12:48.615267 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:48.620694 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 062ed5c0-df28-461b-87fe-826944e42c54 {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:12:48.630064 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-693d002c-8496-4260-b939-7cdbb554ed86 req-5c8c61df-b45b-47aa-b87b-e6607c08d647 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1388810 Feb 08 18:12:48.671495 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d6b4270b-cd19-4248-98c2-8aa1c6f4aba8 admin admin] Publish callbacks [] for security_group (fd4d7cf7-4b72-4f44-bcaa-abc70071253f), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:48.673010 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e17f404c-24dc-4a39-bb94-d303b1da7d4d req-896c7625-6cce-4601-b9c7-bbfb6ceaa015 service neutron] 10.222.0.109 "GET /v2.0/networks/e430084e-9b28-426f-9937-61346814b135?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1854298 Feb 08 18:12:48.681812 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 062ed5c0-df28-461b-87fe-826944e42c54, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=062ed5c0-df28-461b-87fe-826944e42c54,segment=NetworkSegment(7e36cc20-402b-47f5-9242-a15d0de4717c),segment_id=7e36cc20-402b-47f5-9242-a15d0de4717c)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:12:48.687887 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d6b4270b-cd19-4248-98c2-8aa1c6f4aba8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (fd4d7cf7-4b72-4f44-bcaa-abc70071253f), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:48.697032 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (062ed5c0-df28-461b-87fe-826944e42c54), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:48.775789 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7d48939b-624a-47d9-ad5c-f0a4cfb54466 req-33df62b0-a247-49d8-bc38-562be78f1c35 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1603251 Feb 08 18:12:48.826737 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-76c47b8d-e46e-42df-88bf-9618096dc7db req-e7d34bb6-65ea-41b5-b3f0-89e1b16ae04f service neutron] Publish callbacks [] for security_group (9796ec4e-bf15-4eda-9ca1-fe57fda041f1), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:48.827900 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e17f404c-24dc-4a39-bb94-d303b1da7d4d req-9084e1bb-3551-449f-9dd9-f8aaed8b5e36 service neutron] 10.222.0.109 "GET /v2.0/networks/e430084e-9b28-426f-9937-61346814b135?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1455696 Feb 08 18:12:48.844920 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=062ed5c0-df28-461b-87fe-826944e42c54,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:48.850588 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port f63fc38b-d10b-4316-b77f-d1816d07ca90 is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:48.851203 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (f63fc38b-d10b-4316-b77f-d1816d07ca90), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:48.868393 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-d6b4270b-cd19-4248-98c2-8aa1c6f4aba8 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=20463820dda6433799ae85053901084e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9583130 Feb 08 18:12:48.871311 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 36268) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:48.880670 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-76c47b8d-e46e-42df-88bf-9618096dc7db req-e7d34bb6-65ea-41b5-b3f0-89e1b16ae04f service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (9796ec4e-bf15-4eda-9ca1-fe57fda041f1), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:48.896011 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port f63fc38b-d10b-4316-b77f-d1816d07ca90, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=f63fc38b-d10b-4316-b77f-d1816d07ca90,segment=NetworkSegment(7e36cc20-402b-47f5-9242-a15d0de4717c),segment_id=7e36cc20-402b-47f5-9242-a15d0de4717c)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:12:48.904444 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (f63fc38b-d10b-4316-b77f-d1816d07ca90), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:48.933707 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6b4270b-cd19-4248-98c2-8aa1c6f4aba8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fd4d7cf7-4b72-4f44-bcaa-abc70071253f,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:48.950582 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c130f527-44cd-40e6-899e-e9e7c52f805b admin admin] Publish callbacks [] for security_group (fd4d7cf7-4b72-4f44-bcaa-abc70071253f), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:48.968463 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['062ed5c0-df28-461b-87fe-826944e42c54'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:12:48.990899 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c130f527-44cd-40e6-899e-e9e7c52f805b admin admin] Publish callbacks [] for security_group (fd4d7cf7-4b72-4f44-bcaa-abc70071253f), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:48.998467 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d65bea4-46bb-45c9-9f2f-055cb25dadc8 req-37a2c99f-b2e8-44fa-a5c6-bda7cfc54089 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:49.005792 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-9d65bea4-46bb-45c9-9f2f-055cb25dadc8 req-37a2c99f-b2e8-44fa-a5c6-bda7cfc54089 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 944 time: 0.1580904 Feb 08 18:12:49.032916 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-76c47b8d-e46e-42df-88bf-9618096dc7db req-e7d34bb6-65ea-41b5-b3f0-89e1b16ae04f service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=a70d7f73-fc20-4c96-ba3a-f48a3d3736a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4395299 Feb 08 18:12:49.044167 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7d34bb6-65ea-41b5-b3f0-89e1b16ae04f service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=9796ec4e-bf15-4eda-9ca1-fe57fda041f1,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:49.064949 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c130f527-44cd-40e6-899e-e9e7c52f805b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (fd4d7cf7-4b72-4f44-bcaa-abc70071253f), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:49.071789 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c130f527-44cd-40e6-899e-e9e7c52f805b admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:49.073610 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-9d65bea4-46bb-45c9-9f2f-055cb25dadc8 req-f8cc105b-8f5e-436e-ab9e-407254538636 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0650392 Feb 08 18:12:49.074207 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-c130f527-44cd-40e6-899e-e9e7c52f805b admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/fd4d7cf7-4b72-4f44-bcaa-abc70071253f HTTP/1.1" status: 204 len: 168 time: 0.2009614 Feb 08 18:12:49.083289 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c130f527-44cd-40e6-899e-e9e7c52f805b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fd4d7cf7-4b72-4f44-bcaa-abc70071253f,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:49.111691 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=f63fc38b-d10b-4316-b77f-d1816d07ca90,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:49.471818 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc55ea5b-8f48-44b1-a766-7198285b15a3 req-259b3951-317c-4731-b5a9-2194497e314e tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:49.473811 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-dc55ea5b-8f48-44b1-a766-7198285b15a3 req-259b3951-317c-4731-b5a9-2194497e314e tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 945 time: 0.0678012 Feb 08 18:12:49.515213 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 36308) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:49.533773 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-a0b86857-5b69-4823-be6b-6f860f66fb22 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:49.541623 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-dc55ea5b-8f48-44b1-a766-7198285b15a3 req-740e79ad-9c2d-4b13-af0a-cc0b8529fd2a tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/security-groups?id=a70d7f73-fc20-4c96-ba3a-f48a3d3736a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0612891 Feb 08 18:12:49.645530 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-a0b86857-5b69-4823-be6b-6f860f66fb22 admin admin] Publish callbacks [] for security_group (3a7aad6c-b9db-48d3-b962-19e513675bdf), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:49.652619 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-a0b86857-5b69-4823-be6b-6f860f66fb22 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (3a7aad6c-b9db-48d3-b962-19e513675bdf), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:49.685194 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0b86857-5b69-4823-be6b-6f860f66fb22 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3a7aad6c-b9db-48d3-b962-19e513675bdf,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:49.728732 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-a0b86857-5b69-4823-be6b-6f860f66fb22 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=35c1e43b57ce464fa998b15857ae90ab&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2122812 Feb 08 18:12:49.731217 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 36314) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:49.827711 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b8d2e03-f955-49ec-af39-d9c88859a6ba req-b2e02657-b93f-49c1-b857-7c93439b2607 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:49.829440 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-7b8d2e03-f955-49ec-af39-d9c88859a6ba req-b2e02657-b93f-49c1-b857-7c93439b2607 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.0996096 Feb 08 18:12:49.832650 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-005a78f3-b0d9-4eec-a538-5b00d5d97b3a admin admin] Publish callbacks [] for security_group (3a7aad6c-b9db-48d3-b962-19e513675bdf), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:49.890156 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-005a78f3-b0d9-4eec-a538-5b00d5d97b3a admin admin] Publish callbacks [] for security_group (3a7aad6c-b9db-48d3-b962-19e513675bdf), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:49.933618 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a87e384b-d65d-470d-ba9f-04b0fac1f7ab req-eeb84816-a430-4fa9-ba1e-c0463d495173 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:49.935342 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a87e384b-d65d-470d-ba9f-04b0fac1f7ab req-eeb84816-a430-4fa9-ba1e-c0463d495173 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 944 time: 0.0842643 Feb 08 18:12:49.957482 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 36326) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:49.999222 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-7b8d2e03-f955-49ec-af39-d9c88859a6ba req-1f7a02cf-271c-433c-bf4a-e362adf56b50 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1531088 Feb 08 18:12:50.031979 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-005a78f3-b0d9-4eec-a538-5b00d5d97b3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (3a7aad6c-b9db-48d3-b962-19e513675bdf), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:50.034635 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-005a78f3-b0d9-4eec-a538-5b00d5d97b3a admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:50.038508 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a87e384b-d65d-470d-ba9f-04b0fac1f7ab req-4b5d819c-b926-4b5a-8c61-b923ebd579e7 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0951674 Feb 08 18:12:50.042502 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-005a78f3-b0d9-4eec-a538-5b00d5d97b3a admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/3a7aad6c-b9db-48d3-b962-19e513675bdf HTTP/1.1" status: 204 len: 168 time: 0.2997608 Feb 08 18:12:50.043315 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3eb2132b-01b1-4916-84eb-81ab88bcfc6d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f63fc38b-d10b-4316-b77f-d1816d07ca90'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:12:50.046318 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a46fb709-b1fe-440d-93bb-a3feda9cd81b" -d '{"events": [{"server_uuid": "3eb2132b-01b1-4916-84eb-81ab88bcfc6d", "name": "network-vif-plugged", "status": "completed", "tag": "f63fc38b-d10b-4316-b77f-d1816d07ca90"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:12:50.049685 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-005a78f3-b0d9-4eec-a538-5b00d5d97b3a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3a7aad6c-b9db-48d3-b962-19e513675bdf,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:50.098677 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:12:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a8218852-01a4-4732-a5b8-42f3c324f458 x-openstack-request-id: req-a8218852-01a4-4732-a5b8-42f3c324f458 {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:12:50.099022 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3eb2132b-01b1-4916-84eb-81ab88bcfc6d", "name": "network-vif-plugged", "status": "completed", "tag": "f63fc38b-d10b-4316-b77f-d1816d07ca90", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:12:50.103816 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-a8218852-01a4-4732-a5b8-42f3c324f458 {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:12:50.104342 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3eb2132b-01b1-4916-84eb-81ab88bcfc6d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f63fc38b-d10b-4316-b77f-d1816d07ca90', 'code': 200} Feb 08 18:12:50.110106 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:50.121541 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:12:50.125900 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 062ed5c0-df28-461b-87fe-826944e42c54 up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:12:50.164419 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-29dbd53d-f720-49d8-83ba-d6ceec63e49a admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:50.314575 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning for port 062ed5c0-df28-461b-87fe-826944e42c54 completed by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Feb 08 18:12:50.325754 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port 062ed5c0-df28-461b-87fe-826944e42c54 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:50.326307 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (062ed5c0-df28-461b-87fe-826944e42c54), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:50.335605 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7b1aab4-df3a-4ef5-9dba-3a97c3ce0b21 req-8bf4742f-0661-4e28-a66a-4b0f8ee727f2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:50.342998 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9f14be7-4232-4941-a641-5f8572192cae req-cd59c701-16e1-496d-a3db-0c3f1f0be06b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:50.344502 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c9f14be7-4232-4941-a641-5f8572192cae req-cd59c701-16e1-496d-a3db-0c3f1f0be06b service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 1130 time: 0.0769548 Feb 08 18:12:50.346429 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f7b1aab4-df3a-4ef5-9dba-3a97c3ce0b21 req-8bf4742f-0661-4e28-a66a-4b0f8ee727f2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 944 time: 0.1560795 Feb 08 18:12:50.398265 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb,segment=NetworkSegment(acdceaea-bf94-4e23-8e9f-0f5d9197e75f),segment_id=acdceaea-bf94-4e23-8e9f-0f5d9197e75f)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:12:50.413886 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': 'fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'port_id': 'fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb', 'mac_address': 'fa:16:3e:65:e3:65', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1082, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:12:50.432368 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c9f14be7-4232-4941-a641-5f8572192cae req-5ec5366e-1922-4ecf-afda-0a7427d69104 service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0799556 Feb 08 18:12:50.490177 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f7b1aab4-df3a-4ef5-9dba-3a97c3ce0b21 req-418a54c6-80a1-4362-b7d5-89c93e483843 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1411419 Feb 08 18:12:50.494033 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-29dbd53d-f720-49d8-83ba-d6ceec63e49a admin admin] Publish callbacks [] for security_group (12250f7c-77f6-46cf-9637-35b0e8638ec5), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:50.501914 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-29dbd53d-f720-49d8-83ba-d6ceec63e49a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (12250f7c-77f6-46cf-9637-35b0e8638ec5), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:50.506950 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:50.507350 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:50.509987 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 062ed5c0-df28-461b-87fe-826944e42c54 is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:50.510662 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (062ed5c0-df28-461b-87fe-826944e42c54), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:50.534228 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:12:50.558919 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-29dbd53d-f720-49d8-83ba-d6ceec63e49a admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=f1b845fa104c4cc29544532c0fda0cb0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6000574 Feb 08 18:12:50.561409 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 36352) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:50.561873 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29dbd53d-f720-49d8-83ba-d6ceec63e49a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=12250f7c-77f6-46cf-9637-35b0e8638ec5,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:50.599262 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb,segment=NetworkSegment(acdceaea-bf94-4e23-8e9f-0f5d9197e75f),segment_id=acdceaea-bf94-4e23-8e9f-0f5d9197e75f)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:12:50.615407 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 062ed5c0-df28-461b-87fe-826944e42c54, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=062ed5c0-df28-461b-87fe-826944e42c54,segment=NetworkSegment(7e36cc20-402b-47f5-9242-a15d0de4717c),segment_id=7e36cc20-402b-47f5-9242-a15d0de4717c)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:12:50.616681 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:50.617357 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:12:50.630850 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (062ed5c0-df28-461b-87fe-826944e42c54), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:50.742835 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-dbfb8dae-6f5f-4c1a-9a17-65b132bd5ccd admin admin] Publish callbacks [] for security_group (12250f7c-77f6-46cf-9637-35b0e8638ec5), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:50.768495 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:50.792148 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-dbfb8dae-6f5f-4c1a-9a17-65b132bd5ccd admin admin] Publish callbacks [] for security_group (12250f7c-77f6-46cf-9637-35b0e8638ec5), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:50.811537 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8c935a6-af8d-4993-b00e-3ea59d5fd074 req-143221b8-28e2-45d2-a7ce-d298b46ad62b tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:50.813275 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d8c935a6-af8d-4993-b00e-3ea59d5fd074 req-143221b8-28e2-45d2-a7ce-d298b46ad62b tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 945 time: 0.1705282 Feb 08 18:12:50.846908 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:12:50.849786 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=062ed5c0-df28-461b-87fe-826944e42c54,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:50.868796 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'port_id': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8', 'mac_address': 'fa:16:3e:15:4a:9a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1053, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '73de7865-d87d-4a2a-a702-160c400f145f', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:12:50.923620 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-dbfb8dae-6f5f-4c1a-9a17-65b132bd5ccd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (12250f7c-77f6-46cf-9637-35b0e8638ec5), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:50.926292 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-dbfb8dae-6f5f-4c1a-9a17-65b132bd5ccd admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:50.930293 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-dbfb8dae-6f5f-4c1a-9a17-65b132bd5ccd admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/12250f7c-77f6-46cf-9637-35b0e8638ec5 HTTP/1.1" status: 204 len: 168 time: 0.3651824 Feb 08 18:12:50.937045 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:50.937676 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:50.942901 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbfb8dae-6f5f-4c1a-9a17-65b132bd5ccd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=12250f7c-77f6-46cf-9637-35b0e8638ec5,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:50.959591 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:12:50.988005 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:12:50.996081 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:51.015588 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d8c935a6-af8d-4993-b00e-3ea59d5fd074 req-adfd5221-fa28-406e-8290-bbbce093eea9 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/security-groups?id=a70d7f73-fc20-4c96-ba3a-f48a3d3736a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1112907 Feb 08 18:12:51.113208 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:51.172083 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee32cdc2-483e-4ec4-8a7a-44e4ecb81322 req-2a37acb6-64f0-4943-be8b-e0ce12916e22 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:51.183527 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ee32cdc2-483e-4ec4-8a7a-44e4ecb81322 req-2a37acb6-64f0-4943-be8b-e0ce12916e22 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 944 time: 0.1000757 Feb 08 18:12:51.233516 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3c58cd8-08a9-4127-9993-7eaf74d964bd req-e01a7f05-b46a-4820-8a2c-9e09b89cbbbf tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:51.235000 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e3c58cd8-08a9-4127-9993-7eaf74d964bd req-e01a7f05-b46a-4820-8a2c-9e09b89cbbbf tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0800378 Feb 08 18:12:51.256895 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:12:51.272192 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ee32cdc2-483e-4ec4-8a7a-44e4ecb81322 req-fb43a2f7-adb6-45ee-925a-7e6a43f50210 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0871446 Feb 08 18:12:51.304904 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e3c58cd8-08a9-4127-9993-7eaf74d964bd req-27995471-e649-4bcb-b2fe-20a7e05b5c44 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0631413 Feb 08 18:12:51.326872 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['2f2d1cfd-91ec-450a-bfe2-52d21f9196e8'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:12:51.665621 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:51.669240 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 36402) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:51.683393 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d7436e7f-cc44-4013-8ab4-30d5f0888b47 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:51.703414 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3fad1f8-9e79-4334-9596-0dac9e23458d req-a6334c2c-f8f0-4cb4-95c6-488006fc7ccf tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:51.707863 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e3fad1f8-9e79-4334-9596-0dac9e23458d req-a6334c2c-f8f0-4cb4-95c6-488006fc7ccf tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 945 time: 0.1015701 Feb 08 18:12:51.789886 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e3fad1f8-9e79-4334-9596-0dac9e23458d req-ef3d0a81-6513-465b-8afe-d9a00871d572 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0687385 Feb 08 18:12:51.809302 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d7436e7f-cc44-4013-8ab4-30d5f0888b47 admin admin] Publish callbacks [] for security_group (1f25c467-d476-4b56-9568-818ba79aa3fa), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:51.816209 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d7436e7f-cc44-4013-8ab4-30d5f0888b47 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (1f25c467-d476-4b56-9568-818ba79aa3fa), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:51.860297 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-d7436e7f-cc44-4013-8ab4-30d5f0888b47 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=81cbe5ddbebd4b0e87c3b647c7a87622&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1898777 Feb 08 18:12:51.861508 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7436e7f-cc44-4013-8ab4-30d5f0888b47 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1f25c467-d476-4b56-9568-818ba79aa3fa,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:51.863026 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 36410) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:51.920099 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-59b4c9d6-9f73-4176-9d39-a667cacfcc31 admin admin] Publish callbacks [] for security_group (1f25c467-d476-4b56-9568-818ba79aa3fa), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:51.944449 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-59b4c9d6-9f73-4176-9d39-a667cacfcc31 admin admin] Publish callbacks [] for security_group (1f25c467-d476-4b56-9568-818ba79aa3fa), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:51.996942 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-59b4c9d6-9f73-4176-9d39-a667cacfcc31 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (1f25c467-d476-4b56-9568-818ba79aa3fa), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:51.999564 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-59b4c9d6-9f73-4176-9d39-a667cacfcc31 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:52.003613 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-59b4c9d6-9f73-4176-9d39-a667cacfcc31 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/1f25c467-d476-4b56-9568-818ba79aa3fa HTTP/1.1" status: 204 len: 168 time: 0.1363974 Feb 08 18:12:52.012000 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59b4c9d6-9f73-4176-9d39-a667cacfcc31 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1f25c467-d476-4b56-9568-818ba79aa3fa,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:52.105264 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'eb0ad33a-c04e-4d37-ab65-6b2bd025791d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '062ed5c0-df28-461b-87fe-826944e42c54'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:12:52.108717 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-716f465b-2450-483d-9a57-e9f96654d916" -d '{"events": [{"server_uuid": "eb0ad33a-c04e-4d37-ab65-6b2bd025791d", "name": "network-vif-plugged", "status": "completed", "tag": "062ed5c0-df28-461b-87fe-826944e42c54"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:12:52.184216 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:12:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-da3b205e-1c5a-44b1-a0c1-a52c5bcf13a5 x-openstack-request-id: req-da3b205e-1c5a-44b1-a0c1-a52c5bcf13a5 {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:12:52.184822 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "eb0ad33a-c04e-4d37-ab65-6b2bd025791d", "name": "network-vif-plugged", "status": "completed", "tag": "062ed5c0-df28-461b-87fe-826944e42c54", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:12:52.184822 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-da3b205e-1c5a-44b1-a0c1-a52c5bcf13a5 {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:12:52.185282 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'eb0ad33a-c04e-4d37-ab65-6b2bd025791d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '062ed5c0-df28-461b-87fe-826944e42c54', 'code': 200} Feb 08 18:12:52.192702 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f419fae-1dc9-41b4-92bb-90c0b66b9ac2 req-99f0426a-b354-4ced-96ea-f27c1e05ee3a tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:52.194555 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-7f419fae-1dc9-41b4-92bb-90c0b66b9ac2 req-99f0426a-b354-4ced-96ea-f27c1e05ee3a tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 945 time: 0.0898535 Feb 08 18:12:52.258137 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-7f419fae-1dc9-41b4-92bb-90c0b66b9ac2 req-94f5ee33-b967-48db-bd0e-8f7e672ccc9b tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/security-groups?id=a70d7f73-fc20-4c96-ba3a-f48a3d3736a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0568516 Feb 08 18:12:52.449407 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfa16f4f-9e7a-4bf5-b691-6d56d831838b req-73836dcd-6458-43ea-acda-9c542a8bafd7 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:52.451246 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-cfa16f4f-9e7a-4bf5-b691-6d56d831838b req-73836dcd-6458-43ea-acda-9c542a8bafd7 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 944 time: 0.0747366 Feb 08 18:12:52.455470 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4761f1d-c989-472d-8fc7-9ea5879b2d29 req-b0b18daf-a792-41d2-b74a-6326ef26185b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:52.456959 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c4761f1d-c989-472d-8fc7-9ea5879b2d29 req-b0b18daf-a792-41d2-b74a-6326ef26185b service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 1129 time: 0.1187048 Feb 08 18:12:52.507153 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ca93f66-88b2-4857-a9bf-0e820c0546ff req-d2e90d29-9bbb-4405-867d-dbf64abcaedf tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:52.508714 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-6ca93f66-88b2-4857-a9bf-0e820c0546ff req-d2e90d29-9bbb-4405-867d-dbf64abcaedf tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0925858 Feb 08 18:12:52.520125 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-cfa16f4f-9e7a-4bf5-b691-6d56d831838b req-853a4b6f-8599-43bc-9fee-e249b426a8c2 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0611393 Feb 08 18:12:52.587626 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c4761f1d-c989-472d-8fc7-9ea5879b2d29 req-ea5ec391-e5ef-4316-9fd1-121739e01b5d service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1220951 Feb 08 18:12:52.592248 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-6ca93f66-88b2-4857-a9bf-0e820c0546ff req-858f82d7-4266-40e0-82c8-825903aa2f8d tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0697436 Feb 08 18:12:52.916280 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f7f0b61-eacb-49ce-8d5f-76f5f4a313d1 req-1d68138f-18a7-49a5-8a0d-b121cf0637ae tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:52.918205 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8f7f0b61-eacb-49ce-8d5f-76f5f4a313d1 req-1d68138f-18a7-49a5-8a0d-b121cf0637ae tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 945 time: 0.0586946 Feb 08 18:12:53.009711 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8f7f0b61-eacb-49ce-8d5f-76f5f4a313d1 req-b4d892ff-4c96-4c1e-80a9-d6526dc5ee1c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0845320 Feb 08 18:12:53.736141 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ac5de51-5387-40c8-a35e-69ce00a7cd0d req-ee86155d-3eb7-4b4a-a0ab-3d142e0b0013 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:53.737942 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4ac5de51-5387-40c8-a35e-69ce00a7cd0d req-ee86155d-3eb7-4b4a-a0ab-3d142e0b0013 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 944 time: 0.1386824 Feb 08 18:12:53.754507 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75bd48bc-89c8-4621-9a4f-128820ab1ef0 req-1a78ed98-362b-47df-ae43-96694b033fd4 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:53.764371 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-75bd48bc-89c8-4621-9a4f-128820ab1ef0 req-1a78ed98-362b-47df-ae43-96694b033fd4 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0781677 Feb 08 18:12:53.831304 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4ac5de51-5387-40c8-a35e-69ce00a7cd0d req-088e06e7-b811-434b-b84d-702c65802432 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0838337 Feb 08 18:12:53.854485 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-75bd48bc-89c8-4621-9a4f-128820ab1ef0 req-9792cedf-0819-49c6-97f6-1814af7d3523 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0845931 Feb 08 18:12:53.985446 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 36556) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:54.146342 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:12:54.149316 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb7a8fe0-e64f-44ba-9dab-c78aa8a75011 req-0aeeb627-8f90-46a6-be9d-1966e664f9ef tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:54.156492 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-cb7a8fe0-e64f-44ba-9dab-c78aa8a75011 req-0aeeb627-8f90-46a6-be9d-1966e664f9ef tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 945 time: 0.0633118 Feb 08 18:12:54.209704 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-cb7a8fe0-e64f-44ba-9dab-c78aa8a75011 req-a38aedc3-f3ef-4e57-9804-8089240f45a1 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0520439 Feb 08 18:12:54.231962 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning for port fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb completed by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Feb 08 18:12:54.240635 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:54.241090 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:54.290478 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-8a1b6a41-7583-41f7-80aa-b32dc5b3286e admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:54.359713 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:54.360205 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:54.398813 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd6973742-7d30-4603-8075-2a02f14da9ea', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:12:54.401351 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0bf9ef63-8501-44e6-b725-91b7d661041c" -d '{"events": [{"server_uuid": "d6973742-7d30-4603-8075-2a02f14da9ea", "name": "network-vif-plugged", "status": "completed", "tag": "fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:12:54.414753 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb,segment=NetworkSegment(acdceaea-bf94-4e23-8e9f-0f5d9197e75f),segment_id=acdceaea-bf94-4e23-8e9f-0f5d9197e75f)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:12:54.419511 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:54.420382 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:12:54.464936 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-8a1b6a41-7583-41f7-80aa-b32dc5b3286e admin admin] Publish callbacks [] for security_group (fd578366-f51b-4609-816b-68072f516d14), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:54.472625 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-8a1b6a41-7583-41f7-80aa-b32dc5b3286e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (fd578366-f51b-4609-816b-68072f516d14), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:54.486076 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:12:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-687e024f-8eb8-4570-a7a9-d7034ec6eb30 x-openstack-request-id: req-687e024f-8eb8-4570-a7a9-d7034ec6eb30 {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:12:54.486978 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d6973742-7d30-4603-8075-2a02f14da9ea", "name": "network-vif-plugged", "status": "completed", "tag": "fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:12:54.487373 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-687e024f-8eb8-4570-a7a9-d7034ec6eb30 {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:12:54.487893 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd6973742-7d30-4603-8075-2a02f14da9ea', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb', 'code': 200} Feb 08 18:12:54.529124 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-8a1b6a41-7583-41f7-80aa-b32dc5b3286e admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=4f9364c7bfef429f952e55711e4cd322&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5421710 Feb 08 18:12:54.532109 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 36594) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:54.535079 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:54.556193 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning for port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 completed by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Feb 08 18:12:54.563720 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a1b6a41-7583-41f7-80aa-b32dc5b3286e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fd578366-f51b-4609-816b-68072f516d14,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:54.567422 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:12:54.568049 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:54.600653 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-557d7159-ce85-4ffc-88e8-ce30cca3bbf5 admin admin] Publish callbacks [] for security_group (fd578366-f51b-4609-816b-68072f516d14), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:54.625860 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-557d7159-ce85-4ffc-88e8-ce30cca3bbf5 admin admin] Publish callbacks [] for security_group (fd578366-f51b-4609-816b-68072f516d14), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:54.660442 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:12:54.660836 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:54.701405 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-557d7159-ce85-4ffc-88e8-ce30cca3bbf5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (fd578366-f51b-4609-816b-68072f516d14), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:54.704874 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-557d7159-ce85-4ffc-88e8-ce30cca3bbf5 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:54.706379 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-557d7159-ce85-4ffc-88e8-ce30cca3bbf5 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/fd578366-f51b-4609-816b-68072f516d14 HTTP/1.1" status: 204 len: 168 time: 0.1729071 Feb 08 18:12:54.707934 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:12:54.717984 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-557d7159-ce85-4ffc-88e8-ce30cca3bbf5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fd578366-f51b-4609-816b-68072f516d14,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:54.718242 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:54.803596 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:54.805381 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3a73001-bea7-4bfe-a1ca-c6137cb07770 req-9eb11f6f-fb86-43de-921f-af08fba06ffb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:54.808365 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b3a73001-bea7-4bfe-a1ca-c6137cb07770 req-9eb11f6f-fb86-43de-921f-af08fba06ffb service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 1130 time: 0.0921485 Feb 08 18:12:54.859847 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b3a73001-bea7-4bfe-a1ca-c6137cb07770 req-bb42d572-c5ab-430f-a564-6493c60c7738 service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454819 Feb 08 18:12:54.979331 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5589b0e5-32fa-4a4a-901b-b73566a42da7 req-3cca784a-8768-4276-b5fc-90e5f2963ded tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:54.987138 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5589b0e5-32fa-4a4a-901b-b73566a42da7 req-3cca784a-8768-4276-b5fc-90e5f2963ded tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0841215 Feb 08 18:12:55.007400 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d85024e-9b01-401a-aa48-36706aed2f89 req-6c0096f1-dfd8-4e82-97b7-64ccaec8c016 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:55.009406 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5d85024e-9b01-401a-aa48-36706aed2f89 req-6c0096f1-dfd8-4e82-97b7-64ccaec8c016 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0776136 Feb 08 18:12:55.048767 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5589b0e5-32fa-4a4a-901b-b73566a42da7 req-2aac3b9f-148c-411c-a670-467aaf93ffb3 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0603304 Feb 08 18:12:55.109037 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5d85024e-9b01-401a-aa48-36706aed2f89 req-26ff2cff-844f-4f10-90ed-efe8c3a773bc tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0883601 Feb 08 18:12:55.230940 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 36620) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:55.260825 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a4ea4247-d057-49bf-8e20-511b5ed10e92 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:55.395126 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a4ea4247-d057-49bf-8e20-511b5ed10e92 admin admin] Publish callbacks [] for security_group (a144830d-71a6-449a-a595-d514f8fe7d59), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:55.408672 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96347e41-fb63-4ec6-997f-00df417e1c93 req-b3059ed7-2e0d-4985-92d9-c7c229d5eec2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:55.410613 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-96347e41-fb63-4ec6-997f-00df417e1c93 req-b3059ed7-2e0d-4985-92d9-c7c229d5eec2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0811722 Feb 08 18:12:55.411789 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a4ea4247-d057-49bf-8e20-511b5ed10e92 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (a144830d-71a6-449a-a595-d514f8fe7d59), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:55.455455 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4ea4247-d057-49bf-8e20-511b5ed10e92 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a144830d-71a6-449a-a595-d514f8fe7d59,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:55.483065 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 36630) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:55.483252 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-a4ea4247-d057-49bf-8e20-511b5ed10e92 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=8499a3b213524121b0dc40be4e7c693d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2513776 Feb 08 18:12:55.524132 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-96347e41-fb63-4ec6-997f-00df417e1c93 req-19308162-bb2b-473d-aaff-9f00ff96d250 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0850327 Feb 08 18:12:55.544064 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d7658f30-62aa-4bdd-a227-4960c140ed40 admin admin] Publish callbacks [] for security_group (a144830d-71a6-449a-a595-d514f8fe7d59), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:55.570888 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d7658f30-62aa-4bdd-a227-4960c140ed40 admin admin] Publish callbacks [] for security_group (a144830d-71a6-449a-a595-d514f8fe7d59), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:55.691602 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c10315d-48b3-4ba1-95be-03df143984ed req-1f6b96f1-4015-4233-a1ef-b3d3f942f9c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:55.691602 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8c10315d-48b3-4ba1-95be-03df143984ed req-1f6b96f1-4015-4233-a1ef-b3d3f942f9c8 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=3fb51fc0e23f4c66a482d4d406197299&device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 1129 time: 0.1149700 Feb 08 18:12:55.702645 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f29cbd9e-01ed-457c-9f57-c66f1933693a req-37333bac-8cb0-4653-a0fb-e466eddb6f1a tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:55.705221 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f29cbd9e-01ed-457c-9f57-c66f1933693a req-37333bac-8cb0-4653-a0fb-e466eddb6f1a tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0990508 Feb 08 18:12:55.707662 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d7658f30-62aa-4bdd-a227-4960c140ed40 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (a144830d-71a6-449a-a595-d514f8fe7d59), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:55.710608 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d7658f30-62aa-4bdd-a227-4960c140ed40 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:55.711685 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-d7658f30-62aa-4bdd-a227-4960c140ed40 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/a144830d-71a6-449a-a595-d514f8fe7d59 HTTP/1.1" status: 204 len: 168 time: 0.2275715 Feb 08 18:12:55.764320 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7658f30-62aa-4bdd-a227-4960c140ed40 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a144830d-71a6-449a-a595-d514f8fe7d59,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:55.814444 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f29cbd9e-01ed-457c-9f57-c66f1933693a req-37906eaa-1f61-4cf1-864b-f31df93c2b34 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0949507 Feb 08 18:12:55.840086 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c10315d-48b3-4ba1-95be-03df143984ed req-c60b666b-3270-4ac7-8c4e-af3f103c58c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:55.841581 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8c10315d-48b3-4ba1-95be-03df143984ed req-c60b666b-3270-4ac7-8c4e-af3f103c58c1 service neutron] 10.222.0.109 "GET /v2.0/networks?id=f089911e-72de-4ff6-880b-ac3dd7927165 HTTP/1.1" status: 200 len: 921 time: 0.1352122 Feb 08 18:12:55.886597 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8c10315d-48b3-4ba1-95be-03df143984ed req-fcfec787-74a1-4b3f-9d0d-3d90e830d2f0 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=062ed5c0-df28-461b-87fe-826944e42c54 HTTP/1.1" status: 200 len: 217 time: 0.0377576 Feb 08 18:12:55.936182 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c10315d-48b3-4ba1-95be-03df143984ed req-0c05b8cf-b6ec-43c7-96ce-995b210be729 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:55.938242 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8c10315d-48b3-4ba1-95be-03df143984ed req-0c05b8cf-b6ec-43c7-96ce-995b210be729 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=0af67967-364e-4325-b04f-b7e157c3c3d4 HTTP/1.1" status: 200 len: 859 time: 0.0452275 Feb 08 18:12:55.980353 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8c10315d-48b3-4ba1-95be-03df143984ed req-9fd27ac0-f754-4537-b9c4-54df08c4c64f service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=f089911e-72de-4ff6-880b-ac3dd7927165&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0244415 Feb 08 18:12:56.083877 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8c10315d-48b3-4ba1-95be-03df143984ed req-c85258b5-c461-4a21-9f54-5091bb49f136 service neutron] 10.222.0.109 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0864074 Feb 08 18:12:56.193944 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8c10315d-48b3-4ba1-95be-03df143984ed req-fadd506a-305f-4184-ac1f-6e76ba99921a service neutron] 10.222.0.109 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1034067 Feb 08 18:12:56.200768 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54f80fb2-8260-4f1b-922a-013fa6d13179 req-718ad19c-09ee-4758-931d-cd58ae3b26b4 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:56.208020 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-54f80fb2-8260-4f1b-922a-013fa6d13179 req-718ad19c-09ee-4758-931d-cd58ae3b26b4 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0642049 Feb 08 18:12:56.257003 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-54f80fb2-8260-4f1b-922a-013fa6d13179 req-eb18e752-8b7f-4b1e-902a-d7f15e24b80c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0480967 Feb 08 18:12:56.489632 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:12:56.491980 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1a5d1c68-dc31-4c24-b952-7e3a6a8e24c8" -d '{"events": [{"server_uuid": "75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5", "name": "network-vif-plugged", "status": "completed", "tag": "2f2d1cfd-91ec-450a-bfe2-52d21f9196e8"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:12:56.541658 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:12:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-788c6362-65e8-40c3-b6bc-9f6c4db22a69 x-openstack-request-id: req-788c6362-65e8-40c3-b6bc-9f6c4db22a69 {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:12:56.541658 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5", "name": "network-vif-plugged", "status": "completed", "tag": "2f2d1cfd-91ec-450a-bfe2-52d21f9196e8", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:12:56.541658 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-788c6362-65e8-40c3-b6bc-9f6c4db22a69 {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:12:56.541658 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8', 'code': 200} Feb 08 18:12:56.660816 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d837ced-1acd-4085-9b95-9479e7781999 req-55d37efa-ea68-4fed-922c-0c4c32d00a82 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:56.669138 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5d837ced-1acd-4085-9b95-9479e7781999 req-55d37efa-ea68-4fed-922c-0c4c32d00a82 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0781994 Feb 08 18:12:56.755480 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5d837ced-1acd-4085-9b95-9479e7781999 req-27f74bbe-94bb-4527-9e5a-a89aca4715cc tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0851433 Feb 08 18:12:56.859577 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9b563de-2c89-4494-be8f-1982025b1741 req-01419b98-10b4-4c06-96cd-2ab41a8d326a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:56.861648 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b9b563de-2c89-4494-be8f-1982025b1741 req-01419b98-10b4-4c06-96cd-2ab41a8d326a service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 1129 time: 0.1170197 Feb 08 18:12:56.947000 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f2fe183-b3d2-4c28-b823-7447c48aeed5 req-5b77d6a3-90d8-4d4c-92fa-2939297dc25a tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:56.948538 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5f2fe183-b3d2-4c28-b823-7447c48aeed5 req-5b77d6a3-90d8-4d4c-92fa-2939297dc25a tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.1079590 Feb 08 18:12:56.951610 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b9b563de-2c89-4494-be8f-1982025b1741 req-94cbb070-5541-4882-8196-57a887f443d4 service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0704215 Feb 08 18:12:56.957015 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 36706) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:56.963153 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-4c85d5d3-4631-495b-aaf5-42a4f4918514 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Request body: {'floatingip': {'port_id': 'fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:56.982080 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bc5d781-6ab2-421e-989d-a5817fd5a18e req-02524a64-50a6-43b9-897c-4a7249867a28 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:56.989099 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3bc5d781-6ab2-421e-989d-a5817fd5a18e req-02524a64-50a6-43b9-897c-4a7249867a28 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0715890 Feb 08 18:12:57.046086 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4c85d5d3-4631-495b-aaf5-42a4f4918514 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for floatingip (6ff4a76f-ba78-4441-b8c0-8ae1abf97277), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:57.063466 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3bc5d781-6ab2-421e-989d-a5817fd5a18e req-dba31d43-d878-46c3-bcef-dc06719c9775 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0733993 Feb 08 18:12:57.498662 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48c0d28b-7c73-489d-b908-c746ab6472c7 req-43406ccf-a2cc-4f6a-9ed0-b77eb69ca39e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:57.500242 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-48c0d28b-7c73-489d-b908-c746ab6472c7 req-43406ccf-a2cc-4f6a-9ed0-b77eb69ca39e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.1344402 Feb 08 18:12:57.656886 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-48c0d28b-7c73-489d-b908-c746ab6472c7 req-9339cabf-2494-4d1f-a8e9-cbf4e0a6a514 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1487370 Feb 08 18:12:57.918428 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4c85d5d3-4631-495b-aaf5-42a4f4918514 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:57.922951 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4c85d5d3-4631-495b-aaf5-42a4f4918514 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-560746'] for floatingip (6ff4a76f-ba78-4441-b8c0-8ae1abf97277), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:58.035414 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.l3_db [None req-4c85d5d3-4631-495b-aaf5-42a4f4918514 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Floating IP 6ff4a76f-ba78-4441-b8c0-8ae1abf97277 associated. External IP: 172.27.1.121, port: fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb. Feb 08 18:12:58.171363 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29f8fd09-8a38-4962-87fd-28d0228750b5 req-91c0e361-5dd4-4931-99b5-ac562ae740e2 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:58.174638 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-29f8fd09-8a38-4962-87fd-28d0228750b5 req-91c0e361-5dd4-4931-99b5-ac562ae740e2 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0606468 Feb 08 18:12:58.259428 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-29f8fd09-8a38-4962-87fd-28d0228750b5 req-7f949cc1-5bc5-489b-86fa-7595bf3ca9bc tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0753486 Feb 08 18:12:58.330337 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4c85d5d3-4631-495b-aaf5-42a4f4918514 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:12:58.471693 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4c85d5d3-4631-495b-aaf5-42a4f4918514 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:12:58.477204 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4c85d5d3-4631-495b-aaf5-42a4f4918514 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for floatingip (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:58.488064 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f08eff05-4dc5-44be-82c1-26911b7819bd None None] Sync routers for ids ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'] in dv-cinder-773985-21-iscsi {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:12:58.501369 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f08eff05-4dc5-44be-82c1-26911b7819bd None None] Routers {'3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:12:58.502245 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-f08eff05-4dc5-44be-82c1-26911b7819bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:12:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:58.517895 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-4c85d5d3-4631-495b-aaf5-42a4f4918514 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "PUT /v2.0/floatingips/6ff4a76f-ba78-4441-b8c0-8ae1abf97277 HTTP/1.1" status: 200 len: 992 time: 1.5598145 Feb 08 18:12:58.518634 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd6973742-7d30-4603-8075-2a02f14da9ea', 'tag': 'fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:12:58.520987 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ceae31e3-0c01-42d7-92d6-28a0d07fdac3" -d '{"events": [{"name": "network-changed", "server_uuid": "d6973742-7d30-4603-8075-2a02f14da9ea", "tag": "fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:12:58.586638 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:12:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-de67abee-bd38-4cd9-bec5-a58b3a0f6e5a x-openstack-request-id: req-de67abee-bd38-4cd9-bec5-a58b3a0f6e5a {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:12:58.587106 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d6973742-7d30-4603-8075-2a02f14da9ea", "tag": "fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:12:58.587441 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-de67abee-bd38-4cd9-bec5-a58b3a0f6e5a {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:12:58.587900 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd6973742-7d30-4603-8075-2a02f14da9ea', 'tag': 'fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb', 'status': 'completed', 'code': 200} Feb 08 18:12:58.659587 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-f08eff05-4dc5-44be-82c1-26911b7819bd None None] Set router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:12:58.686085 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4386b734-5ac2-436f-a3e3-a23bce305a77 req-43473b4a-d2d6-45bf-ad53-c27cf1a76ddd tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:58.688036 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4386b734-5ac2-436f-a3e3-a23bce305a77 req-43473b4a-d2d6-45bf-ad53-c27cf1a76ddd tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0991364 Feb 08 18:12:58.719137 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceae31e3-0c01-42d7-92d6-28a0d07fdac3 req-f176f82d-36ed-4958-ba19-0795be738741 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:58.721624 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ceae31e3-0c01-42d7-92d6-28a0d07fdac3 req-f176f82d-36ed-4958-ba19-0795be738741 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=630172c388404c75bda3d0ba2d9d5834&device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 1130 time: 0.1015403 Feb 08 18:12:58.842172 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16220066-fb86-49d8-8fcc-349bb2eb8d28 req-6f20a47a-ae2b-4ca8-aa3d-31c33b789671 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:58.844278 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-16220066-fb86-49d8-8fcc-349bb2eb8d28 req-6f20a47a-ae2b-4ca8-aa3d-31c33b789671 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0735660 Feb 08 18:12:58.905421 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4386b734-5ac2-436f-a3e3-a23bce305a77 req-a881ef15-4212-49a2-863b-8c37e13cd609 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1941648 Feb 08 18:12:58.908978 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceae31e3-0c01-42d7-92d6-28a0d07fdac3 req-30eff8e0-cd77-4057-b66b-9479ef28a133 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:58.910534 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ceae31e3-0c01-42d7-92d6-28a0d07fdac3 req-30eff8e0-cd77-4057-b66b-9479ef28a133 service neutron] 10.222.0.109 "GET /v2.0/networks?id=e430084e-9b28-426f-9937-61346814b135 HTTP/1.1" status: 200 len: 912 time: 0.1744688 Feb 08 18:12:58.926843 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-16220066-fb86-49d8-8fcc-349bb2eb8d28 req-dfdc5e7f-aa59-4e90-b545-9c25a2acdff4 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0760210 Feb 08 18:12:59.012823 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 36806) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:59.054845 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-f08eff05-4dc5-44be-82c1-26911b7819bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'name': 'tempest-AttachVolumeTestJSON-997005721-router', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77'}], 'enable_snat': True}, 'gw_port_id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:23Z', 'revision_number': 4, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'gw_port': {'id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ad:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '6ff4a76f-ba78-4441-b8c0-8ae1abf97277', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'floating_ip_address': '172.27.1.121', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'port_id': 'fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 154, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'mac_address': 'fa:16:3e:65:e3:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd6973742-7d30-4603-8075-2a02f14da9ea', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:12:38Z', 'updated_at': '2022-02-08T18:12:57Z', 'revision_number': 1, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fe9dfbe9-83a8-472c-b3a3-9537d424939b', 'name': '', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'mac_address': 'fa:16:3e:dd:46:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:19Z', 'updated_at': '2022-02-08T18:12:34Z', 'revision_number': 5, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'subnets': [{'id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:59.085746 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f08eff05-4dc5-44be-82c1-26911b7819bd None None] Checking router: 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 for host: dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:12:59.097988 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f08eff05-4dc5-44be-82c1-26911b7819bd None None] Routers {'3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:12:59.098643 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-f08eff05-4dc5-44be-82c1-26911b7819bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:12:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:59.176676 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a1e74688-81d0-4c99-b918-6d412e7a6cae admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:59.247939 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-f08eff05-4dc5-44be-82c1-26911b7819bd None None] Set router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:12:59.279210 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a1e74688-81d0-4c99-b918-6d412e7a6cae admin admin] Publish callbacks [] for security_group (22aca8ef-9889-4d3a-8444-b4fc2accfd81), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:59.284431 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a1e74688-81d0-4c99-b918-6d412e7a6cae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (22aca8ef-9889-4d3a-8444-b4fc2accfd81), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:59.337301 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ceae31e3-0c01-42d7-92d6-28a0d07fdac3 req-88d99108-42c8-4605-8f46-b6e6b1f0c8a1 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb HTTP/1.1" status: 200 len: 1000 time: 0.4087577 Feb 08 18:12:59.342082 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-a1e74688-81d0-4c99-b918-6d412e7a6cae admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=50c0d560096d4c6caefe6c1d43fc09af&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3277593 Feb 08 18:12:59.343515 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 36818) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:59.356443 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1e74688-81d0-4c99-b918-6d412e7a6cae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=22aca8ef-9889-4d3a-8444-b4fc2accfd81,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:59.394094 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee84609d-59fb-4549-a6a1-e9494f7ba7e4 req-08909d10-9776-49f7-bc73-9fc870c5d503 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:59.403033 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ee84609d-59fb-4549-a6a1-e9494f7ba7e4 req-08909d10-9776-49f7-bc73-9fc870c5d503 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0768843 Feb 08 18:12:59.424480 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-003af5b7-52d2-4faf-8f34-9258826c26b6 req-249226c6-e5ce-4660-a68d-d2c4eed72538 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:59.426370 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-003af5b7-52d2-4faf-8f34-9258826c26b6 req-249226c6-e5ce-4660-a68d-d2c4eed72538 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.3607340 Feb 08 18:12:59.438065 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 36824) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:59.441306 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceae31e3-0c01-42d7-92d6-28a0d07fdac3 req-c81ff458-84ee-48aa-826d-d13e0602e794 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:59.442749 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ceae31e3-0c01-42d7-92d6-28a0d07fdac3 req-c81ff458-84ee-48aa-826d-d13e0602e794 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=86592955-e7d0-4e8a-9490-976e17240d7c HTTP/1.1" status: 200 len: 849 time: 0.1000457 Feb 08 18:12:59.447006 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-b3752d38-c0b5-4b97-af14-1bc6c11f08ea tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Request body: {'floatingip': {'port_id': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:12:59.496267 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ee84609d-59fb-4549-a6a1-e9494f7ba7e4 req-d9d1c41b-07ff-4067-a302-907d92e66fec tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0919759 Feb 08 18:12:59.529684 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b3752d38-c0b5-4b97-af14-1bc6c11f08ea tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for floatingip (693198c9-5ae8-4773-8f2e-6a69445aaeef), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:59.534361 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2e27745b-9223-43b4-916a-a686cf92a414 admin admin] Publish callbacks [] for security_group (22aca8ef-9889-4d3a-8444-b4fc2accfd81), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:59.607674 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-f08eff05-4dc5-44be-82c1-26911b7819bd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'name': 'tempest-AttachVolumeTestJSON-997005721-router', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77'}], 'enable_snat': True}, 'gw_port_id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:23Z', 'revision_number': 4, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'gw_port': {'id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ad:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '6ff4a76f-ba78-4441-b8c0-8ae1abf97277', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'floating_ip_address': '172.27.1.121', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'port_id': 'fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 154, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'mac_address': 'fa:16:3e:65:e3:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd6973742-7d30-4603-8075-2a02f14da9ea', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:12:38Z', 'updated_at': '2022-02-08T18:12:57Z', 'revision_number': 1, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fe9dfbe9-83a8-472c-b3a3-9537d424939b', 'name': '', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'mac_address': 'fa:16:3e:dd:46:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:19Z', 'updated_at': '2022-02-08T18:12:34Z', 'revision_number': 5, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'subnets': [{'id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:12:59.627457 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2e27745b-9223-43b4-916a-a686cf92a414 admin admin] Publish callbacks [] for security_group (22aca8ef-9889-4d3a-8444-b4fc2accfd81), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:59.651990 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f08eff05-4dc5-44be-82c1-26911b7819bd None None] The sync data for ids ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'] in dv-cinder-773985-21-iscsi is: [{'id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'name': 'tempest-AttachVolumeTestJSON-997005721-router', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77'}], 'enable_snat': True}, 'gw_port_id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:23Z', 'revision_number': 4, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'gw_port': {'id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ad:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '6ff4a76f-ba78-4441-b8c0-8ae1abf97277', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'floating_ip_address': '172.27.1.121', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'port_id': 'fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb', 'fixed_ip_address': '172.20.0.14', 'status': 'DOWN', 'standard_attr_id': 154, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'mac_address': 'fa:16:3e:65:e3:65', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd6973742-7d30-4603-8075-2a02f14da9ea', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:12:38Z', 'updated_at': '2022-02-08T18:12:57Z', 'revision_number': 1, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fe9dfbe9-83a8-472c-b3a3-9537d424939b', 'name': '', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'mac_address': 'fa:16:3e:dd:46:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:19Z', 'updated_at': '2022-02-08T18:12:34Z', 'revision_number': 5, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'subnets': [{'id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:12:59.661283 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceae31e3-0c01-42d7-92d6-28a0d07fdac3 req-be543fa2-8738-4f49-afeb-f227a1028286 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:12:59.663005 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ceae31e3-0c01-42d7-92d6-28a0d07fdac3 req-be543fa2-8738-4f49-afeb-f227a1028286 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=e430084e-9b28-426f-9937-61346814b135&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.2120354 Feb 08 18:12:59.834421 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 36844) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:12:59.868168 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2e27745b-9223-43b4-916a-a686cf92a414 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (22aca8ef-9889-4d3a-8444-b4fc2accfd81), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:59.870917 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2e27745b-9223-43b4-916a-a686cf92a414 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:12:59.872057 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-2e27745b-9223-43b4-916a-a686cf92a414 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/22aca8ef-9889-4d3a-8444-b4fc2accfd81 HTTP/1.1" status: 204 len: 168 time: 0.5276873 Feb 08 18:12:59.908771 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e27745b-9223-43b4-916a-a686cf92a414 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=22aca8ef-9889-4d3a-8444-b4fc2accfd81,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:12:59.920059 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ceae31e3-0c01-42d7-92d6-28a0d07fdac3 req-7d4e9cfa-fd41-4031-8dbd-57cac814a75a service neutron] 10.222.0.109 "GET /v2.0/networks/e430084e-9b28-426f-9937-61346814b135?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2343454 Feb 08 18:13:00.005226 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a95af64-ca1f-490e-9785-d446bddff84f None None] New status for floating IP 6ff4a76f-ba78-4441-b8c0-8ae1abf97277: ACTIVE {{(pid=102561) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Feb 08 18:13:00.045851 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1e5c67ee-14a0-4f75-90f6-49c3ad09c604 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:00.085763 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ceae31e3-0c01-42d7-92d6-28a0d07fdac3 req-6c544003-aa7d-4d5e-99ce-3f8ffb0e6301 service neutron] 10.222.0.109 "GET /v2.0/networks/e430084e-9b28-426f-9937-61346814b135?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1388087 Feb 08 18:13:00.155573 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1e5c67ee-14a0-4f75-90f6-49c3ad09c604 admin admin] Publish callbacks [] for security_group (afff3d55-7237-4fc1-9623-befd663a6090), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:00.163346 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1e5c67ee-14a0-4f75-90f6-49c3ad09c604 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (afff3d55-7237-4fc1-9623-befd663a6090), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:00.220721 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-1e5c67ee-14a0-4f75-90f6-49c3ad09c604 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=c9fc8bc8575b474e8453a0b9286312e2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3835838 Feb 08 18:13:00.221559 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 36854) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:00.239667 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e5c67ee-14a0-4f75-90f6-49c3ad09c604 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=afff3d55-7237-4fc1-9623-befd663a6090,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:00.309392 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4ce47188-eb2d-4c28-b503-e74f7916b1e4 admin admin] Publish callbacks [] for security_group (afff3d55-7237-4fc1-9623-befd663a6090), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:00.335708 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4ce47188-eb2d-4c28-b503-e74f7916b1e4 admin admin] Publish callbacks [] for security_group (afff3d55-7237-4fc1-9623-befd663a6090), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:00.390284 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4ce47188-eb2d-4c28-b503-e74f7916b1e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (afff3d55-7237-4fc1-9623-befd663a6090), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:00.392794 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4ce47188-eb2d-4c28-b503-e74f7916b1e4 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:00.393938 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-4ce47188-eb2d-4c28-b503-e74f7916b1e4 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/afff3d55-7237-4fc1-9623-befd663a6090 HTTP/1.1" status: 204 len: 168 time: 0.1715295 Feb 08 18:13:00.408766 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ce47188-eb2d-4c28-b503-e74f7916b1e4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=afff3d55-7237-4fc1-9623-befd663a6090,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:00.448063 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bd662e2-13ef-48b0-8b66-d1190b14befb req-df69c419-a6fa-4273-a8a5-7d272e173042 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:00.455809 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1bd662e2-13ef-48b0-8b66-d1190b14befb req-df69c419-a6fa-4273-a8a5-7d272e173042 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.3775375 Feb 08 18:13:00.512236 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b3752d38-c0b5-4b97-af14-1bc6c11f08ea tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:00.533049 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b3752d38-c0b5-4b97-af14-1bc6c11f08ea tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-560746'] for floatingip (693198c9-5ae8-4773-8f2e-6a69445aaeef), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:00.539475 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 36866) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:00.548148 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1bd662e2-13ef-48b0-8b66-d1190b14befb req-ad685026-e20e-48f5-9bb6-de5cce2f3549 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0883203 Feb 08 18:13:00.560769 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9408caf5-6692-461f-b168-26088259ff2e admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:00.774233 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.l3_db [None req-b3752d38-c0b5-4b97-af14-1bc6c11f08ea tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Floating IP 693198c9-5ae8-4773-8f2e-6a69445aaeef associated. External IP: 172.27.1.172, port: 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8. Feb 08 18:13:00.790115 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-655579b6-2d56-4c71-a790-842382131613 req-30335194-3995-4c15-a0c4-ae1bbd2223bb tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:00.797638 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-655579b6-2d56-4c71-a790-842382131613 req-30335194-3995-4c15-a0c4-ae1bbd2223bb tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.1677752 Feb 08 18:13:00.839462 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9408caf5-6692-461f-b168-26088259ff2e admin admin] Publish callbacks [] for security_group (f4490be1-8079-4ebc-9059-70210f208565), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:00.850528 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9408caf5-6692-461f-b168-26088259ff2e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (f4490be1-8079-4ebc-9059-70210f208565), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:00.917926 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-655579b6-2d56-4c71-a790-842382131613 req-c04fecb8-d50f-4a0c-b29b-b2542b9674c1 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1193449 Feb 08 18:13:00.933640 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9408caf5-6692-461f-b168-26088259ff2e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f4490be1-8079-4ebc-9059-70210f208565,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:00.947102 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-9408caf5-6692-461f-b168-26088259ff2e admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=45a6945bc05f42c684e7a2885ac4a794&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4057164 Feb 08 18:13:00.948564 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 36886) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:00.980556 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 36890) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:01.022865 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4ff8d78d-bcf1-43a6-9f55-c73449e28412 admin admin] Publish callbacks [] for security_group (f4490be1-8079-4ebc-9059-70210f208565), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:01.027806 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3574b6c1-0f87-4f88-a879-a95a45a0646f admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:01.054254 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4ff8d78d-bcf1-43a6-9f55-c73449e28412 admin admin] Publish callbacks [] for security_group (f4490be1-8079-4ebc-9059-70210f208565), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:01.117727 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4ff8d78d-bcf1-43a6-9f55-c73449e28412 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (f4490be1-8079-4ebc-9059-70210f208565), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:01.121155 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4ff8d78d-bcf1-43a6-9f55-c73449e28412 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:01.122686 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-4ff8d78d-bcf1-43a6-9f55-c73449e28412 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/f4490be1-8079-4ebc-9059-70210f208565 HTTP/1.1" status: 204 len: 168 time: 0.1721318 Feb 08 18:13:01.128848 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b3752d38-c0b5-4b97-af14-1bc6c11f08ea tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Router 058f0c04-e3de-4d16-8a7a-a7247919133c has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:13:01.135656 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ff8d78d-bcf1-43a6-9f55-c73449e28412 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f4490be1-8079-4ebc-9059-70210f208565,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:01.159796 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3574b6c1-0f87-4f88-a879-a95a45a0646f admin admin] Publish callbacks [] for security_group (a675a80d-4cb1-41d9-86e3-3a40e0f4ff8f), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:01.201692 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3574b6c1-0f87-4f88-a879-a95a45a0646f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (a675a80d-4cb1-41d9-86e3-3a40e0f4ff8f), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:01.258952 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-3574b6c1-0f87-4f88-a879-a95a45a0646f admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=daab3b16c350447a94c96c90c219f3d9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2773073 Feb 08 18:13:01.261642 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 36898) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:01.292673 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3574b6c1-0f87-4f88-a879-a95a45a0646f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a675a80d-4cb1-41d9-86e3-3a40e0f4ff8f,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:01.326246 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 36900) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:01.333283 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b3752d38-c0b5-4b97-af14-1bc6c11f08ea tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:13:01.341302 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b3752d38-c0b5-4b97-af14-1bc6c11f08ea tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for floatingip (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:01.349735 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c79fb8f-cb8b-41ca-9b51-6f14915abb65 None None] Sync routers for ids ['058f0c04-e3de-4d16-8a7a-a7247919133c'] in dv-cinder-773985-21-iscsi {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:13:01.353788 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-16b5428f-0366-4318-80a5-38981e48a1ca admin admin] Publish callbacks [] for security_group (a675a80d-4cb1-41d9-86e3-3a40e0f4ff8f), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:01.361850 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c79fb8f-cb8b-41ca-9b51-6f14915abb65 None None] Routers {'058f0c04-e3de-4d16-8a7a-a7247919133c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:13:01.363692 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-0c79fb8f-cb8b-41ca-9b51-6f14915abb65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:12:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['058f0c04-e3de-4d16-8a7a-a7247919133c'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:13:01.383753 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-b3752d38-c0b5-4b97-af14-1bc6c11f08ea tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "PUT /v2.0/floatingips/693198c9-5ae8-4773-8f2e-6a69445aaeef HTTP/1.1" status: 200 len: 991 time: 1.9439094 Feb 08 18:13:01.386327 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5', 'tag': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:13:01.388922 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-db731eb5-d1ca-4a73-be49-aa9a10287749" -d '{"events": [{"name": "network-changed", "server_uuid": "75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5", "tag": "2f2d1cfd-91ec-450a-bfe2-52d21f9196e8"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:13:01.389609 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-16b5428f-0366-4318-80a5-38981e48a1ca admin admin] Publish callbacks [] for security_group (a675a80d-4cb1-41d9-86e3-3a40e0f4ff8f), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:01.482745 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:13:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-13669e6a-c89d-483b-b3c0-838d1d7b5fd9 x-openstack-request-id: req-13669e6a-c89d-483b-b3c0-838d1d7b5fd9 {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:13:01.483347 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5", "tag": "2f2d1cfd-91ec-450a-bfe2-52d21f9196e8", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:13:01.483347 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-13669e6a-c89d-483b-b3c0-838d1d7b5fd9 {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:13:01.483845 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5', 'tag': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8', 'status': 'completed', 'code': 200} Feb 08 18:13:01.486232 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-16b5428f-0366-4318-80a5-38981e48a1ca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (a675a80d-4cb1-41d9-86e3-3a40e0f4ff8f), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:01.488919 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-16b5428f-0366-4318-80a5-38981e48a1ca admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:01.490071 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-16b5428f-0366-4318-80a5-38981e48a1ca admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/a675a80d-4cb1-41d9-86e3-3a40e0f4ff8f HTTP/1.1" status: 204 len: 168 time: 0.2259054 Feb 08 18:13:01.499825 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16b5428f-0366-4318-80a5-38981e48a1ca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a675a80d-4cb1-41d9-86e3-3a40e0f4ff8f,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:01.555545 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-0c79fb8f-cb8b-41ca-9b51-6f14915abb65 None None] Set router 058f0c04-e3de-4d16-8a7a-a7247919133c gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:13:01.589426 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-accc908f-cb53-4139-9b40-4c3daef9d5bc req-a0679c14-4b43-4143-8140-0d11209cba85 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:01.591195 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-accc908f-cb53-4139-9b40-4c3daef9d5bc req-a0679c14-4b43-4143-8140-0d11209cba85 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.1061587 Feb 08 18:13:01.611382 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db731eb5-d1ca-4a73-be49-aa9a10287749 req-c876224f-2486-42e6-9b96-dcf437627690 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:01.613209 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-db731eb5-d1ca-4a73-be49-aa9a10287749 req-c876224f-2486-42e6-9b96-dcf437627690 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=357dab3d3db74ef9a8ee50fdd8a8bdcd&device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 1129 time: 0.0828524 Feb 08 18:13:01.674057 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5a2a1bcd-d893-4aac-8d92-b51741ddbf45 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:01.740752 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-accc908f-cb53-4139-9b40-4c3daef9d5bc req-cbb33a79-6a9e-439d-978d-640df23c94de tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1383376 Feb 08 18:13:01.772159 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 36916) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:01.780076 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db731eb5-d1ca-4a73-be49-aa9a10287749 req-f6d54a2c-ab89-4cfb-a6fb-f58abf6f8cf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:01.781704 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-db731eb5-d1ca-4a73-be49-aa9a10287749 req-f6d54a2c-ab89-4cfb-a6fb-f58abf6f8cf3 service neutron] 10.222.0.109 "GET /v2.0/networks?id=7a854399-3ce6-42bd-bfc4-061132ecb9c2 HTTP/1.1" status: 200 len: 918 time: 0.1541965 Feb 08 18:13:01.800042 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ba2e5376-25f0-4702-a4a0-ffc3349f98ee admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:01.810878 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf466e50-9aa4-4726-95f2-a9023ee085ff req-7607dd1c-3893-43c0-a4c2-4e8e3ace3271 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:01.818401 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-cf466e50-9aa4-4726-95f2-a9023ee085ff req-7607dd1c-3893-43c0-a4c2-4e8e3ace3271 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.1035547 Feb 08 18:13:01.875740 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-cf466e50-9aa4-4726-95f2-a9023ee085ff req-5e1367cc-f058-4310-8b92-1deaffb47479 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0562501 Feb 08 18:13:01.903268 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-db731eb5-d1ca-4a73-be49-aa9a10287749 req-d42dd7fc-d6da-49d0-bb45-3129de0555d5 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 HTTP/1.1" status: 200 len: 999 time: 0.0925510 Feb 08 18:13:01.910047 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5a2a1bcd-d893-4aac-8d92-b51741ddbf45 admin admin] Publish callbacks [] for security_group (56b8c5af-6f93-4a5c-b0a9-d73a6ec4e701), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:01.916475 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5a2a1bcd-d893-4aac-8d92-b51741ddbf45 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (56b8c5af-6f93-4a5c-b0a9-d73a6ec4e701), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:01.958606 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-5a2a1bcd-d893-4aac-8d92-b51741ddbf45 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=1a774ce7549e439c8cb42b7abcc36ed1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6295366 Feb 08 18:13:01.960795 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 36926) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:02.035756 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a2a1bcd-d893-4aac-8d92-b51741ddbf45 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=56b8c5af-6f93-4a5c-b0a9-d73a6ec4e701,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:02.078998 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db731eb5-d1ca-4a73-be49-aa9a10287749 req-042dd632-f4dc-4e3b-9e25-074ea030b9b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:02.080564 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-db731eb5-d1ca-4a73-be49-aa9a10287749 req-042dd632-f4dc-4e3b-9e25-074ea030b9b9 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=73de7865-d87d-4a2a-a702-160c400f145f HTTP/1.1" status: 200 len: 855 time: 0.1652141 Feb 08 18:13:02.082671 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7694af6a-ff8c-4480-9780-95797b055497 admin admin] Publish callbacks [] for security_group (56b8c5af-6f93-4a5c-b0a9-d73a6ec4e701), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:02.132941 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ba2e5376-25f0-4702-a4a0-ffc3349f98ee admin admin] Publish callbacks [] for security_group (af2e4979-844d-407b-8a03-5b2ca93778ca), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:02.138294 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ba2e5376-25f0-4702-a4a0-ffc3349f98ee admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (af2e4979-844d-407b-8a03-5b2ca93778ca), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:02.140551 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7694af6a-ff8c-4480-9780-95797b055497 admin admin] Publish callbacks [] for security_group (56b8c5af-6f93-4a5c-b0a9-d73a6ec4e701), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:02.171800 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce1f3ea7-5708-4360-9ab2-5edaf77c89f3 req-d4af8eea-dbfe-48cf-b001-13aed42183c0 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:02.173606 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ce1f3ea7-5708-4360-9ab2-5edaf77c89f3 req-d4af8eea-dbfe-48cf-b001-13aed42183c0 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0881562 Feb 08 18:13:02.264088 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ce1f3ea7-5708-4360-9ab2-5edaf77c89f3 req-c40a55f4-4531-49b3-a9a9-97541cd80f38 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0783243 Feb 08 18:13:02.272545 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7694af6a-ff8c-4480-9780-95797b055497 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (56b8c5af-6f93-4a5c-b0a9-d73a6ec4e701), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:02.274986 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-0c79fb8f-cb8b-41ca-9b51-6f14915abb65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'name': 'tempest-AttachVolumeShelveTestJSON-785190803-router', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106'}], 'enable_snat': True}, 'gw_port_id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:11Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'gw_port': {'id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:49:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:14Z', 'updated_at': '2022-02-08T18:12:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '693198c9-5ae8-4773-8f2e-6a69445aaeef', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'floating_ip_address': '172.27.1.172', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'port_id': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 147, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'mac_address': 'fa:16:3e:15:4a:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:12:37Z', 'updated_at': '2022-02-08T18:13:00Z', 'revision_number': 1, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e29130bd-e04d-4042-835b-4ba71dbf114e', 'name': '', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'mac_address': 'fa:16:3e:aa:1e:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '73de7865-d87d-4a2a-a702-160c400f145f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:21Z', 'updated_at': '2022-02-08T18:12:30Z', 'revision_number': 5, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'subnets': [{'id': '73de7865-d87d-4a2a-a702-160c400f145f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:13:02.276908 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7694af6a-ff8c-4480-9780-95797b055497 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:02.282119 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-7694af6a-ff8c-4480-9780-95797b055497 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/56b8c5af-6f93-4a5c-b0a9-d73a6ec4e701 HTTP/1.1" status: 204 len: 168 time: 0.3197618 Feb 08 18:13:02.326500 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7694af6a-ff8c-4480-9780-95797b055497 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=56b8c5af-6f93-4a5c-b0a9-d73a6ec4e701,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:02.327578 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c79fb8f-cb8b-41ca-9b51-6f14915abb65 None None] Checking router: 058f0c04-e3de-4d16-8a7a-a7247919133c for host: dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:13:02.349477 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c79fb8f-cb8b-41ca-9b51-6f14915abb65 None None] Routers {'058f0c04-e3de-4d16-8a7a-a7247919133c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:13:02.350147 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-0c79fb8f-cb8b-41ca-9b51-6f14915abb65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:12:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['058f0c04-e3de-4d16-8a7a-a7247919133c'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:13:02.443981 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-ba2e5376-25f0-4702-a4a0-ffc3349f98ee admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=e8a82220446c43a7b728a435b78097db&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6680300 Feb 08 18:13:02.445636 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 36944) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:02.454745 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba2e5376-25f0-4702-a4a0-ffc3349f98ee admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af2e4979-844d-407b-8a03-5b2ca93778ca,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:02.458922 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db731eb5-d1ca-4a73-be49-aa9a10287749 req-66939cd2-49c8-49f9-b080-4c982157db2c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:02.460536 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-db731eb5-d1ca-4a73-be49-aa9a10287749 req-66939cd2-49c8-49f9-b080-4c982157db2c service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=7a854399-3ce6-42bd-bfc4-061132ecb9c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.3656290 Feb 08 18:13:02.524688 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-637e4444-e15e-4ea8-b689-524371b9a4c9 admin admin] Publish callbacks [] for security_group (af2e4979-844d-407b-8a03-5b2ca93778ca), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:02.541943 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-0c79fb8f-cb8b-41ca-9b51-6f14915abb65 None None] Set router 058f0c04-e3de-4d16-8a7a-a7247919133c gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:13:02.552643 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-637e4444-e15e-4ea8-b689-524371b9a4c9 admin admin] Publish callbacks [] for security_group (af2e4979-844d-407b-8a03-5b2ca93778ca), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:02.632725 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-637e4444-e15e-4ea8-b689-524371b9a4c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (af2e4979-844d-407b-8a03-5b2ca93778ca), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:02.638157 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-637e4444-e15e-4ea8-b689-524371b9a4c9 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:02.643998 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-637e4444-e15e-4ea8-b689-524371b9a4c9 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/af2e4979-844d-407b-8a03-5b2ca93778ca HTTP/1.1" status: 204 len: 168 time: 0.1962388 Feb 08 18:13:02.654699 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-637e4444-e15e-4ea8-b689-524371b9a4c9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af2e4979-844d-407b-8a03-5b2ca93778ca,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:02.655668 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-db731eb5-d1ca-4a73-be49-aa9a10287749 req-d450bc04-5a49-4325-be29-950eab28a97d service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1751897 Feb 08 18:13:02.819742 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-db731eb5-d1ca-4a73-be49-aa9a10287749 req-0c53af78-a691-406b-9d2d-fc5b1b7309c3 service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1389775 Feb 08 18:13:02.894443 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-0c79fb8f-cb8b-41ca-9b51-6f14915abb65 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'name': 'tempest-AttachVolumeShelveTestJSON-785190803-router', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106'}], 'enable_snat': True}, 'gw_port_id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:11Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'gw_port': {'id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:49:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:14Z', 'updated_at': '2022-02-08T18:12:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '693198c9-5ae8-4773-8f2e-6a69445aaeef', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'floating_ip_address': '172.27.1.172', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'port_id': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 147, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'mac_address': 'fa:16:3e:15:4a:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:12:37Z', 'updated_at': '2022-02-08T18:13:00Z', 'revision_number': 1, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e29130bd-e04d-4042-835b-4ba71dbf114e', 'name': '', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'mac_address': 'fa:16:3e:aa:1e:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '73de7865-d87d-4a2a-a702-160c400f145f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:21Z', 'updated_at': '2022-02-08T18:12:30Z', 'revision_number': 5, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'subnets': [{'id': '73de7865-d87d-4a2a-a702-160c400f145f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:13:02.931137 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c79fb8f-cb8b-41ca-9b51-6f14915abb65 None None] The sync data for ids ['058f0c04-e3de-4d16-8a7a-a7247919133c'] in dv-cinder-773985-21-iscsi is: [{'id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'name': 'tempest-AttachVolumeShelveTestJSON-785190803-router', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106'}], 'enable_snat': True}, 'gw_port_id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:11Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'gw_port': {'id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:49:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:14Z', 'updated_at': '2022-02-08T18:12:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '693198c9-5ae8-4773-8f2e-6a69445aaeef', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'floating_ip_address': '172.27.1.172', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'port_id': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 147, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'mac_address': 'fa:16:3e:15:4a:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:12:37Z', 'updated_at': '2022-02-08T18:13:00Z', 'revision_number': 1, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e29130bd-e04d-4042-835b-4ba71dbf114e', 'name': '', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'mac_address': 'fa:16:3e:aa:1e:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '73de7865-d87d-4a2a-a702-160c400f145f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:21Z', 'updated_at': '2022-02-08T18:12:30Z', 'revision_number': 5, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'subnets': [{'id': '73de7865-d87d-4a2a-a702-160c400f145f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:13:02.973199 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc6a71f6-e9c7-4144-bc6f-7b2a894ab341 req-e43b5bcd-b171-44a9-afca-e9b244657558 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:02.980133 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-bc6a71f6-e9c7-4144-bc6f-7b2a894ab341 req-e43b5bcd-b171-44a9-afca-e9b244657558 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.1100779 Feb 08 18:13:03.038414 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-bc6a71f6-e9c7-4144-bc6f-7b2a894ab341 req-e52894b7-7018-4830-bea9-facc3c3423cc tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0573795 Feb 08 18:13:03.137141 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 36974) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:03.158370 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b087074b-e0ef-4724-855d-9a0c5811287c admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:03.255396 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e4ebc238-c2d6-491d-849e-d8224ee438af None None] New status for floating IP 693198c9-5ae8-4773-8f2e-6a69445aaeef: ACTIVE {{(pid=102561) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Feb 08 18:13:03.288517 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b087074b-e0ef-4724-855d-9a0c5811287c admin admin] Publish callbacks [] for security_group (cc563a1d-2b2f-4a30-9e06-b9e241bbbd90), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:03.300816 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b087074b-e0ef-4724-855d-9a0c5811287c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (cc563a1d-2b2f-4a30-9e06-b9e241bbbd90), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:03.426252 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-b087074b-e0ef-4724-855d-9a0c5811287c admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=7611f6681dc24637ab3bf064dc361ebb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2876174 Feb 08 18:13:03.429124 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 36988) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:03.447752 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b087074b-e0ef-4724-855d-9a0c5811287c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cc563a1d-2b2f-4a30-9e06-b9e241bbbd90,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:03.538359 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9ae22557-d40b-495e-9080-627e3f6400c1 admin admin] Publish callbacks [] for security_group (cc563a1d-2b2f-4a30-9e06-b9e241bbbd90), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:03.545246 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bb7f900-cf24-4018-927d-ea296d867b95 req-c7ff50f3-9c95-4846-bb70-88649d4b7d6b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:03.546871 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5bb7f900-cf24-4018-927d-ea296d867b95 req-c7ff50f3-9c95-4846-bb70-88649d4b7d6b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.1605897 Feb 08 18:13:03.602695 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9ae22557-d40b-495e-9080-627e3f6400c1 admin admin] Publish callbacks [] for security_group (cc563a1d-2b2f-4a30-9e06-b9e241bbbd90), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:03.637491 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5bb7f900-cf24-4018-927d-ea296d867b95 req-51c2ea53-d683-4785-9477-9533ef5cc9c8 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0831127 Feb 08 18:13:03.723781 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffa4911b-87f1-4493-9900-2052d84bbd37 req-9033529e-b084-47ec-8004-779726101b13 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:03.725314 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ffa4911b-87f1-4493-9900-2052d84bbd37 req-9033529e-b084-47ec-8004-779726101b13 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 945 time: 0.0809302 Feb 08 18:13:03.726416 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9ae22557-d40b-495e-9080-627e3f6400c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (cc563a1d-2b2f-4a30-9e06-b9e241bbbd90), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:03.729459 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9ae22557-d40b-495e-9080-627e3f6400c1 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:03.730798 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-9ae22557-d40b-495e-9080-627e3f6400c1 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/cc563a1d-2b2f-4a30-9e06-b9e241bbbd90 HTTP/1.1" status: 204 len: 168 time: 0.2996633 Feb 08 18:13:03.741882 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 37002) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:03.752576 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ae22557-d40b-495e-9080-627e3f6400c1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc563a1d-2b2f-4a30-9e06-b9e241bbbd90,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:03.790443 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ffa4911b-87f1-4493-9900-2052d84bbd37 req-44dec98b-9240-4019-871d-e3b06289a0e5 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/security-groups?id=a70d7f73-fc20-4c96-ba3a-f48a3d3736a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0584388 Feb 08 18:13:03.984183 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e966a195-6d79-456d-9b79-978582586bdb admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:04.112330 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e966a195-6d79-456d-9b79-978582586bdb admin admin] Publish callbacks [] for security_group (868402b2-20fd-4899-a90e-ffc0b09f5ee8), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:04.118008 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e966a195-6d79-456d-9b79-978582586bdb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (868402b2-20fd-4899-a90e-ffc0b09f5ee8), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:04.191231 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 37028) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:04.204998 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4af1661e-b096-4ed3-a41b-58560ae87a44 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:04.215102 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-e966a195-6d79-456d-9b79-978582586bdb admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=7325ec33ac624906af3843116969c9fb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4692130 Feb 08 18:13:04.215724 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 37030) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:04.218295 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e966a195-6d79-456d-9b79-978582586bdb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=868402b2-20fd-4899-a90e-ffc0b09f5ee8,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:04.245712 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9afe009-46f5-480b-934d-c899c1ad73b1 req-b5ceca1f-fee8-4e8c-a50d-df84b819752e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:04.247237 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a9afe009-46f5-480b-934d-c899c1ad73b1 req-b5ceca1f-fee8-4e8c-a50d-df84b819752e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0948081 Feb 08 18:13:04.302166 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a9afe009-46f5-480b-934d-c899c1ad73b1 req-edf890d5-596e-4ab4-bee6-e6374f761667 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0475850 Feb 08 18:13:04.336763 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-2aa57063-f6eb-4252-b25e-19463caf5c9a admin admin] Publish callbacks [] for security_group (868402b2-20fd-4899-a90e-ffc0b09f5ee8), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:04.376406 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-2aa57063-f6eb-4252-b25e-19463caf5c9a admin admin] Publish callbacks [] for security_group (868402b2-20fd-4899-a90e-ffc0b09f5ee8), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:04.426225 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4af1661e-b096-4ed3-a41b-58560ae87a44 admin admin] Publish callbacks [] for security_group (db629a5f-5996-4116-b803-1874bf30229a), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:04.434016 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4af1661e-b096-4ed3-a41b-58560ae87a44 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (db629a5f-5996-4116-b803-1874bf30229a), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:04.479123 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4af1661e-b096-4ed3-a41b-58560ae87a44 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=db629a5f-5996-4116-b803-1874bf30229a,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:04.484076 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-4af1661e-b096-4ed3-a41b-58560ae87a44 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=00af6f17a5bf4953a955853f24b69341&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2917933 Feb 08 18:13:04.485550 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-2aa57063-f6eb-4252-b25e-19463caf5c9a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (868402b2-20fd-4899-a90e-ffc0b09f5ee8), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:04.488217 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 37048) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:04.488502 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-2aa57063-f6eb-4252-b25e-19463caf5c9a admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:04.492401 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-2aa57063-f6eb-4252-b25e-19463caf5c9a admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/868402b2-20fd-4899-a90e-ffc0b09f5ee8 HTTP/1.1" status: 204 len: 168 time: 0.2757392 Feb 08 18:13:04.500376 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2aa57063-f6eb-4252-b25e-19463caf5c9a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=868402b2-20fd-4899-a90e-ffc0b09f5ee8,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:04.561728 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d5c02c35-669d-4411-a1ad-f535544d1ca0 admin admin] Publish callbacks [] for security_group (db629a5f-5996-4116-b803-1874bf30229a), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:04.589482 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d5c02c35-669d-4411-a1ad-f535544d1ca0 admin admin] Publish callbacks [] for security_group (db629a5f-5996-4116-b803-1874bf30229a), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:04.661475 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d5c02c35-669d-4411-a1ad-f535544d1ca0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (db629a5f-5996-4116-b803-1874bf30229a), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:04.663849 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d5c02c35-669d-4411-a1ad-f535544d1ca0 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:04.665339 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-d5c02c35-669d-4411-a1ad-f535544d1ca0 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/db629a5f-5996-4116-b803-1874bf30229a HTTP/1.1" status: 204 len: 168 time: 0.1747925 Feb 08 18:13:04.677647 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5c02c35-669d-4411-a1ad-f535544d1ca0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=db629a5f-5996-4116-b803-1874bf30229a,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:04.883733 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b25d8e21-a6f6-4669-8087-fd24584a4b99 req-5a82466d-0018-4520-ad33-9fa80d8f0ced tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:04.886265 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b25d8e21-a6f6-4669-8087-fd24584a4b99 req-5a82466d-0018-4520-ad33-9fa80d8f0ced tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.1150908 Feb 08 18:13:04.942364 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9acfbdd-ecc2-41dd-a323-f16e294a6ca7 req-7a1b89de-ad9e-4ea8-ba84-bf5fbe7fa166 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:04.950563 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d9acfbdd-ecc2-41dd-a323-f16e294a6ca7 req-7a1b89de-ad9e-4ea8-ba84-bf5fbe7fa166 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 945 time: 0.0749876 Feb 08 18:13:04.955425 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b25d8e21-a6f6-4669-8087-fd24584a4b99 req-6053c6fa-1918-4488-b329-d3ddb686e581 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0592339 Feb 08 18:13:05.019074 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d9acfbdd-ecc2-41dd-a323-f16e294a6ca7 req-7f1bf325-df57-4888-84e8-68bbffcdfc90 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/security-groups?id=a70d7f73-fc20-4c96-ba3a-f48a3d3736a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0674055 Feb 08 18:13:05.643962 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b68f6ede-a05d-4d6c-a22d-417f2db179c1 req-ec5f4620-7eb7-415a-bf3b-0c2ad5901b05 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:05.645461 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b68f6ede-a05d-4d6c-a22d-417f2db179c1 req-ec5f4620-7eb7-415a-bf3b-0c2ad5901b05 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.109 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 945 time: 0.0734828 Feb 08 18:13:05.830934 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-b68f6ede-a05d-4d6c-a22d-417f2db179c1 req-17ab21b5-7764-4df7-9362-0a3da5621d56 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Deleting port 02c57200-9a7e-48d7-947f-7ed959af8662 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:13:05.831295 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-b68f6ede-a05d-4d6c-a22d-417f2db179c1 req-17ab21b5-7764-4df7-9362-0a3da5621d56 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (02c57200-9a7e-48d7-947f-7ed959af8662), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:05.913127 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 37148) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:05.936348 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-b68f6ede-a05d-4d6c-a22d-417f2db179c1 req-17ab21b5-7764-4df7-9362-0a3da5621d56 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] For port 02c57200-9a7e-48d7-947f-7ed959af8662, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=02c57200-9a7e-48d7-947f-7ed959af8662,segment=NetworkSegment(36b36f15-bf90-46bb-ac3a-109acbbc7fd3),segment_id=36b36f15-bf90-46bb-ac3a-109acbbc7fd3)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:13:05.936716 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-b68f6ede-a05d-4d6c-a22d-417f2db179c1 req-17ab21b5-7764-4df7-9362-0a3da5621d56 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (02c57200-9a7e-48d7-947f-7ed959af8662), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:05.951864 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-b68f6ede-a05d-4d6c-a22d-417f2db179c1 req-17ab21b5-7764-4df7-9362-0a3da5621d56 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Calling delete_port for 02c57200-9a7e-48d7-947f-7ed959af8662 owned by compute:nova {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:13:06.116265 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4ffd5d0-199f-4df9-9d0c-bc81b1fb8424 req-7ce9c90e-77bb-495a-b84c-f8cefb3e9ece tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:06.117844 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c4ffd5d0-199f-4df9-9d0c-bc81b1fb8424 req-7ce9c90e-77bb-495a-b84c-f8cefb3e9ece tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0775256 Feb 08 18:13:06.187467 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0f877d89-3c08-4de0-bf06-e85e54c928b6 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:06.207912 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81857c5f-9a74-422b-8505-996104697151 req-680c2146-6c3f-4748-bbcb-1b724e4de51a tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:06.210517 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-81857c5f-9a74-422b-8505-996104697151 req-680c2146-6c3f-4748-bbcb-1b724e4de51a tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 945 time: 0.0799570 Feb 08 18:13:06.241535 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-b68f6ede-a05d-4d6c-a22d-417f2db179c1 req-17ab21b5-7764-4df7-9362-0a3da5621d56 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (02c57200-9a7e-48d7-947f-7ed959af8662), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:06.254642 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['02c57200-9a7e-48d7-947f-7ed959af8662'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:13:06.269889 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c4ffd5d0-199f-4df9-9d0c-bc81b1fb8424 req-54228979-5d3d-4896-8680-05f9f4a0de25 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1230342 Feb 08 18:13:06.311806 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17ab21b5-7764-4df7-9362-0a3da5621d56 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Pushing event deleted for resources: {'Port': ['ID=02c57200-9a7e-48d7-947f-7ed959af8662,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:06.333243 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-81857c5f-9a74-422b-8505-996104697151 req-1e7fd84f-3827-4605-8bdf-efb8568a68d9 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/security-groups?id=a70d7f73-fc20-4c96-ba3a-f48a3d3736a6&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1157157 Feb 08 18:13:06.414913 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [req-b68f6ede-a05d-4d6c-a22d-417f2db179c1 req-17ab21b5-7764-4df7-9362-0a3da5621d56 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] No DVR routers for this DVR port 02c57200-9a7e-48d7-947f-7ed959af8662 on host hv-cinder-77398 {{(pid=102560) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:13:06.425024 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-b68f6ede-a05d-4d6c-a22d-417f2db179c1 req-17ab21b5-7764-4df7-9362-0a3da5621d56 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:06.429879 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b68f6ede-a05d-4d6c-a22d-417f2db179c1 req-17ab21b5-7764-4df7-9362-0a3da5621d56 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.109 "DELETE /v2.0/ports/02c57200-9a7e-48d7-947f-7ed959af8662 HTTP/1.1" status: 204 len: 173 time: 0.7778711 Feb 08 18:13:06.430515 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6447fbdb-9f53-4284-ab18-211e412243c0', 'name': 'network-vif-deleted', 'tag': '02c57200-9a7e-48d7-947f-7ed959af8662'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:13:06.444837 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4ed2b102-8be1-45b6-b1ba-b62b8e26b818" -d '{"events": [{"server_uuid": "6447fbdb-9f53-4284-ab18-211e412243c0", "name": "network-vif-deleted", "tag": "02c57200-9a7e-48d7-947f-7ed959af8662"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:13:06.485519 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0f877d89-3c08-4de0-bf06-e85e54c928b6 admin admin] Publish callbacks [] for security_group (a88120c4-c86c-49a2-b77d-08fab8aa9ff1), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:06.496186 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 37172) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:06.515112 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:13:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4c023514-9784-4f37-9a1c-11b573f02009 x-openstack-request-id: req-4c023514-9784-4f37-9a1c-11b573f02009 {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:13:06.520968 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6447fbdb-9f53-4284-ab18-211e412243c0", "name": "network-vif-deleted", "tag": "02c57200-9a7e-48d7-947f-7ed959af8662", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:13:06.521516 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-4c023514-9784-4f37-9a1c-11b573f02009 {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:13:06.521940 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6447fbdb-9f53-4284-ab18-211e412243c0', 'name': 'network-vif-deleted', 'tag': '02c57200-9a7e-48d7-947f-7ed959af8662', 'status': 'completed', 'code': 200} Feb 08 18:13:06.523416 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0f877d89-3c08-4de0-bf06-e85e54c928b6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (a88120c4-c86c-49a2-b77d-08fab8aa9ff1), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:06.582057 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 37178) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:06.585983 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-0f877d89-3c08-4de0-bf06-e85e54c928b6 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=8115b428a8074d45905dba6aaf16bca7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6713955 Feb 08 18:13:06.592363 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f877d89-3c08-4de0-bf06-e85e54c928b6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a88120c4-c86c-49a2-b77d-08fab8aa9ff1,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:06.633299 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-47fd7411-e9da-445a-97b6-9c45a6d71596 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:06.658161 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9a03aa6d-6547-47b7-be69-e7351aa265ec admin admin] Publish callbacks [] for security_group (a88120c4-c86c-49a2-b77d-08fab8aa9ff1), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:06.694813 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9a03aa6d-6547-47b7-be69-e7351aa265ec admin admin] Publish callbacks [] for security_group (a88120c4-c86c-49a2-b77d-08fab8aa9ff1), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:06.776336 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-47fd7411-e9da-445a-97b6-9c45a6d71596 admin admin] Publish callbacks [] for security_group (2e97fff2-223d-4a08-a071-654acfa2acde), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:06.782446 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-47fd7411-e9da-445a-97b6-9c45a6d71596 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (2e97fff2-223d-4a08-a071-654acfa2acde), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:06.789337 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9a03aa6d-6547-47b7-be69-e7351aa265ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (a88120c4-c86c-49a2-b77d-08fab8aa9ff1), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:06.792350 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9a03aa6d-6547-47b7-be69-e7351aa265ec admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:06.793321 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-9a03aa6d-6547-47b7-be69-e7351aa265ec admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/a88120c4-c86c-49a2-b77d-08fab8aa9ff1 HTTP/1.1" status: 204 len: 168 time: 0.2127075 Feb 08 18:13:06.836633 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47fd7411-e9da-445a-97b6-9c45a6d71596 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2e97fff2-223d-4a08-a071-654acfa2acde,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:06.843366 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-47fd7411-e9da-445a-97b6-9c45a6d71596 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=1eb85005e1bf4c05981ec16361197062&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3458405 Feb 08 18:13:06.846017 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 37190) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:06.853095 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a03aa6d-6547-47b7-be69-e7351aa265ec admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a88120c4-c86c-49a2-b77d-08fab8aa9ff1,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:06.956878 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b798c262-be53-470a-83c1-9349bf8af767 admin admin] Publish callbacks [] for security_group (2e97fff2-223d-4a08-a071-654acfa2acde), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:06.982112 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b798c262-be53-470a-83c1-9349bf8af767 admin admin] Publish callbacks [] for security_group (2e97fff2-223d-4a08-a071-654acfa2acde), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:07.059862 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b798c262-be53-470a-83c1-9349bf8af767 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (2e97fff2-223d-4a08-a071-654acfa2acde), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:07.063980 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b798c262-be53-470a-83c1-9349bf8af767 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:07.065144 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-b798c262-be53-470a-83c1-9349bf8af767 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/2e97fff2-223d-4a08-a071-654acfa2acde HTTP/1.1" status: 204 len: 168 time: 0.2125020 Feb 08 18:13:07.076187 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b798c262-be53-470a-83c1-9349bf8af767 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2e97fff2-223d-4a08-a071-654acfa2acde,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:07.201384 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 37202) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:07.215915 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-37625d49-1efe-41c8-aa8f-56afa30468b3 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:07.321631 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-37625d49-1efe-41c8-aa8f-56afa30468b3 admin admin] Publish callbacks [] for security_group (0f568f29-3241-45cd-a0ac-f8d2f219bea8), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:07.326473 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-37625d49-1efe-41c8-aa8f-56afa30468b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (0f568f29-3241-45cd-a0ac-f8d2f219bea8), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:07.404875 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37625d49-1efe-41c8-aa8f-56afa30468b3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0f568f29-3241-45cd-a0ac-f8d2f219bea8,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:07.434146 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3bc752b-a450-4ec9-b8ad-8e0cdc52d2da req-96a601ca-46fc-416b-b887-40fd133a9729 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:07.442426 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d3bc752b-a450-4ec9-b8ad-8e0cdc52d2da req-96a601ca-46fc-416b-b887-40fd133a9729 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0992570 Feb 08 18:13:07.442703 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-37625d49-1efe-41c8-aa8f-56afa30468b3 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=a275e600738940d7bbc375e5ff284268&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2401125 Feb 08 18:13:07.443405 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 37218) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:07.519278 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d3bc752b-a450-4ec9-b8ad-8e0cdc52d2da req-7c25c7d0-dd40-4d2e-a175-29184f3aa4b4 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0753720 Feb 08 18:13:07.569654 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-acb2031f-6efc-49e4-ba30-e41c4b1dae81 admin admin] Publish callbacks [] for security_group (0f568f29-3241-45cd-a0ac-f8d2f219bea8), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:07.589036 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ba47eb55-e926-4900-8421-47c0699b2908 req-07908079-4918-4e33-9673-3f00aade5942 tempest-DeleteServersTestJSON-846608340 tempest-DeleteServersTestJSON-846608340-project] 10.222.0.118 "GET /v2.0/ports?device_id=6447fbdb-9f53-4284-ab18-211e412243c0 HTTP/1.1" status: 200 len: 210 time: 0.0379946 Feb 08 18:13:07.600007 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 37226) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:07.614848 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-62748e39-bdb1-4a3c-879c-c2b7e032bbb6 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:07.635363 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-acb2031f-6efc-49e4-ba30-e41c4b1dae81 admin admin] Publish callbacks [] for security_group (0f568f29-3241-45cd-a0ac-f8d2f219bea8), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:07.719297 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-62748e39-bdb1-4a3c-879c-c2b7e032bbb6 admin admin] Publish callbacks [] for security_group (83875e10-97c3-4694-b37a-ed81c1f3d74c), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:07.720347 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-acb2031f-6efc-49e4-ba30-e41c4b1dae81 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (0f568f29-3241-45cd-a0ac-f8d2f219bea8), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:07.723568 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-acb2031f-6efc-49e4-ba30-e41c4b1dae81 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:07.725173 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-acb2031f-6efc-49e4-ba30-e41c4b1dae81 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/0f568f29-3241-45cd-a0ac-f8d2f219bea8 HTTP/1.1" status: 204 len: 168 time: 0.2809010 Feb 08 18:13:07.725770 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-62748e39-bdb1-4a3c-879c-c2b7e032bbb6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (83875e10-97c3-4694-b37a-ed81c1f3d74c), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:07.741405 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acb2031f-6efc-49e4-ba30-e41c4b1dae81 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0f568f29-3241-45cd-a0ac-f8d2f219bea8,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:07.749743 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acb2031f-6efc-49e4-ba30-e41c4b1dae81 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.750343 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acb2031f-6efc-49e4-ba30-e41c4b1dae81 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.751237 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acb2031f-6efc-49e4-ba30-e41c4b1dae81 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.751846 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acb2031f-6efc-49e4-ba30-e41c4b1dae81 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.752363 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acb2031f-6efc-49e4-ba30-e41c4b1dae81 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.752840 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acb2031f-6efc-49e4-ba30-e41c4b1dae81 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.753354 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acb2031f-6efc-49e4-ba30-e41c4b1dae81 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.753916 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acb2031f-6efc-49e4-ba30-e41c4b1dae81 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.754397 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acb2031f-6efc-49e4-ba30-e41c4b1dae81 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.755037 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acb2031f-6efc-49e4-ba30-e41c4b1dae81 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.755526 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acb2031f-6efc-49e4-ba30-e41c4b1dae81 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.755993 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acb2031f-6efc-49e4-ba30-e41c4b1dae81 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.756761 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-acb2031f-6efc-49e4-ba30-e41c4b1dae81 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.760185 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62748e39-bdb1-4a3c-879c-c2b7e032bbb6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=83875e10-97c3-4694-b37a-ed81c1f3d74c,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:07.791835 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62748e39-bdb1-4a3c-879c-c2b7e032bbb6 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.792179 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62748e39-bdb1-4a3c-879c-c2b7e032bbb6 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.792511 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62748e39-bdb1-4a3c-879c-c2b7e032bbb6 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.792903 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62748e39-bdb1-4a3c-879c-c2b7e032bbb6 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.793151 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62748e39-bdb1-4a3c-879c-c2b7e032bbb6 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.793472 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62748e39-bdb1-4a3c-879c-c2b7e032bbb6 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.793802 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62748e39-bdb1-4a3c-879c-c2b7e032bbb6 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.794122 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62748e39-bdb1-4a3c-879c-c2b7e032bbb6 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.794456 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62748e39-bdb1-4a3c-879c-c2b7e032bbb6 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.794752 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62748e39-bdb1-4a3c-879c-c2b7e032bbb6 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.795599 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62748e39-bdb1-4a3c-879c-c2b7e032bbb6 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.795934 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62748e39-bdb1-4a3c-879c-c2b7e032bbb6 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.796248 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-62748e39-bdb1-4a3c-879c-c2b7e032bbb6 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:07.824807 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-62748e39-bdb1-4a3c-879c-c2b7e032bbb6 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=2bfdc8d40ed747d391eae79c58feb677&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2235253 Feb 08 18:13:07.827352 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 37232) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:07.882035 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-602c5f11-95ad-4056-866b-aa74c3a698eb admin admin] Publish callbacks [] for security_group (83875e10-97c3-4694-b37a-ed81c1f3d74c), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:07.909846 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-602c5f11-95ad-4056-866b-aa74c3a698eb admin admin] Publish callbacks [] for security_group (83875e10-97c3-4694-b37a-ed81c1f3d74c), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:07.964174 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-602c5f11-95ad-4056-866b-aa74c3a698eb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (83875e10-97c3-4694-b37a-ed81c1f3d74c), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:07.966890 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-602c5f11-95ad-4056-866b-aa74c3a698eb admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:07.970539 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-602c5f11-95ad-4056-866b-aa74c3a698eb admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/83875e10-97c3-4694-b37a-ed81c1f3d74c HTTP/1.1" status: 204 len: 168 time: 0.1396713 Feb 08 18:13:07.976956 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-602c5f11-95ad-4056-866b-aa74c3a698eb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=83875e10-97c3-4694-b37a-ed81c1f3d74c,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:08.171384 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 37244) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:08.184985 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1cc152e0-e676-456a-b77f-efecc233e6db admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:08.265231 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1cc152e0-e676-456a-b77f-efecc233e6db admin admin] Publish callbacks [] for security_group (d8c516e9-bbee-4fac-b0e9-d1177c850550), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:08.270104 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1cc152e0-e676-456a-b77f-efecc233e6db admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (d8c516e9-bbee-4fac-b0e9-d1177c850550), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:08.310820 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-1cc152e0-e676-456a-b77f-efecc233e6db admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=f443068b87c54208adb8070f20a1c826&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1359799 Feb 08 18:13:08.310820 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cc152e0-e676-456a-b77f-efecc233e6db admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d8c516e9-bbee-4fac-b0e9-d1177c850550,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:08.311578 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 37250) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:08.361664 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-acd6258e-95ab-4162-bf53-12483a667904 admin admin] Publish callbacks [] for security_group (d8c516e9-bbee-4fac-b0e9-d1177c850550), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:08.388563 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-acd6258e-95ab-4162-bf53-12483a667904 admin admin] Publish callbacks [] for security_group (d8c516e9-bbee-4fac-b0e9-d1177c850550), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:08.438898 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-acd6258e-95ab-4162-bf53-12483a667904 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (d8c516e9-bbee-4fac-b0e9-d1177c850550), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:08.441590 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-acd6258e-95ab-4162-bf53-12483a667904 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:08.442812 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-acd6258e-95ab-4162-bf53-12483a667904 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/d8c516e9-bbee-4fac-b0e9-d1177c850550 HTTP/1.1" status: 204 len: 168 time: 0.1302309 Feb 08 18:13:08.450359 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acd6258e-95ab-4162-bf53-12483a667904 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d8c516e9-bbee-4fac-b0e9-d1177c850550,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:08.643126 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f18fb9f-bb18-43ae-ae55-1af6d61c4fd6 req-100d4df5-9c8e-495a-ae57-5fa4757c80d6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:08.644708 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8f18fb9f-bb18-43ae-ae55-1af6d61c4fd6 req-100d4df5-9c8e-495a-ae57-5fa4757c80d6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0576389 Feb 08 18:13:08.740897 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8f18fb9f-bb18-43ae-ae55-1af6d61c4fd6 req-4f8da962-fe9e-4880-a0aa-e1d7f96b845a tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0839953 Feb 08 18:13:09.293826 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 37316) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:09.396454 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c1c7d7c8-313a-4758-b073-f36600d4568c admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:09.470423 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c1c7d7c8-313a-4758-b073-f36600d4568c admin admin] Publish callbacks [] for security_group (b022e5ee-bede-4e2c-be70-fda3a23cb33d), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:09.474919 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c1c7d7c8-313a-4758-b073-f36600d4568c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (b022e5ee-bede-4e2c-be70-fda3a23cb33d), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:09.511849 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-c1c7d7c8-313a-4758-b073-f36600d4568c admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=f7d175d5d2934d21873fab27d2f67759&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2169211 Feb 08 18:13:09.512931 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1c7d7c8-313a-4758-b073-f36600d4568c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b022e5ee-bede-4e2c-be70-fda3a23cb33d,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:09.514662 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 37320) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:09.567911 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-cae59727-c8ca-4d15-b2f3-32ed55ea93ba admin admin] Publish callbacks [] for security_group (b022e5ee-bede-4e2c-be70-fda3a23cb33d), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:09.592747 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-cae59727-c8ca-4d15-b2f3-32ed55ea93ba admin admin] Publish callbacks [] for security_group (b022e5ee-bede-4e2c-be70-fda3a23cb33d), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:09.656237 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-cae59727-c8ca-4d15-b2f3-32ed55ea93ba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (b022e5ee-bede-4e2c-be70-fda3a23cb33d), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:09.658874 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-cae59727-c8ca-4d15-b2f3-32ed55ea93ba admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:09.660110 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-cae59727-c8ca-4d15-b2f3-32ed55ea93ba admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/b022e5ee-bede-4e2c-be70-fda3a23cb33d HTTP/1.1" status: 204 len: 168 time: 0.1437433 Feb 08 18:13:09.668088 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cae59727-c8ca-4d15-b2f3-32ed55ea93ba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b022e5ee-bede-4e2c-be70-fda3a23cb33d,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:09.854822 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b15cbc5-a6eb-4b20-a541-c2337f7db7df req-ea7c5768-dc64-401d-ab14-26ca029cd60c tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:09.856336 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5b15cbc5-a6eb-4b20-a541-c2337f7db7df req-ea7c5768-dc64-401d-ab14-26ca029cd60c tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0583098 Feb 08 18:13:09.908480 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5b15cbc5-a6eb-4b20-a541-c2337f7db7df req-0014b6fe-dcc1-442c-8fda-1625166232c2 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461338 Feb 08 18:13:10.853324 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 02c57200-9a7e-48d7-947f-7ed959af8662 no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:13:10.883100 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] No Port match for: 02c57200-9a7e-48d7-947f-7ed959af8662 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:13:10.883450 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 02c57200-9a7e-48d7-947f-7ed959af8662 not bound to the agent host hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:13:11.031882 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a52e4266-7b03-4a20-b591-9731209aaf4c req-33f6d68c-e0e6-40cd-88b3-681480387ef0 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:11.033016 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a52e4266-7b03-4a20-b591-9731209aaf4c req-33f6d68c-e0e6-40cd-88b3-681480387ef0 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0560961 Feb 08 18:13:11.083625 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a52e4266-7b03-4a20-b591-9731209aaf4c req-49369840-5fd0-493b-9889-8cb7b3482669 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445321 Feb 08 18:13:12.169252 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 37386) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:12.215326 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_v2 [None req-cc8c8523-e91b-4135-93bd-75cac25f465d admin admin] Deleting subnet bb9e2714-8d92-49d4-a88e-0ba6d48e2ad3 {{(pid=102559) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Feb 08 18:13:12.216316 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bc8dce8-c03a-4996-987a-3b867c6791cc req-36187a28-5465-4665-b91f-3a20c8b8c51d tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:12.217829 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0bc8dce8-c03a-4996-987a-3b867c6791cc req-36187a28-5465-4665-b91f-3a20c8b8c51d tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0595624 Feb 08 18:13:12.218556 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-cc8c8523-e91b-4135-93bd-75cac25f465d admin admin] Publish callbacks [] for subnet (bb9e2714-8d92-49d4-a88e-0ba6d48e2ad3), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:12.260400 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-cc8c8523-e91b-4135-93bd-75cac25f465d admin admin] Publish callbacks [] for subnet (bb9e2714-8d92-49d4-a88e-0ba6d48e2ad3), precommit_delete_associations {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:12.266238 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-cc8c8523-e91b-4135-93bd-75cac25f465d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1801023'] for subnet (bb9e2714-8d92-49d4-a88e-0ba6d48e2ad3), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:12.271422 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0bc8dce8-c03a-4996-987a-3b867c6791cc req-db99639c-b457-4b5b-8a56-d645c73410f2 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469925 Feb 08 18:13:12.321808 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-cc8c8523-e91b-4135-93bd-75cac25f465d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1801156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for subnet (bb9e2714-8d92-49d4-a88e-0ba6d48e2ad3), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:12.346816 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc8c8523-e91b-4135-93bd-75cac25f465d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=bb9e2714-8d92-49d4-a88e-0ba6d48e2ad3,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:12.351430 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-cc8c8523-e91b-4135-93bd-75cac25f465d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:12.357229 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-cc8c8523-e91b-4135-93bd-75cac25f465d admin admin] 10.222.0.118 "DELETE /v2.0/subnets/bb9e2714-8d92-49d4-a88e-0ba6d48e2ad3 HTTP/1.1" status: 204 len: 168 time: 0.1853158 Feb 08 18:13:12.357478 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 37396) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:12.427319 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-83ccbee2-e65c-48ac-813c-22f778fdfc57 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1860329'] for network (c6ecb925-b9a5-4524-9125-b49155fa007e), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:12.516236 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-83ccbee2-e65c-48ac-813c-22f778fdfc57 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1721768', 'neutron.services.segments.db._delete_segments_for_network-8770558865089'] for network (c6ecb925-b9a5-4524-9125-b49155fa007e), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:12.536083 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-83ccbee2-e65c-48ac-813c-22f778fdfc57 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c6ecb925-b9a5-4524-9125-b49155fa007e']}} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:13:12.545767 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-83ccbee2-e65c-48ac-813c-22f778fdfc57 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '36b36f15-bf90-46bb-ac3a-109acbbc7fd3') {'for_net_delete': True} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:13:12.546059 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-83ccbee2-e65c-48ac-813c-22f778fdfc57 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '36b36f15-bf90-46bb-ac3a-109acbbc7fd3') {} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:13:12.559796 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-83ccbee2-e65c-48ac-813c-22f778fdfc57 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8770558866122', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-64533840'] for segment (36b36f15-bf90-46bb-ac3a-109acbbc7fd3), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:12.573092 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-83ccbee2-e65c-48ac-813c-22f778fdfc57 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (36b36f15-bf90-46bb-ac3a-109acbbc7fd3), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:12.580497 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-83ccbee2-e65c-48ac-813c-22f778fdfc57 admin admin] Releasing vlan 1093 on physical network physnet1 to pool {{(pid=102560) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Feb 08 18:13:12.580991 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-83ccbee2-e65c-48ac-813c-22f778fdfc57 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-64531704'] for segment (36b36f15-bf90-46bb-ac3a-109acbbc7fd3), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: Traceback (most recent call last): Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: timer() Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: cb(*args, **kw) Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: return func(*args, **kwargs) Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: self._notify() Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: self.callback(batched_events) Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: event.method(event) Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: aggregate_uuid = self.p_client.list_aggregates( Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: return f(self, *a, **k) Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: return self._get(url).json() Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: return self._client.get(url, endpoint_filter=self._ks_filter, Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: return self.request(url, 'GET', **kwargs) Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: base_url = self.get_endpoint(auth, allow=allow, Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 08 18:13:12.582599 dv-cinder-773985-21-iscsi neutron-server[102560]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 08 18:13:12.637474 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-83ccbee2-e65c-48ac-813c-22f778fdfc57 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1721777', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-560760'] for network (c6ecb925-b9a5-4524-9125-b49155fa007e), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:12.644521 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-83ccbee2-e65c-48ac-813c-22f778fdfc57 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:12.647658 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-83ccbee2-e65c-48ac-813c-22f778fdfc57 admin admin] 10.222.0.118 "DELETE /v2.0/networks/c6ecb925-b9a5-4524-9125-b49155fa007e HTTP/1.1" status: 204 len: 168 time: 0.2893918 Feb 08 18:13:12.656890 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83ccbee2-e65c-48ac-813c-22f778fdfc57 admin admin] Pushing event deleted for resources: {'Network': ['ID=c6ecb925-b9a5-4524-9125-b49155fa007e,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:12.694260 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 37416) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:12.798679 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c8ea07ed-2de4-4601-87d5-060e7e6f49ad admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:12.806193 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 37420) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:12.847693 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-da296838-54cf-4c56-8b18-13def4b91e3b admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=4947894da18b4d0580dc1cf24ecb581c&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0402737 Feb 08 18:13:12.850250 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 37422) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:12.873320 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c8ea07ed-2de4-4601-87d5-060e7e6f49ad admin admin] Publish callbacks [] for security_group (66cb1039-a6d8-4d8b-92e8-edcfbab595f8), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:12.878158 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c8ea07ed-2de4-4601-87d5-060e7e6f49ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (66cb1039-a6d8-4d8b-92e8-edcfbab595f8), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:12.895086 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4edba0dd-ce88-4191-865d-9fbf97a8d3aa admin admin] Publish callbacks [] for security_group (a70d7f73-fc20-4c96-ba3a-f48a3d3736a6), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:12.913850 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-c8ea07ed-2de4-4601-87d5-060e7e6f49ad admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=b0fe9c9afc3d4153b15603f397ee2a21&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2180943 Feb 08 18:13:12.915830 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c8ea07ed-2de4-4601-87d5-060e7e6f49ad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=66cb1039-a6d8-4d8b-92e8-edcfbab595f8,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:12.916630 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 37424) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:12.919700 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4edba0dd-ce88-4191-865d-9fbf97a8d3aa admin admin] Publish callbacks [] for security_group (a70d7f73-fc20-4c96-ba3a-f48a3d3736a6), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:12.991143 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-12dd7352-bc1e-41a1-9173-1bf551b70a77 admin admin] Publish callbacks [] for security_group (66cb1039-a6d8-4d8b-92e8-edcfbab595f8), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:13.009071 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4edba0dd-ce88-4191-865d-9fbf97a8d3aa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (a70d7f73-fc20-4c96-ba3a-f48a3d3736a6), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:13.011562 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4edba0dd-ce88-4191-865d-9fbf97a8d3aa admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:13.012678 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-4edba0dd-ce88-4191-865d-9fbf97a8d3aa admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/a70d7f73-fc20-4c96-ba3a-f48a3d3736a6 HTTP/1.1" status: 204 len: 168 time: 0.1616447 Feb 08 18:13:13.018367 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-12dd7352-bc1e-41a1-9173-1bf551b70a77 admin admin] Publish callbacks [] for security_group (66cb1039-a6d8-4d8b-92e8-edcfbab595f8), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:13.031491 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4edba0dd-ce88-4191-865d-9fbf97a8d3aa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a70d7f73-fc20-4c96-ba3a-f48a3d3736a6,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:13.074295 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-12dd7352-bc1e-41a1-9173-1bf551b70a77 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (66cb1039-a6d8-4d8b-92e8-edcfbab595f8), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:13.076890 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-12dd7352-bc1e-41a1-9173-1bf551b70a77 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:13.078181 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-12dd7352-bc1e-41a1-9173-1bf551b70a77 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/66cb1039-a6d8-4d8b-92e8-edcfbab595f8 HTTP/1.1" status: 204 len: 168 time: 0.1606843 Feb 08 18:13:13.085989 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12dd7352-bc1e-41a1-9173-1bf551b70a77 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=66cb1039-a6d8-4d8b-92e8-edcfbab595f8,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:13.395318 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65a13888-4b0d-4176-b2dd-0abc481abe22 req-f016b39a-5c15-47bd-ae8f-9aa4c4545009 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:13.397129 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-65a13888-4b0d-4176-b2dd-0abc481abe22 req-f016b39a-5c15-47bd-ae8f-9aa4c4545009 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0559525 Feb 08 18:13:13.444995 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-65a13888-4b0d-4176-b2dd-0abc481abe22 req-8ee43a1e-976c-48b9-a96b-cb1cc075ea9f tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0418124 Feb 08 18:13:13.466740 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 37446) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:13.483037 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da86eccb-4d12-4171-a6c5-a0f03452aad0 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:13.555311 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da86eccb-4d12-4171-a6c5-a0f03452aad0 admin admin] Publish callbacks [] for security_group (e6932441-30a6-487e-8ac7-de53c96a8fc8), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:13.561154 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da86eccb-4d12-4171-a6c5-a0f03452aad0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (e6932441-30a6-487e-8ac7-de53c96a8fc8), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:13.601492 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-da86eccb-4d12-4171-a6c5-a0f03452aad0 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=9d99ced08b774269acb83f10d8afe8a6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1337557 Feb 08 18:13:13.602730 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da86eccb-4d12-4171-a6c5-a0f03452aad0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e6932441-30a6-487e-8ac7-de53c96a8fc8,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:13.604162 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 37454) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:13.656733 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1836809a-e5a3-4623-bdcf-592824f7c9d2 admin admin] Publish callbacks [] for security_group (e6932441-30a6-487e-8ac7-de53c96a8fc8), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:13.678349 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1836809a-e5a3-4623-bdcf-592824f7c9d2 admin admin] Publish callbacks [] for security_group (e6932441-30a6-487e-8ac7-de53c96a8fc8), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:13.742121 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1836809a-e5a3-4623-bdcf-592824f7c9d2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (e6932441-30a6-487e-8ac7-de53c96a8fc8), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:13.745049 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1836809a-e5a3-4623-bdcf-592824f7c9d2 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:13.746251 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-1836809a-e5a3-4623-bdcf-592824f7c9d2 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/e6932441-30a6-487e-8ac7-de53c96a8fc8 HTTP/1.1" status: 204 len: 168 time: 0.1409600 Feb 08 18:13:13.754235 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1836809a-e5a3-4623-bdcf-592824f7c9d2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e6932441-30a6-487e-8ac7-de53c96a8fc8,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:13.791344 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 37462) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:13.886282 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-ae9f87bc-2b50-4d10-a506-c46e49f39580 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-2144126523-network', 'tenant_id': '602d106ac7104b10bebcfc0421ea5edc'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:13:13.905172 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ae9f87bc-2b50-4d10-a506-c46e49f39580 admin admin] Made reservation on behalf of 602d106ac7104b10bebcfc0421ea5edc for: {'network': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:13:13.907730 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ae9f87bc-2b50-4d10-a506-c46e49f39580 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for network (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:13.916101 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ae9f87bc-2b50-4d10-a506-c46e49f39580 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:13.996794 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ae9f87bc-2b50-4d10-a506-c46e49f39580 admin admin] Publish callbacks [] for security_group (ee26d93a-0e97-42a4-942d-86acae001415), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:14.001095 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ae9f87bc-2b50-4d10-a506-c46e49f39580 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (ee26d93a-0e97-42a4-942d-86acae001415), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:14.019896 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ae9f87bc-2b50-4d10-a506-c46e49f39580 admin admin] vlan segment allocate from pool success with {'vlan_id': 1074, 'physical_network': 'physnet1'} {{(pid=102560) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Feb 08 18:13:14.038943 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ae9f87bc-2b50-4d10-a506-c46e49f39580 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (acdb31ea-e529-495f-b01f-8c3d7b96781f), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:14.039267 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.segments_db [None req-ae9f87bc-2b50-4d10-a506-c46e49f39580 admin admin] Added segment acdb31ea-e529-495f-b01f-8c3d7b96781f of type vlan for network 622fcad3-2fd8-49df-8f66-feb243e2b24d Feb 08 18:13:14.040821 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae9f87bc-2b50-4d10-a506-c46e49f39580 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ee26d93a-0e97-42a4-942d-86acae001415,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:14.083984 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ae9f87bc-2b50-4d10-a506-c46e49f39580 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8770558521384'] for network (622fcad3-2fd8-49df-8f66-feb243e2b24d), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:14.117322 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ae9f87bc-2b50-4d10-a506-c46e49f39580 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for network (622fcad3-2fd8-49df-8f66-feb243e2b24d), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:14.118312 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ae9f87bc-2b50-4d10-a506-c46e49f39580 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:14.118967 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ae9f87bc-2b50-4d10-a506-c46e49f39580 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:14.178053 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-ae9f87bc-2b50-4d10-a506-c46e49f39580 admin admin] 10.222.0.118 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.3854635 Feb 08 18:13:14.181994 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 37480) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:14.186501 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae9f87bc-2b50-4d10-a506-c46e49f39580 admin admin] Pushing event updated for resources: {'Network': ['ID=622fcad3-2fd8-49df-8f66-feb243e2b24d,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:14.187725 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-db886f1a-da70-4332-8a90-771b7e2ff49d admin admin] Request body: {'subnet': {'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-2144126523-subnet', 'tenant_id': '602d106ac7104b10bebcfc0421ea5edc', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:13:14.196505 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Network 622fcad3-2fd8-49df-8f66-feb243e2b24d details requested by agent ovs-agent-dv-cinder-773985-21-iscsi with host dv-cinder-773985-21-iscsi {{(pid=102561) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Feb 08 18:13:14.212395 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-db886f1a-da70-4332-8a90-771b7e2ff49d admin admin] Made reservation on behalf of 602d106ac7104b10bebcfc0421ea5edc for: {'subnet': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:13:14.215587 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-db886f1a-da70-4332-8a90-771b7e2ff49d admin admin] Publish callbacks [] for subnet (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:14.391752 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-db886f1a-da70-4332-8a90-771b7e2ff49d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for subnet (080b9f96-e4e1-410a-a6ed-01cf523843d5), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:14.446237 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db886f1a-da70-4332-8a90-771b7e2ff49d admin admin] Pushing event updated for resources: {'Subnet': ['ID=080b9f96-e4e1-410a-a6ed-01cf523843d5,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:14.459161 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-db886f1a-da70-4332-8a90-771b7e2ff49d admin admin] Checking segment: {'id': 'acdb31ea-e529-495f-b01f-8c3d7b96781f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102559) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:13:14.459526 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db886f1a-da70-4332-8a90-771b7e2ff49d admin admin] Network hostable DHCP agents. Network: 622fcad3-2fd8-49df-8f66-feb243e2b24d, hostable agents: ['006b5388-ac7d-4794-a124-14bb8e5d8fec'], hosted agents: [] {{(pid=102559) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Feb 08 18:13:14.477259 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-db886f1a-da70-4332-8a90-771b7e2ff49d admin admin] Network 622fcad3-2fd8-49df-8f66-feb243e2b24d is scheduled to be hosted by DHCP agent 006b5388-ac7d-4794-a124-14bb8e5d8fec with binding_index 1 {{(pid=102559) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Feb 08 18:13:14.493482 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-db886f1a-da70-4332-8a90-771b7e2ff49d admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773985-21-iscsi, 622fcad3-2fd8-49df-8f66-feb243e2b24d) {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:13:14.498048 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-db886f1a-da70-4332-8a90-771b7e2ff49d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:14.499001 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-db886f1a-da70-4332-8a90-771b7e2ff49d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:14.508913 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3874a598-58e6-4495-9f8f-e57a25f04197 None None] Network 622fcad3-2fd8-49df-8f66-feb243e2b24d requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:13:14.526810 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-db886f1a-da70-4332-8a90-771b7e2ff49d admin admin] 10.222.0.118 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.3420420 Feb 08 18:13:14.584966 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d2c00c2-232c-4d14-a2d8-86c4e4c27655 req-cbd30ab0-c25c-4d81-b619-b8cd550e6264 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:14.586496 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0d2c00c2-232c-4d14-a2d8-86c4e4c27655 req-cbd30ab0-c25c-4d81-b619-b8cd550e6264 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0644653 Feb 08 18:13:14.658149 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d75b6636-684a-4d8a-9e29-39e7c60fd8ab None None] Network 622fcad3-2fd8-49df-8f66-feb243e2b24d requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:13:14.662878 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0d2c00c2-232c-4d14-a2d8-86c4e4c27655 req-e3c07d3d-a7ac-473b-9962-18c76713a5cc tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0676591 Feb 08 18:13:15.366282 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-57c86115-a1d3-45ee-ab3c-48d5c2bcbdc6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:15.390571 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-2a8c9ea0-04ec-4c28-b7b2-8bdbc929e497 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:15.392090 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-2a8c9ea0-04ec-4c28-b7b2-8bdbc929e497 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/networks?id=622fcad3-2fd8-49df-8f66-feb243e2b24d HTTP/1.1" status: 200 len: 815 time: 0.2973461 Feb 08 18:13:15.407599 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-a780dfcd-f5d0-40ce-8d45-f9618b34d509 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/quotas/602d106ac7104b10bebcfc0421ea5edc HTTP/1.1" status: 200 len: 375 time: 0.0094817 Feb 08 18:13:15.441573 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-3b9c1028-82bc-4081-a21e-d4687526ce53 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?tenant_id=602d106ac7104b10bebcfc0421ea5edc&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0274131 Feb 08 18:13:15.534021 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-2769391b-bc7b-47a9-a556-88a28b05f877 service neutron] 10.222.0.118 "GET /v2.0/networks/622fcad3-2fd8-49df-8f66-feb243e2b24d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852609 Feb 08 18:13:15.624216 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-0169b8d2-28c1-43fd-b683-2e4f5564d718 service neutron] 10.222.0.118 "GET /v2.0/networks/622fcad3-2fd8-49df-8f66-feb243e2b24d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0838542 Feb 08 18:13:15.814264 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d1567dc-5f55-4804-ae92-627fb8428a86 req-0059ad4b-29b4-4aec-91b9-83c19e6ba22b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:15.816822 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0d1567dc-5f55-4804-ae92-627fb8428a86 req-0059ad4b-29b4-4aec-91b9-83c19e6ba22b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0599713 Feb 08 18:13:15.824019 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-446f216d-9055-4436-9df3-0985a778ff9b req-438f65de-051e-4a17-a71a-395609fa7304 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=d2fb9a58-8375-440e-8e25-2a60d637eb7a HTTP/1.1" status: 200 len: 210 time: 0.0550127 Feb 08 18:13:15.915059 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0d1567dc-5f55-4804-ae92-627fb8428a86 req-7990fdbc-6de0-4958-b2a9-bbb1cf387f28 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0915158 Feb 08 18:13:16.942641 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-315f4d8a-faf3-4510-828d-69d26a1b0b2e req-dc8b27db-d255-47ea-a0c7-22404234eee7 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=d2fb9a58-8375-440e-8e25-2a60d637eb7a HTTP/1.1" status: 200 len: 210 time: 0.0357561 Feb 08 18:13:16.980569 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:13:17.064874 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dda09b0c-c720-42c7-9bb6-69aba75ff9d9 req-aa7504f0-3660-413d-821c-a4ecad09a0ca tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:17.065802 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-dda09b0c-c720-42c7-9bb6-69aba75ff9d9 req-aa7504f0-3660-413d-821c-a4ecad09a0ca tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0630379 Feb 08 18:13:17.115745 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-dda09b0c-c720-42c7-9bb6-69aba75ff9d9 req-9d6020a4-330d-4151-8a59-08913e543789 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413940 Feb 08 18:13:17.165346 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 37580) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:17.277180 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-197bc016-9d5b-4ca4-9de9-9c17fd5e7a5b admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:17.359824 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-197bc016-9d5b-4ca4-9de9-9c17fd5e7a5b admin admin] Publish callbacks [] for security_group (589aaa32-f10d-4c19-8de5-9c0cf46c3d3a), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:17.366348 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-197bc016-9d5b-4ca4-9de9-9c17fd5e7a5b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (589aaa32-f10d-4c19-8de5-9c0cf46c3d3a), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:17.403850 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-197bc016-9d5b-4ca4-9de9-9c17fd5e7a5b admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=ad46bfe0d91e4887a07b9610aeaa1360&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2374153 Feb 08 18:13:17.404690 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-197bc016-9d5b-4ca4-9de9-9c17fd5e7a5b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=589aaa32-f10d-4c19-8de5-9c0cf46c3d3a,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:17.407483 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 37586) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:17.456876 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e54f8c84-092b-481a-b873-0a7abd4505c6 admin admin] Publish callbacks [] for security_group (589aaa32-f10d-4c19-8de5-9c0cf46c3d3a), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:17.478296 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e54f8c84-092b-481a-b873-0a7abd4505c6 admin admin] Publish callbacks [] for security_group (589aaa32-f10d-4c19-8de5-9c0cf46c3d3a), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:17.527769 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e54f8c84-092b-481a-b873-0a7abd4505c6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (589aaa32-f10d-4c19-8de5-9c0cf46c3d3a), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:17.530426 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e54f8c84-092b-481a-b873-0a7abd4505c6 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:17.531675 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-e54f8c84-092b-481a-b873-0a7abd4505c6 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/589aaa32-f10d-4c19-8de5-9c0cf46c3d3a HTTP/1.1" status: 204 len: 168 time: 0.1232114 Feb 08 18:13:17.539844 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e54f8c84-092b-481a-b873-0a7abd4505c6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=589aaa32-f10d-4c19-8de5-9c0cf46c3d3a,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:17.805767 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b28368c8-0f19-4da4-8958-3aae8eddfb96 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:17.937355 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:18.060016 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-94234ed3-7a1d-4f4c-ac5c-809ba193b00c req-286fd281-044d-437c-aec9-79349f2bbe63 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=d2fb9a58-8375-440e-8e25-2a60d637eb7a HTTP/1.1" status: 200 len: 210 time: 0.0320516 Feb 08 18:13:18.243888 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3756f08a-ac0a-4876-8373-fd8f8222ccf1 req-3438ae22-d692-469b-b644-d308df48aa27 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:18.245512 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-3756f08a-ac0a-4876-8373-fd8f8222ccf1 req-3438ae22-d692-469b-b644-d308df48aa27 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0548558 Feb 08 18:13:18.290776 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-3756f08a-ac0a-4876-8373-fd8f8222ccf1 req-8e364797-1e4c-4c9a-8e10-0e2278706e9d tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0398121 Feb 08 18:13:18.475219 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:19.159109 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9558add8-aff5-4a00-aa90-a8ed70ddd9c2 req-0d8b6a91-82ef-4747-a8be-bdcf07e69fb2 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=d2fb9a58-8375-440e-8e25-2a60d637eb7a HTTP/1.1" status: 200 len: 210 time: 0.0269787 Feb 08 18:13:19.291981 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ab8b7796-5d14-4a90-889b-fd66315e180c req-fb31c0c5-4d5b-4fb6-abcb-d4d2c79df303 service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0459721 Feb 08 18:13:19.424821 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab8b7796-5d14-4a90-889b-fd66315e180c req-1c5b929a-219c-47ed-a7b7-2ac67811bfaf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:19.426277 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ab8b7796-5d14-4a90-889b-fd66315e180c req-1c5b929a-219c-47ed-a7b7-2ac67811bfaf service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=3fb51fc0e23f4c66a482d4d406197299&device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 1130 time: 0.0748243 Feb 08 18:13:19.435994 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98e45dbc-e784-4fda-a449-2c510714c28d req-561b7b25-f04c-4cdb-9b41-bc00c76bb78b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:19.437366 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-98e45dbc-e784-4fda-a449-2c510714c28d req-561b7b25-f04c-4cdb-9b41-bc00c76bb78b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0779836 Feb 08 18:13:19.533851 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-98e45dbc-e784-4fda-a449-2c510714c28d req-b4c29fbb-9199-417e-a4db-af6854904a38 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0896511 Feb 08 18:13:19.563897 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab8b7796-5d14-4a90-889b-fd66315e180c req-868f589a-6c6c-45b6-b3d3-27cdd54cdc35 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:19.565426 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ab8b7796-5d14-4a90-889b-fd66315e180c req-868f589a-6c6c-45b6-b3d3-27cdd54cdc35 service neutron] 10.222.0.109 "GET /v2.0/networks?id=f089911e-72de-4ff6-880b-ac3dd7927165 HTTP/1.1" status: 200 len: 921 time: 0.1107559 Feb 08 18:13:19.622812 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ab8b7796-5d14-4a90-889b-fd66315e180c req-526d6b2c-33a8-41ec-a2da-d2ddeb1d4664 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=f63fc38b-d10b-4316-b77f-d1816d07ca90 HTTP/1.1" status: 200 len: 217 time: 0.0379333 Feb 08 18:13:19.673712 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab8b7796-5d14-4a90-889b-fd66315e180c req-81ecb5a2-60ff-40d8-a353-074e52295e70 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:19.675264 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ab8b7796-5d14-4a90-889b-fd66315e180c req-81ecb5a2-60ff-40d8-a353-074e52295e70 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=0af67967-364e-4325-b04f-b7e157c3c3d4 HTTP/1.1" status: 200 len: 859 time: 0.0461261 Feb 08 18:13:20.081609 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:20.269659 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-925a2ac4-0743-4e87-8cdc-2117460e2259 req-7cdc01b8-1153-48e0-87d7-dc58f0adf5b3 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=d2fb9a58-8375-440e-8e25-2a60d637eb7a HTTP/1.1" status: 200 len: 210 time: 0.0298078 Feb 08 18:13:20.661169 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae2f9eb1-7240-49b7-b93e-2a886eafc475 req-4e2261c7-5a13-419f-ab0e-2e1f94b04691 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:20.662503 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ae2f9eb1-7240-49b7-b93e-2a886eafc475 req-4e2261c7-5a13-419f-ab0e-2e1f94b04691 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0567281 Feb 08 18:13:20.710787 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ae2f9eb1-7240-49b7-b93e-2a886eafc475 req-7cd47027-cf90-4143-adcd-162374fcfccd tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425215 Feb 08 18:13:21.374164 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-4cb1d93b-cc5d-4959-8740-b1114d8f7cfb req-2e9eb4c0-afef-43af-86cf-3aaee139145a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=d2fb9a58-8375-440e-8e25-2a60d637eb7a HTTP/1.1" status: 200 len: 210 time: 0.0266871 Feb 08 18:13:21.657727 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:21.837028 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-779145c8-706a-45db-9e64-5e2c4fbc3aa3 req-0d13ed17-f192-4d7c-b947-e09186b2ac00 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:21.838455 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-779145c8-706a-45db-9e64-5e2c4fbc3aa3 req-0d13ed17-f192-4d7c-b947-e09186b2ac00 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0601606 Feb 08 18:13:21.885811 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-779145c8-706a-45db-9e64-5e2c4fbc3aa3 req-be6c7134-3527-4e67-a16c-8ebe868f435c tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416374 Feb 08 18:13:22.482795 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-074897a6-6194-454b-b7c4-cb131098b39c req-7c148ff2-8b0f-4d08-aa53-3ff282c13eaa tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=d2fb9a58-8375-440e-8e25-2a60d637eb7a HTTP/1.1" status: 200 len: 210 time: 0.0297532 Feb 08 18:13:22.601114 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ab8b7796-5d14-4a90-889b-fd66315e180c req-49889b93-60c3-4ddd-8414-93e12d4561c2 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=f089911e-72de-4ff6-880b-ac3dd7927165&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0266054 Feb 08 18:13:22.684011 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e06e9932-3b8f-488b-9f9c-277fc635c2f7 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:22.685582 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e06e9932-3b8f-488b-9f9c-277fc635c2f7 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.109 "GET /v2.0/networks?id=622fcad3-2fd8-49df-8f66-feb243e2b24d HTTP/1.1" status: 200 len: 815 time: 0.1098115 Feb 08 18:13:22.691996 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ab8b7796-5d14-4a90-889b-fd66315e180c req-6f1f6c1e-df70-4fd5-be08-8e17ee4e25d9 service neutron] 10.222.0.109 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0816505 Feb 08 18:13:22.706131 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-365db158-77e5-464f-a625-5412f3e409c6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Request body: {'port': {'device_id': 'd2fb9a58-8375-440e-8e25-2a60d637eb7a', 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d', 'admin_state_up': True, 'tenant_id': '602d106ac7104b10bebcfc0421ea5edc'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:13:22.790369 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ab8b7796-5d14-4a90-889b-fd66315e180c req-cb557a79-c6f9-48d2-86c6-eafe52b76fc7 service neutron] 10.222.0.109 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0865891 Feb 08 18:13:22.820999 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-365db158-77e5-464f-a625-5412f3e409c6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Made reservation on behalf of 602d106ac7104b10bebcfc0421ea5edc for: {'port': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:13:22.824435 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-365db158-77e5-464f-a625-5412f3e409c6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:22.969129 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-365db158-77e5-464f-a625-5412f3e409c6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Allocated IP 172.20.0.7 (622fcad3-2fd8-49df-8f66-feb243e2b24d/080b9f96-e4e1-410a-a6ed-01cf523843d5/5676d44a-8ef0-472a-9703-1a68bebb5ad4) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:13:23.013382 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fb94388-df78-4c4c-9f42-ee45e1253765 req-30671580-f446-4381-a7df-191438f32b98 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:23.014815 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0fb94388-df78-4c4c-9f42-ee45e1253765 req-30671580-f446-4381-a7df-191438f32b98 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0538666 Feb 08 18:13:23.061133 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0fb94388-df78-4c4c-9f42-ee45e1253765 req-27bb455a-294e-4e70-aa5c-822907bf3a43 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0400343 Feb 08 18:13:23.117141 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-365db158-77e5-464f-a625-5412f3e409c6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks [] for port (5676d44a-8ef0-472a-9703-1a68bebb5ad4), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:23.153737 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-365db158-77e5-464f-a625-5412f3e409c6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (5676d44a-8ef0-472a-9703-1a68bebb5ad4), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:23.217220 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-365db158-77e5-464f-a625-5412f3e409c6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Network 622fcad3-2fd8-49df-8f66-feb243e2b24d is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:13:23.223006 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-365db158-77e5-464f-a625-5412f3e409c6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:13:23.227355 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-365db158-77e5-464f-a625-5412f3e409c6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:13:23.234521 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-365db158-77e5-464f-a625-5412f3e409c6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:23.235441 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-365db158-77e5-464f-a625-5412f3e409c6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:23.240023 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-365db158-77e5-464f-a625-5412f3e409c6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Pushing event updated for resources: {'Port': ['ID=5676d44a-8ef0-472a-9703-1a68bebb5ad4,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:23.259616 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-365db158-77e5-464f-a625-5412f3e409c6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.109 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5575259 Feb 08 18:13:23.613836 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76a57adc-3945-404d-9405-14b82a24d332 req-b72a9890-acab-4d07-807b-779ec782bf4e tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:23.615440 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-76a57adc-3945-404d-9405-14b82a24d332 req-b72a9890-acab-4d07-807b-779ec782bf4e tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=d2fb9a58-8375-440e-8e25-2a60d637eb7a HTTP/1.1" status: 200 len: 931 time: 0.0531719 Feb 08 18:13:23.661783 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-76a57adc-3945-404d-9405-14b82a24d332 req-7e369880-51d0-4b62-8c74-1ba246f6cf8f tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407379 Feb 08 18:13:24.192219 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25f0b011-0fde-449c-a517-a8e7d690fa79 req-ed65534e-5515-4f16-9ff7-f76f8429749a tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:24.193670 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-25f0b011-0fde-449c-a517-a8e7d690fa79 req-ed65534e-5515-4f16-9ff7-f76f8429749a tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0584300 Feb 08 18:13:24.243544 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-25f0b011-0fde-449c-a517-a8e7d690fa79 req-d9ee5533-f398-45ec-8ade-66b6563913e5 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417280 Feb 08 18:13:24.803078 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e8ff8c4-561d-48c5-bafc-393d61335105 req-6e62ca30-cb4d-46b0-9315-3914f0544bba tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:24.804907 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9e8ff8c4-561d-48c5-bafc-393d61335105 req-6e62ca30-cb4d-46b0-9315-3914f0544bba tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=d2fb9a58-8375-440e-8e25-2a60d637eb7a HTTP/1.1" status: 200 len: 931 time: 0.0674920 Feb 08 18:13:24.853401 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9e8ff8c4-561d-48c5-bafc-393d61335105 req-10953e25-daa1-46f1-98d6-83a375468745 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427008 Feb 08 18:13:24.873332 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] Request body: {'port': {'device_id': 'd2fb9a58-8375-440e-8e25-2a60d637eb7a', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77398'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:13:24.935378 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (5676d44a-8ef0-472a-9703-1a68bebb5ad4), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:25.229971 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5676d44a-8ef0-472a-9703-1a68bebb5ad4 {{(pid=102559) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:13:25.238128 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] Publish callbacks [] for port (5676d44a-8ef0-472a-9703-1a68bebb5ad4), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:25.250967 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.provisioning_blocks [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] Transition to ACTIVE for port object 5676d44a-8ef0-472a-9703-1a68bebb5ad4 will not be triggered until provisioned by entity L2. {{(pid=102559) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Feb 08 18:13:25.256824 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (5676d44a-8ef0-472a-9703-1a68bebb5ad4), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:25.307584 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] Pushing event updated for resources: {'Port': ['ID=5676d44a-8ef0-472a-9703-1a68bebb5ad4,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:25.336059 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] Attempting to bind port 5676d44a-8ef0-472a-9703-1a68bebb5ad4 on host hv-cinder-77398 for vnic_type normal with profile {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:13:25.336394 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] Attempting to bind port 5676d44a-8ef0-472a-9703-1a68bebb5ad4 by drivers openvswitch,hyperv on host hv-cinder-77398 at level 0 using segments [{'id': 'acdb31ea-e529-495f-b01f-8c3d7b96781f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d'}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:13:25.336723 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] Attempting to bind port 5676d44a-8ef0-472a-9703-1a68bebb5ad4 on network 622fcad3-2fd8-49df-8f66-feb243e2b24d {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:13:25.341398 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] Port 5676d44a-8ef0-472a-9703-1a68bebb5ad4 on network 622fcad3-2fd8-49df-8f66-feb243e2b24d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77398 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Feb 08 18:13:25.341689 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] Attempting to bind port 5676d44a-8ef0-472a-9703-1a68bebb5ad4 on network 622fcad3-2fd8-49df-8f66-feb243e2b24d {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:13:25.347407 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] Checking agent: {'id': '045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77398', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'started_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 13, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:13:25.347795 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] Checking segment: {'id': 'acdb31ea-e529-495f-b01f-8c3d7b96781f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102559) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:13:25.348150 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] Bound using segment: {'id': 'acdb31ea-e529-495f-b01f-8c3d7b96781f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d'} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:13:25.348556 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] Bound port: 5676d44a-8ef0-472a-9703-1a68bebb5ad4, host: hv-cinder-77398, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'acdb31ea-e529-495f-b01f-8c3d7b96781f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d'}}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:13:25.348928 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (5676d44a-8ef0-472a-9703-1a68bebb5ad4), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:25.365327 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58a780b8-6c6a-4b36-b5f3-259a70357526 req-2d60f8f7-952e-452b-b54a-3e6dd841ff12 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:25.366809 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-58a780b8-6c6a-4b36-b5f3-259a70357526 req-2d60f8f7-952e-452b-b54a-3e6dd841ff12 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0520229 Feb 08 18:13:25.412356 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] For port 5676d44a-8ef0-472a-9703-1a68bebb5ad4, host hv-cinder-77398, cleared binding levels {{(pid=102559) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:13:25.413262 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-58a780b8-6c6a-4b36-b5f3-259a70357526 req-77a8963b-f9f1-4674-8ecb-8237e3e3068c tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405622 Feb 08 18:13:25.415356 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] For port 5676d44a-8ef0-472a-9703-1a68bebb5ad4, host hv-cinder-77398, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=5676d44a-8ef0-472a-9703-1a68bebb5ad4,segment=NetworkSegment(acdb31ea-e529-495f-b01f-8c3d7b96781f),segment_id=acdb31ea-e529-495f-b01f-8c3d7b96781f)] {{(pid=102559) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:13:25.422114 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (5676d44a-8ef0-472a-9703-1a68bebb5ad4), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:25.454745 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:25.455428 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:25.456807 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] 10.222.0.109 "PUT /v2.0/ports/5676d44a-8ef0-472a-9703-1a68bebb5ad4 HTTP/1.1" status: 200 len: 1093 time: 0.5880511 Feb 08 18:13:25.457332 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd2fb9a58-8375-440e-8e25-2a60d637eb7a', 'tag': '5676d44a-8ef0-472a-9703-1a68bebb5ad4'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:13:25.459680 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-874b5bd6-8768-4a64-8b21-67e25181cb65" -d '{"events": [{"name": "network-changed", "server_uuid": "d2fb9a58-8375-440e-8e25-2a60d637eb7a", "tag": "5676d44a-8ef0-472a-9703-1a68bebb5ad4"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:13:25.483301 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e75d64b3-836b-4f8e-a8e5-ac528b9de0b0 service neutron] Pushing event updated for resources: {'Port': ['ID=5676d44a-8ef0-472a-9703-1a68bebb5ad4,revision_number=3']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:25.496329 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:13:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4ac4870c-ffaf-4226-b361-afa628a5dde9 x-openstack-request-id: req-4ac4870c-ffaf-4226-b361-afa628a5dde9 {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:13:25.496611 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d2fb9a58-8375-440e-8e25-2a60d637eb7a", "tag": "5676d44a-8ef0-472a-9703-1a68bebb5ad4", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:13:25.496858 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-4ac4870c-ffaf-4226-b361-afa628a5dde9 {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:13:25.497246 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd2fb9a58-8375-440e-8e25-2a60d637eb7a', 'tag': '5676d44a-8ef0-472a-9703-1a68bebb5ad4', 'status': 'completed', 'code': 200} Feb 08 18:13:25.905962 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-874b5bd6-8768-4a64-8b21-67e25181cb65 req-66191240-d9c1-48f6-994c-c5041a0955d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:25.907083 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-874b5bd6-8768-4a64-8b21-67e25181cb65 req-66191240-d9c1-48f6-994c-c5041a0955d4 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=602d106ac7104b10bebcfc0421ea5edc&device_id=d2fb9a58-8375-440e-8e25-2a60d637eb7a HTTP/1.1" status: 200 len: 1127 time: 0.0559919 Feb 08 18:13:25.976001 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd27af5b-a63f-41b1-879f-6bf692431165 req-9fa88cb8-2927-4365-951a-0e9c0cab6dcb tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:25.977435 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-bd27af5b-a63f-41b1-879f-6bf692431165 req-9fa88cb8-2927-4365-951a-0e9c0cab6dcb tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=d2fb9a58-8375-440e-8e25-2a60d637eb7a HTTP/1.1" status: 200 len: 943 time: 0.0529275 Feb 08 18:13:26.026622 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-bd27af5b-a63f-41b1-879f-6bf692431165 req-7658002a-ff21-41da-b1cb-8ad4d4c82f45 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432487 Feb 08 18:13:26.087933 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-874b5bd6-8768-4a64-8b21-67e25181cb65 req-460f31c1-31c5-48ee-a705-cf44762d868e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:26.089384 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-874b5bd6-8768-4a64-8b21-67e25181cb65 req-460f31c1-31c5-48ee-a705-cf44762d868e service neutron] 10.222.0.109 "GET /v2.0/networks?tenant_id=602d106ac7104b10bebcfc0421ea5edc&shared=False HTTP/1.1" status: 200 len: 917 time: 0.1611843 Feb 08 18:13:26.248457 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-874b5bd6-8768-4a64-8b21-67e25181cb65 req-37af97f9-f04d-4181-aa42-e872754a918f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:26.249897 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-874b5bd6-8768-4a64-8b21-67e25181cb65 req-37af97f9-f04d-4181-aa42-e872754a918f service neutron] 10.222.0.109 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.1518722 Feb 08 18:13:26.334141 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-6eb1b185-2808-475d-a3f1-44b4180f3562 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:26.335534 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-6eb1b185-2808-475d-a3f1-44b4180f3562 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=602d106ac7104b10bebcfc0421ea5edc&device_id=d2fb9a58-8375-440e-8e25-2a60d637eb7a HTTP/1.1" status: 200 len: 1127 time: 0.0445037 Feb 08 18:13:26.380723 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-0fbc7228-2251-41e9-a4ed-2f7cf16077af service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=5676d44a-8ef0-472a-9703-1a68bebb5ad4 HTTP/1.1" status: 200 len: 217 time: 0.0328505 Feb 08 18:13:26.439125 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-6c4e68a5-da7f-4c46-a2a5-507f40d6fe10 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:26.440666 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-6c4e68a5-da7f-4c46-a2a5-507f40d6fe10 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=080b9f96-e4e1-410a-a6ed-01cf523843d5 HTTP/1.1" status: 200 len: 855 time: 0.0458534 Feb 08 18:13:26.473933 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-35b3deca-1360-4b4d-9c67-5de965d2e4cd service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=622fcad3-2fd8-49df-8f66-feb243e2b24d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0254641 Feb 08 18:13:26.605653 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36688dc5-613c-41af-bf52-6306c1502cf3 req-b6643b04-3410-4db8-be98-8c4a34c15440 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:26.607064 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-36688dc5-613c-41af-bf52-6306c1502cf3 req-b6643b04-3410-4db8-be98-8c4a34c15440 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.1152790 Feb 08 18:13:26.611228 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-0739f747-1b8f-4353-8b8e-1ca7ef68de72 service neutron] 10.222.0.109 "GET /v2.0/networks/622fcad3-2fd8-49df-8f66-feb243e2b24d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1295013 Feb 08 18:13:26.704366 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-36688dc5-613c-41af-bf52-6306c1502cf3 req-a849ab73-734b-470f-861c-e84ea092959c tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0912776 Feb 08 18:13:26.733853 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2f44bb51-a2b8-4bd9-97fc-6912ba0c4687 req-a4d07b10-f423-4cc2-9aba-2548f884e2a3 service neutron] 10.222.0.109 "GET /v2.0/networks/622fcad3-2fd8-49df-8f66-feb243e2b24d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1140363 Feb 08 18:13:27.070708 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-012c552f-df8d-4bd8-81e9-06a1fe65e24c req-5a2a893c-10cf-4b29-9987-baf1aa6a0852 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:27.072277 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-012c552f-df8d-4bd8-81e9-06a1fe65e24c req-5a2a893c-10cf-4b29-9987-baf1aa6a0852 service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 1129 time: 0.2947512 Feb 08 18:13:27.135982 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-012c552f-df8d-4bd8-81e9-06a1fe65e24c req-67b8352e-cd2e-4156-829e-592adf1b1e5b service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0552075 Feb 08 18:13:27.170243 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a64fda8-7c94-4d19-8c6e-627f4b9d60a1 req-29c5ff4f-fcf3-42c7-8c65-f7c1959fd455 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:27.171760 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8a64fda8-7c94-4d19-8c6e-627f4b9d60a1 req-29c5ff4f-fcf3-42c7-8c65-f7c1959fd455 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=d2fb9a58-8375-440e-8e25-2a60d637eb7a HTTP/1.1" status: 200 len: 943 time: 0.0616243 Feb 08 18:13:27.227536 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8a64fda8-7c94-4d19-8c6e-627f4b9d60a1 req-fc859e41-dc47-4813-abaa-1cefbe2d68b2 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473523 Feb 08 18:13:27.832935 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02f242f6-8e65-4977-a3e5-927b64daac80 req-ecf387d0-d55e-4d67-ba15-c6a13077d15c tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:27.834404 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-02f242f6-8e65-4977-a3e5-927b64daac80 req-ecf387d0-d55e-4d67-ba15-c6a13077d15c tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0620458 Feb 08 18:13:27.889287 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-02f242f6-8e65-4977-a3e5-927b64daac80 req-8fb3640e-4058-4d91-9c38-95cbbf29e828 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463579 Feb 08 18:13:28.051036 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 5676d44a-8ef0-472a-9703-1a68bebb5ad4 details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:13:28.150661 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 5676d44a-8ef0-472a-9703-1a68bebb5ad4, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=5676d44a-8ef0-472a-9703-1a68bebb5ad4,segment=NetworkSegment(acdb31ea-e529-495f-b01f-8c3d7b96781f),segment_id=acdb31ea-e529-495f-b01f-8c3d7b96781f)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:13:28.161970 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': '5676d44a-8ef0-472a-9703-1a68bebb5ad4', 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d', 'port_id': '5676d44a-8ef0-472a-9703-1a68bebb5ad4', 'mac_address': 'fa:16:3e:4a:9a:2a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1074, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '080b9f96-e4e1-410a-a6ed-01cf523843d5', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:13:28.199103 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 5676d44a-8ef0-472a-9703-1a68bebb5ad4 is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:28.199492 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (5676d44a-8ef0-472a-9703-1a68bebb5ad4), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:28.213063 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5676d44a-8ef0-472a-9703-1a68bebb5ad4 {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:13:28.233508 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 5676d44a-8ef0-472a-9703-1a68bebb5ad4, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=5676d44a-8ef0-472a-9703-1a68bebb5ad4,segment=NetworkSegment(acdb31ea-e529-495f-b01f-8c3d7b96781f),segment_id=acdb31ea-e529-495f-b01f-8c3d7b96781f)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:13:28.237929 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (5676d44a-8ef0-472a-9703-1a68bebb5ad4), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:28.293015 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=5676d44a-8ef0-472a-9703-1a68bebb5ad4,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:28.302119 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:28.302529 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:28.302917 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:28.303258 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:28.303583 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:28.304435 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:28.304945 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:28.305419 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:28.305886 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:28.306379 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:28.306713 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:28.307069 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:28.307393 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:28.348070 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 37802) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:28.404314 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40b2dc51-5e27-4578-94d1-29917c7202c7 req-253461ef-6386-414c-99a9-6fcc99daabc5 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:28.406507 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-40b2dc51-5e27-4578-94d1-29917c7202c7 req-253461ef-6386-414c-99a9-6fcc99daabc5 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=d2fb9a58-8375-440e-8e25-2a60d637eb7a HTTP/1.1" status: 200 len: 944 time: 0.0615423 Feb 08 18:13:28.458924 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 37812) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:28.470850 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-40b2dc51-5e27-4578-94d1-29917c7202c7 req-abebcd99-7f01-4efe-b1bb-cd6182218623 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0550120 Feb 08 18:13:28.526692 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a0768b4a-14eb-4a0a-8010-37269ffe40ab admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:28.530720 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['5676d44a-8ef0-472a-9703-1a68bebb5ad4'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:13:28.593638 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d2783780-b337-495d-97ef-6afcaf8b7efd admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:28.637464 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a0768b4a-14eb-4a0a-8010-37269ffe40ab admin admin] Publish callbacks [] for security_group (e5cf0c7c-8110-472e-9da2-c8f17d61f6d3), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:28.645716 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a0768b4a-14eb-4a0a-8010-37269ffe40ab admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (e5cf0c7c-8110-472e-9da2-c8f17d61f6d3), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:28.702254 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0768b4a-14eb-4a0a-8010-37269ffe40ab admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e5cf0c7c-8110-472e-9da2-c8f17d61f6d3,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:28.707631 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-a0768b4a-14eb-4a0a-8010-37269ffe40ab admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=6dfed0eba22a45c38cba2db8ff3bf851&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3577154 Feb 08 18:13:28.710545 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 37818) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:28.735267 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d2783780-b337-495d-97ef-6afcaf8b7efd admin admin] Publish callbacks [] for security_group (83abce53-2091-4fe1-8d5f-679e8e676b8b), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:28.740023 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d2783780-b337-495d-97ef-6afcaf8b7efd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (83abce53-2091-4fe1-8d5f-679e8e676b8b), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:28.762383 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-17489c4e-61e6-4272-b3b6-081d291fd3d6 admin admin] Publish callbacks [] for security_group (e5cf0c7c-8110-472e-9da2-c8f17d61f6d3), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:28.778298 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-d2783780-b337-495d-97ef-6afcaf8b7efd admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=4a004389843347e6b6197eba4d085c3a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3182020 Feb 08 18:13:28.779434 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2783780-b337-495d-97ef-6afcaf8b7efd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=83abce53-2091-4fe1-8d5f-679e8e676b8b,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:28.781090 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 37820) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:28.785113 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-17489c4e-61e6-4272-b3b6-081d291fd3d6 admin admin] Publish callbacks [] for security_group (e5cf0c7c-8110-472e-9da2-c8f17d61f6d3), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:28.856214 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e0b814b0-b188-4139-bb17-7ccd2c959f4d admin admin] Publish callbacks [] for security_group (83abce53-2091-4fe1-8d5f-679e8e676b8b), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:28.875120 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-17489c4e-61e6-4272-b3b6-081d291fd3d6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (e5cf0c7c-8110-472e-9da2-c8f17d61f6d3), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:28.877618 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-17489c4e-61e6-4272-b3b6-081d291fd3d6 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:28.878737 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-17489c4e-61e6-4272-b3b6-081d291fd3d6 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/e5cf0c7c-8110-472e-9da2-c8f17d61f6d3 HTTP/1.1" status: 204 len: 168 time: 0.1671658 Feb 08 18:13:28.885646 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e0b814b0-b188-4139-bb17-7ccd2c959f4d admin admin] Publish callbacks [] for security_group (83abce53-2091-4fe1-8d5f-679e8e676b8b), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:28.897124 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17489c4e-61e6-4272-b3b6-081d291fd3d6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e5cf0c7c-8110-472e-9da2-c8f17d61f6d3,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:28.957468 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e0b814b0-b188-4139-bb17-7ccd2c959f4d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (83abce53-2091-4fe1-8d5f-679e8e676b8b), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:28.961979 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e0b814b0-b188-4139-bb17-7ccd2c959f4d admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:28.965698 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-e0b814b0-b188-4139-bb17-7ccd2c959f4d admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/83abce53-2091-4fe1-8d5f-679e8e676b8b HTTP/1.1" status: 204 len: 168 time: 0.1806221 Feb 08 18:13:28.974817 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e0b814b0-b188-4139-bb17-7ccd2c959f4d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=83abce53-2091-4fe1-8d5f-679e8e676b8b,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:29.023676 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f37c26f-78a2-4a8c-8647-715a5c538e6a req-52fef744-54ff-47f5-8ead-539176e8b112 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:29.025248 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9f37c26f-78a2-4a8c-8647-715a5c538e6a req-52fef744-54ff-47f5-8ead-539176e8b112 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0630355 Feb 08 18:13:29.077455 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9f37c26f-78a2-4a8c-8647-715a5c538e6a req-f963e5ce-b130-4fc6-94e7-2536d9f1a3f7 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0456176 Feb 08 18:13:29.204161 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcadf0e9-a1be-4c66-91aa-87247e64880f req-d62c67b0-34bf-46ae-9252-4ec6361b1ca7 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:29.205640 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-dcadf0e9-a1be-4c66-91aa-87247e64880f req-d62c67b0-34bf-46ae-9252-4ec6361b1ca7 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0601864 Feb 08 18:13:29.260350 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-dcadf0e9-a1be-4c66-91aa-87247e64880f req-23667094-4c77-4a75-b4d2-070dc93359a0 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0479872 Feb 08 18:13:29.280686 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 37840) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:29.294693 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1c3a011c-a389-4bed-8749-eb9ce6125831 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:29.381815 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1c3a011c-a389-4bed-8749-eb9ce6125831 admin admin] Publish callbacks [] for security_group (e2fa9401-11a9-48c9-8615-44ae195a4ef1), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:29.387197 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1c3a011c-a389-4bed-8749-eb9ce6125831 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (e2fa9401-11a9-48c9-8615-44ae195a4ef1), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:29.430679 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-1c3a011c-a389-4bed-8749-eb9ce6125831 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=94341fbb98244b38bc4c19feac91cf5c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1486654 Feb 08 18:13:29.433297 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 37846) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:29.436967 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c3a011c-a389-4bed-8749-eb9ce6125831 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e2fa9401-11a9-48c9-8615-44ae195a4ef1,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:29.499129 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-26a4a602-6881-4288-bfe0-4c091afe29f6 admin admin] Publish callbacks [] for security_group (e2fa9401-11a9-48c9-8615-44ae195a4ef1), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:29.528868 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-26a4a602-6881-4288-bfe0-4c091afe29f6 admin admin] Publish callbacks [] for security_group (e2fa9401-11a9-48c9-8615-44ae195a4ef1), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:29.601120 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-26a4a602-6881-4288-bfe0-4c091afe29f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (e2fa9401-11a9-48c9-8615-44ae195a4ef1), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:29.604915 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-26a4a602-6881-4288-bfe0-4c091afe29f6 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:29.607531 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-26a4a602-6881-4288-bfe0-4c091afe29f6 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/e2fa9401-11a9-48c9-8615-44ae195a4ef1 HTTP/1.1" status: 204 len: 168 time: 0.1723723 Feb 08 18:13:29.619734 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26a4a602-6881-4288-bfe0-4c091afe29f6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e2fa9401-11a9-48c9-8615-44ae195a4ef1,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:29.708122 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-793f1f52-ac95-42f2-8846-22797bd6783d req-b38ab546-41df-4e2d-9d7c-adb1372147e5 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:29.715954 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-793f1f52-ac95-42f2-8846-22797bd6783d req-b38ab546-41df-4e2d-9d7c-adb1372147e5 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=d2fb9a58-8375-440e-8e25-2a60d637eb7a HTTP/1.1" status: 200 len: 944 time: 0.1402318 Feb 08 18:13:29.764924 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-793f1f52-ac95-42f2-8846-22797bd6783d req-a2cc8000-b0fe-40f7-80db-db2a8fd25a3e tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0480721 Feb 08 18:13:30.075670 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 5676d44a-8ef0-472a-9703-1a68bebb5ad4 up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:13:30.141177 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning for port 5676d44a-8ef0-472a-9703-1a68bebb5ad4 completed by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Feb 08 18:13:30.145950 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port 5676d44a-8ef0-472a-9703-1a68bebb5ad4 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:30.145950 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (5676d44a-8ef0-472a-9703-1a68bebb5ad4), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:30.232519 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 5676d44a-8ef0-472a-9703-1a68bebb5ad4 is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:30.233004 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (5676d44a-8ef0-472a-9703-1a68bebb5ad4), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:30.261545 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd2fb9a58-8375-440e-8e25-2a60d637eb7a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5676d44a-8ef0-472a-9703-1a68bebb5ad4'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:13:30.263810 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b35e8e34-5ba2-4fba-b2b4-f65e2533011e" -d '{"events": [{"server_uuid": "d2fb9a58-8375-440e-8e25-2a60d637eb7a", "name": "network-vif-plugged", "status": "completed", "tag": "5676d44a-8ef0-472a-9703-1a68bebb5ad4"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:13:30.283161 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 5676d44a-8ef0-472a-9703-1a68bebb5ad4, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=5676d44a-8ef0-472a-9703-1a68bebb5ad4,segment=NetworkSegment(acdb31ea-e529-495f-b01f-8c3d7b96781f),segment_id=acdb31ea-e529-495f-b01f-8c3d7b96781f)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:13:30.291154 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (5676d44a-8ef0-472a-9703-1a68bebb5ad4), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:30.337777 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:13:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ffc715cb-211f-458e-a5f0-a22ce37bc9a5 x-openstack-request-id: req-ffc715cb-211f-458e-a5f0-a22ce37bc9a5 {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:13:30.338202 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d2fb9a58-8375-440e-8e25-2a60d637eb7a", "name": "network-vif-plugged", "status": "completed", "tag": "5676d44a-8ef0-472a-9703-1a68bebb5ad4", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:13:30.338721 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-ffc715cb-211f-458e-a5f0-a22ce37bc9a5 {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:13:30.339308 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd2fb9a58-8375-440e-8e25-2a60d637eb7a', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5676d44a-8ef0-472a-9703-1a68bebb5ad4', 'code': 200} Feb 08 18:13:30.354884 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=5676d44a-8ef0-472a-9703-1a68bebb5ad4,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:30.525813 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b04f7494-ab8d-4481-9d50-63cb79e8e2cc req-1acce928-3700-4823-85ea-6391c0dd9ef3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:30.527345 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b04f7494-ab8d-4481-9d50-63cb79e8e2cc req-1acce928-3700-4823-85ea-6391c0dd9ef3 service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=d2fb9a58-8375-440e-8e25-2a60d637eb7a HTTP/1.1" status: 200 len: 1129 time: 0.0441196 Feb 08 18:13:30.581018 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b04f7494-ab8d-4481-9d50-63cb79e8e2cc req-f2b272c9-6f8d-46f4-b2b2-54a868c239eb service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0390770 Feb 08 18:13:30.898094 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49ec5d0f-842a-4e4a-bfe1-bb00096bfbf5 req-6536139f-9190-4882-bd42-2266a6fd8aa5 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:30.899503 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-49ec5d0f-842a-4e4a-bfe1-bb00096bfbf5 req-6536139f-9190-4882-bd42-2266a6fd8aa5 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=d2fb9a58-8375-440e-8e25-2a60d637eb7a HTTP/1.1" status: 200 len: 945 time: 0.0551434 Feb 08 18:13:30.957054 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-49ec5d0f-842a-4e4a-bfe1-bb00096bfbf5 req-c9b47987-6c46-408a-923c-f37f55126557 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516796 Feb 08 18:13:31.050092 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71c0ec6b-b49e-4c73-9663-42ca84f16ee6 req-0658987c-ca10-41f9-a5e6-bb847a9743e1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:31.051678 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-71c0ec6b-b49e-4c73-9663-42ca84f16ee6 req-0658987c-ca10-41f9-a5e6-bb847a9743e1 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=3fb51fc0e23f4c66a482d4d406197299&device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 1130 time: 0.0913024 Feb 08 18:13:31.063807 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-046ede8a-2e80-4d3f-8e41-42d6dad1df48 req-2a0b0b80-9fc7-43fb-a8c8-f401cca6431d tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:31.065250 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-046ede8a-2e80-4d3f-8e41-42d6dad1df48 req-2a0b0b80-9fc7-43fb-a8c8-f401cca6431d tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0905435 Feb 08 18:13:31.166262 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-046ede8a-2e80-4d3f-8e41-42d6dad1df48 req-16b00d90-2305-4041-a27a-6946d9d8606f tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0953624 Feb 08 18:13:31.205393 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71c0ec6b-b49e-4c73-9663-42ca84f16ee6 req-9f699662-85e8-42fd-9cd7-39585bdf8ce1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:31.207028 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-71c0ec6b-b49e-4c73-9663-42ca84f16ee6 req-9f699662-85e8-42fd-9cd7-39585bdf8ce1 service neutron] 10.222.0.109 "GET /v2.0/networks?id=f089911e-72de-4ff6-880b-ac3dd7927165 HTTP/1.1" status: 200 len: 921 time: 0.1179421 Feb 08 18:13:31.255690 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-71c0ec6b-b49e-4c73-9663-42ca84f16ee6 req-f17fc96b-e107-49da-aefa-1973d9826d2a service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=f63fc38b-d10b-4316-b77f-d1816d07ca90 HTTP/1.1" status: 200 len: 217 time: 0.0393946 Feb 08 18:13:31.310093 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71c0ec6b-b49e-4c73-9663-42ca84f16ee6 req-a329631b-3b28-4131-9202-ec07faa880d4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:31.311577 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-71c0ec6b-b49e-4c73-9663-42ca84f16ee6 req-a329631b-3b28-4131-9202-ec07faa880d4 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=0af67967-364e-4325-b04f-b7e157c3c3d4 HTTP/1.1" status: 200 len: 859 time: 0.0449860 Feb 08 18:13:31.361768 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-71c0ec6b-b49e-4c73-9663-42ca84f16ee6 req-233b4793-98f3-41e2-95cc-2863603bd904 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=f089911e-72de-4ff6-880b-ac3dd7927165&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0312817 Feb 08 18:13:31.460409 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-71c0ec6b-b49e-4c73-9663-42ca84f16ee6 req-95ba3b86-1a7a-4c55-b1ed-34ce1f4aefe3 service neutron] 10.222.0.109 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0899007 Feb 08 18:13:31.553099 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-71c0ec6b-b49e-4c73-9663-42ca84f16ee6 req-200010ed-333d-448c-80f3-9dc809a9a8fd service neutron] 10.222.0.109 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0859501 Feb 08 18:13:32.092410 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f68e018e-d803-4150-8e86-ef11eea36c72 req-7ee1375d-28c9-4af7-90de-5b494d18dd9b tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:32.093952 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f68e018e-d803-4150-8e86-ef11eea36c72 req-7ee1375d-28c9-4af7-90de-5b494d18dd9b tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=d2fb9a58-8375-440e-8e25-2a60d637eb7a HTTP/1.1" status: 200 len: 945 time: 0.0623083 Feb 08 18:13:32.140924 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f68e018e-d803-4150-8e86-ef11eea36c72 req-9c843886-264b-42e8-bc65-e8e646f3d3ad tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411630 Feb 08 18:13:32.159342 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 37960) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:32.276223 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1fd11643-5192-4b2b-a3e4-1e57ebe81e70 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:32.312291 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b0acc8c-6f65-4070-b922-a84b09e6577e req-8efd86ca-fd1e-4ecc-b381-77e3c6f624ca tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:32.313747 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2b0acc8c-6f65-4070-b922-a84b09e6577e req-8efd86ca-fd1e-4ecc-b381-77e3c6f624ca tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0793114 Feb 08 18:13:32.381266 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2b0acc8c-6f65-4070-b922-a84b09e6577e req-82f83f7c-3548-4888-92d4-e273fde844ea tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0604513 Feb 08 18:13:32.400251 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1fd11643-5192-4b2b-a3e4-1e57ebe81e70 admin admin] Publish callbacks [] for security_group (9a2e8968-3f4c-4de4-81c3-0fe52c9e46e2), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:32.406224 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1fd11643-5192-4b2b-a3e4-1e57ebe81e70 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (9a2e8968-3f4c-4de4-81c3-0fe52c9e46e2), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:32.447200 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fd11643-5192-4b2b-a3e4-1e57ebe81e70 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a2e8968-3f4c-4de4-81c3-0fe52c9e46e2,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:32.451383 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-1fd11643-5192-4b2b-a3e4-1e57ebe81e70 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=d6690c2a394f400da037d3e0e4b4a62f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2908444 Feb 08 18:13:32.454421 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 37970) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:32.505061 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-db002567-abae-4146-b0c0-f66efb94f601 admin admin] Publish callbacks [] for security_group (9a2e8968-3f4c-4de4-81c3-0fe52c9e46e2), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:32.526811 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-db002567-abae-4146-b0c0-f66efb94f601 admin admin] Publish callbacks [] for security_group (9a2e8968-3f4c-4de4-81c3-0fe52c9e46e2), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:32.576941 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-db002567-abae-4146-b0c0-f66efb94f601 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (9a2e8968-3f4c-4de4-81c3-0fe52c9e46e2), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:32.579659 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-db002567-abae-4146-b0c0-f66efb94f601 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:32.580798 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-db002567-abae-4146-b0c0-f66efb94f601 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/9a2e8968-3f4c-4de4-81c3-0fe52c9e46e2 HTTP/1.1" status: 204 len: 168 time: 0.1254277 Feb 08 18:13:32.595547 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db002567-abae-4146-b0c0-f66efb94f601 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a2e8968-3f4c-4de4-81c3-0fe52c9e46e2,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:33.260859 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-776a3073-cf28-4405-9dc8-05992c009836 req-dfe0e34e-a224-4328-893a-29336db139ac tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:33.262220 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-776a3073-cf28-4405-9dc8-05992c009836 req-dfe0e34e-a224-4328-893a-29336db139ac tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=d2fb9a58-8375-440e-8e25-2a60d637eb7a HTTP/1.1" status: 200 len: 945 time: 0.0511203 Feb 08 18:13:33.309321 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-776a3073-cf28-4405-9dc8-05992c009836 req-a02ab943-88aa-4a9e-afff-d973f3fbf9b8 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413017 Feb 08 18:13:33.507154 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a56ea424-184f-479f-bf15-34ef6bb5c516 req-bc4e9805-53e8-41be-8466-712fb6b2fa9d tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:33.508683 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a56ea424-184f-479f-bf15-34ef6bb5c516 req-bc4e9805-53e8-41be-8466-712fb6b2fa9d tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0524793 Feb 08 18:13:33.557101 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a56ea424-184f-479f-bf15-34ef6bb5c516 req-d3017268-2f1c-4285-8b1e-a2cac5f7cb26 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427742 Feb 08 18:13:33.880466 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 38004) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:34.002041 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d6319752-0130-4013-9152-de1e141cb8d4 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:34.075762 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d6319752-0130-4013-9152-de1e141cb8d4 admin admin] Publish callbacks [] for security_group (33836417-9a21-4e0c-ad2b-d9844544a136), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:34.082021 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d6319752-0130-4013-9152-de1e141cb8d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (33836417-9a21-4e0c-ad2b-d9844544a136), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:34.121076 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d6319752-0130-4013-9152-de1e141cb8d4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=33836417-9a21-4e0c-ad2b-d9844544a136,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:34.138540 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-d6319752-0130-4013-9152-de1e141cb8d4 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=03f83b21e6a64479b69558e1262a0b1a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2453949 Feb 08 18:13:34.138540 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 38010) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:34.180888 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d5b90fcc-c742-4779-b818-b6114643cc94 admin admin] Publish callbacks [] for security_group (33836417-9a21-4e0c-ad2b-d9844544a136), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:34.202673 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d5b90fcc-c742-4779-b818-b6114643cc94 admin admin] Publish callbacks [] for security_group (33836417-9a21-4e0c-ad2b-d9844544a136), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:34.250838 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d5b90fcc-c742-4779-b818-b6114643cc94 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (33836417-9a21-4e0c-ad2b-d9844544a136), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:34.253531 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d5b90fcc-c742-4779-b818-b6114643cc94 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:34.254678 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-d5b90fcc-c742-4779-b818-b6114643cc94 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/33836417-9a21-4e0c-ad2b-d9844544a136 HTTP/1.1" status: 204 len: 168 time: 0.1241856 Feb 08 18:13:34.263530 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5b90fcc-c742-4779-b818-b6114643cc94 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=33836417-9a21-4e0c-ad2b-d9844544a136,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:34.532841 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 38030) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:34.546230 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-86fcc2fd-83ae-4a19-aebd-e772a7191d9f admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:34.647191 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-86fcc2fd-83ae-4a19-aebd-e772a7191d9f admin admin] Publish callbacks [] for security_group (f7d6e4a6-8779-4398-a40e-961f7b622ea5), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:34.652187 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-86fcc2fd-83ae-4a19-aebd-e772a7191d9f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (f7d6e4a6-8779-4398-a40e-961f7b622ea5), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:34.724274 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-86fcc2fd-83ae-4a19-aebd-e772a7191d9f admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=9e8a4d96affe4d638788bc61dd15826e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1880140 Feb 08 18:13:34.724744 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 38040) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:34.728323 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86fcc2fd-83ae-4a19-aebd-e772a7191d9f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f7d6e4a6-8779-4398-a40e-961f7b622ea5,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:34.742691 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca96fe64-9c29-49d5-9469-5ee69a50b9cc req-52d28123-5113-460b-917c-e3e1eb5eb005 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:34.744209 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ca96fe64-9c29-49d5-9469-5ee69a50b9cc req-52d28123-5113-460b-917c-e3e1eb5eb005 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.1102369 Feb 08 18:13:34.797068 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ca96fe64-9c29-49d5-9469-5ee69a50b9cc req-496a9726-0b90-43c8-8bcd-2d7ff44d756f tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462682 Feb 08 18:13:34.811169 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-69c6b430-ae93-484a-badc-0728aced7703 admin admin] Publish callbacks [] for security_group (f7d6e4a6-8779-4398-a40e-961f7b622ea5), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:34.833976 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-69c6b430-ae93-484a-badc-0728aced7703 admin admin] Publish callbacks [] for security_group (f7d6e4a6-8779-4398-a40e-961f7b622ea5), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:34.904238 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-69c6b430-ae93-484a-badc-0728aced7703 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (f7d6e4a6-8779-4398-a40e-961f7b622ea5), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:34.906957 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-69c6b430-ae93-484a-badc-0728aced7703 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:34.908564 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-69c6b430-ae93-484a-badc-0728aced7703 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/f7d6e4a6-8779-4398-a40e-961f7b622ea5 HTTP/1.1" status: 204 len: 168 time: 0.1828709 Feb 08 18:13:34.918474 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69c6b430-ae93-484a-badc-0728aced7703 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f7d6e4a6-8779-4398-a40e-961f7b622ea5,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:35.919078 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbf2d578-3940-463d-a5f6-921cc52d3b2d req-e09105a8-5d23-4ce5-9b40-01fa5804d5fd tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:35.923318 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-bbf2d578-3940-463d-a5f6-921cc52d3b2d req-e09105a8-5d23-4ce5-9b40-01fa5804d5fd tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0573080 Feb 08 18:13:35.983492 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-bbf2d578-3940-463d-a5f6-921cc52d3b2d req-52a39495-b256-4305-a1de-a4570daa2a47 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0569422 Feb 08 18:13:37.104036 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad6c91b0-c2e4-42af-ac88-89b9dfa293e2 req-3374921e-9035-48a0-a5f2-87dd9ffc52e5 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:37.105540 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ad6c91b0-c2e4-42af-ac88-89b9dfa293e2 req-3374921e-9035-48a0-a5f2-87dd9ffc52e5 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0571070 Feb 08 18:13:37.158367 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ad6c91b0-c2e4-42af-ac88-89b9dfa293e2 req-ffbec648-8c47-4b03-a388-04f451706aad tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470510 Feb 08 18:13:37.262422 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-a18bcd57-b7e5-4e51-9239-67617b1a895e tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.118 "GET /v2.0/networks?tenant_id=3e4cabb4ec92455bb1039d17ea1c0339&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0345840 Feb 08 18:13:37.652910 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-ab18a3b0-5928-4e6e-a50b-60c1a5333a5b tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:37.654363 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-ab18a3b0-5928-4e6e-a50b-60c1a5333a5b tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.118 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3867047 Feb 08 18:13:37.669357 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-f0f090ad-5987-4ccb-9bfa-2d61bcb09ee9 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.118 "GET /v2.0/quotas/3e4cabb4ec92455bb1039d17ea1c0339 HTTP/1.1" status: 200 len: 375 time: 0.0095050 Feb 08 18:13:37.707098 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-61ee6700-0d69-4420-bab7-6749d95be0ac tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.118 "GET /v2.0/ports?tenant_id=3e4cabb4ec92455bb1039d17ea1c0339&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0320261 Feb 08 18:13:37.877403 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-26f31b9d-644d-41ce-9cfc-baf7260b509c req-ba172934-2960-4561-9379-b8c28db5e765 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.118 "GET /v2.0/ports?device_id=fb86a1f9-6c7c-4d52-ad74-316450a98f42 HTTP/1.1" status: 200 len: 210 time: 0.0274630 Feb 08 18:13:38.288270 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-292edde2-1158-4c5e-8d7c-d34bb5ba3bf5 req-fdaaed26-d9c4-4864-855e-7180589fb9d2 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:38.289628 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-292edde2-1158-4c5e-8d7c-d34bb5ba3bf5 req-fdaaed26-d9c4-4864-855e-7180589fb9d2 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0553894 Feb 08 18:13:38.337341 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-292edde2-1158-4c5e-8d7c-d34bb5ba3bf5 req-2b186416-bd71-4fa1-ae2b-0ba5a139c9c9 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417886 Feb 08 18:13:38.848321 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-9340221c-c2dc-4672-b398-b89935aa7072 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.109 "GET /v2.0/networks?tenant_id=3e4cabb4ec92455bb1039d17ea1c0339&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0334179 Feb 08 18:13:39.002225 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a2052626-0e13-40d7-9a9d-1e9c74916ef5 req-877f1bbe-a89b-43d5-aed6-aa0e9a22f0a8 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.118 "GET /v2.0/ports?device_id=fb86a1f9-6c7c-4d52-ad74-316450a98f42 HTTP/1.1" status: 200 len: 210 time: 0.0532794 Feb 08 18:13:39.068720 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-dbc1afde-cceb-4d63-a852-e32d43ca2e02 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:39.070137 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-dbc1afde-cceb-4d63-a852-e32d43ca2e02 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.109 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.2143078 Feb 08 18:13:39.091043 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-46e2efce-02ac-485b-82fd-703158ad3d2e tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Request body: {'port': {'device_id': 'fb86a1f9-6c7c-4d52-ad74-316450a98f42', 'network_id': '0e45e9f5-b786-4875-81b2-3623bb709dc6', 'admin_state_up': True, 'tenant_id': '3e4cabb4ec92455bb1039d17ea1c0339'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:13:39.202822 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-46e2efce-02ac-485b-82fd-703158ad3d2e tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Made reservation on behalf of 3e4cabb4ec92455bb1039d17ea1c0339 for: {'port': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:13:39.206160 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-46e2efce-02ac-485b-82fd-703158ad3d2e tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:39.214396 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-46e2efce-02ac-485b-82fd-703158ad3d2e tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:39.292120 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-46e2efce-02ac-485b-82fd-703158ad3d2e tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Publish callbacks [] for security_group (554e9f35-c52e-4f9b-8a51-a983fe72dbe4), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:39.302970 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-46e2efce-02ac-485b-82fd-703158ad3d2e tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (554e9f35-c52e-4f9b-8a51-a983fe72dbe4), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:39.367039 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46e2efce-02ac-485b-82fd-703158ad3d2e tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Pushing event updated for resources: {'SecurityGroup': ['ID=554e9f35-c52e-4f9b-8a51-a983fe72dbe4,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:39.447832 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-46e2efce-02ac-485b-82fd-703158ad3d2e tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Allocated IP 192.168.233.109 (0e45e9f5-b786-4875-81b2-3623bb709dc6/cbe0418d-c54a-4c73-9109-d1357b7f7680/50fd9608-2dd8-44fa-bf18-dfa18cd45e68) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:13:39.457996 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-397713d8-66f5-4760-b8d5-00e5c05acc64 req-70339e88-6339-43d7-8220-82a8a50c3fe8 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:39.459569 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-397713d8-66f5-4760-b8d5-00e5c05acc64 req-70339e88-6339-43d7-8220-82a8a50c3fe8 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0510952 Feb 08 18:13:39.504588 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-397713d8-66f5-4760-b8d5-00e5c05acc64 req-b9ebf191-0dc2-4f8e-be82-ed9b496f49ed tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0389471 Feb 08 18:13:39.590355 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-46e2efce-02ac-485b-82fd-703158ad3d2e tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Publish callbacks [] for port (50fd9608-2dd8-44fa-bf18-dfa18cd45e68), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:39.625111 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-46e2efce-02ac-485b-82fd-703158ad3d2e tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (50fd9608-2dd8-44fa-bf18-dfa18cd45e68), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:39.670797 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-46e2efce-02ac-485b-82fd-703158ad3d2e tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Network 0e45e9f5-b786-4875-81b2-3623bb709dc6 is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:13:39.674057 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-46e2efce-02ac-485b-82fd-703158ad3d2e tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:13:39.677638 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-46e2efce-02ac-485b-82fd-703158ad3d2e tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:13:39.683010 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-46e2efce-02ac-485b-82fd-703158ad3d2e tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:39.683633 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-46e2efce-02ac-485b-82fd-703158ad3d2e tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:39.689538 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-46e2efce-02ac-485b-82fd-703158ad3d2e tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Pushing event updated for resources: {'Port': ['ID=50fd9608-2dd8-44fa-bf18-dfa18cd45e68,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:39.707939 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-46e2efce-02ac-485b-82fd-703158ad3d2e tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.109 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 0.6204796 Feb 08 18:13:39.720979 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-23721d63-516f-44f3-966e-2f804f882435 service neutron] Request body: {'port': {'device_id': 'fb86a1f9-6c7c-4d52-ad74-316450a98f42', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77398'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:13:39.780233 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-23721d63-516f-44f3-966e-2f804f882435 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (50fd9608-2dd8-44fa-bf18-dfa18cd45e68), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:39.924809 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-aeb3e1b7-365e-4d4c-b9de-3f49a838d708 None None] Provisioning complete for port 50fd9608-2dd8-44fa-bf18-dfa18cd45e68 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:39.925411 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-aeb3e1b7-365e-4d4c-b9de-3f49a838d708 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (50fd9608-2dd8-44fa-bf18-dfa18cd45e68), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:39.963510 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-aeb3e1b7-365e-4d4c-b9de-3f49a838d708 None None] Port 50fd9608-2dd8-44fa-bf18-dfa18cd45e68 cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:13:40.045536 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-23721d63-516f-44f3-966e-2f804f882435 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 50fd9608-2dd8-44fa-bf18-dfa18cd45e68 {{(pid=102559) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:13:40.054145 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-23721d63-516f-44f3-966e-2f804f882435 service neutron] Publish callbacks [] for port (50fd9608-2dd8-44fa-bf18-dfa18cd45e68), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:40.067398 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.provisioning_blocks [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-23721d63-516f-44f3-966e-2f804f882435 service neutron] Transition to ACTIVE for port object 50fd9608-2dd8-44fa-bf18-dfa18cd45e68 will not be triggered until provisioned by entity L2. {{(pid=102559) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Feb 08 18:13:40.071297 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-23721d63-516f-44f3-966e-2f804f882435 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (50fd9608-2dd8-44fa-bf18-dfa18cd45e68), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:40.148991 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 38196) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:40.150614 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23721d63-516f-44f3-966e-2f804f882435 service neutron] Pushing event updated for resources: {'Port': ['ID=50fd9608-2dd8-44fa-bf18-dfa18cd45e68,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:40.196145 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-23721d63-516f-44f3-966e-2f804f882435 service neutron] Attempting to bind port 50fd9608-2dd8-44fa-bf18-dfa18cd45e68 on host hv-cinder-77398 for vnic_type normal with profile {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:13:40.196475 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-23721d63-516f-44f3-966e-2f804f882435 service neutron] Attempting to bind port 50fd9608-2dd8-44fa-bf18-dfa18cd45e68 by drivers openvswitch,hyperv on host hv-cinder-77398 at level 0 using segments [{'id': '154cb5f9-649d-4c0e-87ea-ee1bef794d47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1059, 'network_id': '0e45e9f5-b786-4875-81b2-3623bb709dc6'}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:13:40.196802 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-23721d63-516f-44f3-966e-2f804f882435 service neutron] Attempting to bind port 50fd9608-2dd8-44fa-bf18-dfa18cd45e68 on network 0e45e9f5-b786-4875-81b2-3623bb709dc6 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:13:40.203239 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-23721d63-516f-44f3-966e-2f804f882435 service neutron] Port 50fd9608-2dd8-44fa-bf18-dfa18cd45e68 on network 0e45e9f5-b786-4875-81b2-3623bb709dc6 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77398 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Feb 08 18:13:40.203556 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-23721d63-516f-44f3-966e-2f804f882435 service neutron] Attempting to bind port 50fd9608-2dd8-44fa-bf18-dfa18cd45e68 on network 0e45e9f5-b786-4875-81b2-3623bb709dc6 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:13:40.211630 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c23b994a-d5fd-473a-ace3-2c4090f2676d req-43fb0f21-b01c-4cc1-b9d0-cef4db26fcde tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:40.213149 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c23b994a-d5fd-473a-ace3-2c4090f2676d req-43fb0f21-b01c-4cc1-b9d0-cef4db26fcde tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.118 "GET /v2.0/ports?device_id=fb86a1f9-6c7c-4d52-ad74-316450a98f42 HTTP/1.1" status: 200 len: 948 time: 0.1194711 Feb 08 18:13:40.217333 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-23721d63-516f-44f3-966e-2f804f882435 service neutron] Checking agent: {'id': '045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77398', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'started_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 13, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:13:40.217664 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-23721d63-516f-44f3-966e-2f804f882435 service neutron] Checking segment: {'id': '154cb5f9-649d-4c0e-87ea-ee1bef794d47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1059, 'network_id': '0e45e9f5-b786-4875-81b2-3623bb709dc6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102559) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:13:40.218043 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-23721d63-516f-44f3-966e-2f804f882435 service neutron] Bound using segment: {'id': '154cb5f9-649d-4c0e-87ea-ee1bef794d47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1059, 'network_id': '0e45e9f5-b786-4875-81b2-3623bb709dc6'} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:13:40.218468 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-23721d63-516f-44f3-966e-2f804f882435 service neutron] Bound port: 50fd9608-2dd8-44fa-bf18-dfa18cd45e68, host: hv-cinder-77398, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '154cb5f9-649d-4c0e-87ea-ee1bef794d47', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1059, 'network_id': '0e45e9f5-b786-4875-81b2-3623bb709dc6'}}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:13:40.218970 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-23721d63-516f-44f3-966e-2f804f882435 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (50fd9608-2dd8-44fa-bf18-dfa18cd45e68), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:40.264063 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b28cbc6e-2498-44df-aadd-3d733cb99510 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:40.309484 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c23b994a-d5fd-473a-ace3-2c4090f2676d req-4e478354-fdb1-4222-a88f-0e93aef16291 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.118 "GET /v2.0/security-groups?id=554e9f35-c52e-4f9b-8a51-a983fe72dbe4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0873635 Feb 08 18:13:40.315025 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-23721d63-516f-44f3-966e-2f804f882435 service neutron] For port 50fd9608-2dd8-44fa-bf18-dfa18cd45e68, host hv-cinder-77398, cleared binding levels {{(pid=102559) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:13:40.318420 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-23721d63-516f-44f3-966e-2f804f882435 service neutron] For port 50fd9608-2dd8-44fa-bf18-dfa18cd45e68, host hv-cinder-77398, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=50fd9608-2dd8-44fa-bf18-dfa18cd45e68,segment=NetworkSegment(154cb5f9-649d-4c0e-87ea-ee1bef794d47),segment_id=154cb5f9-649d-4c0e-87ea-ee1bef794d47)] {{(pid=102559) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:13:40.324632 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-23721d63-516f-44f3-966e-2f804f882435 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (50fd9608-2dd8-44fa-bf18-dfa18cd45e68), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:40.353947 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b28cbc6e-2498-44df-aadd-3d733cb99510 admin admin] Publish callbacks [] for security_group (8a53c0cc-d2f1-4bea-a805-db7e657de7c6), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:40.357616 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-23721d63-516f-44f3-966e-2f804f882435 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:40.358226 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-23721d63-516f-44f3-966e-2f804f882435 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:40.359673 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-23721d63-516f-44f3-966e-2f804f882435 service neutron] 10.222.0.109 "PUT /v2.0/ports/50fd9608-2dd8-44fa-bf18-dfa18cd45e68 HTTP/1.1" status: 200 len: 1098 time: 0.6429954 Feb 08 18:13:40.360093 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'fb86a1f9-6c7c-4d52-ad74-316450a98f42', 'tag': '50fd9608-2dd8-44fa-bf18-dfa18cd45e68'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:13:40.360354 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b28cbc6e-2498-44df-aadd-3d733cb99510 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (8a53c0cc-d2f1-4bea-a805-db7e657de7c6), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:40.362303 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-69960b7b-7cc1-47c1-b086-7b5187855c84" -d '{"events": [{"name": "network-changed", "server_uuid": "fb86a1f9-6c7c-4d52-ad74-316450a98f42", "tag": "50fd9608-2dd8-44fa-bf18-dfa18cd45e68"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:13:40.400236 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23721d63-516f-44f3-966e-2f804f882435 service neutron] Pushing event updated for resources: {'Port': ['ID=50fd9608-2dd8-44fa-bf18-dfa18cd45e68,revision_number=3']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:40.412065 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b28cbc6e-2498-44df-aadd-3d733cb99510 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8a53c0cc-d2f1-4bea-a805-db7e657de7c6,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:40.420872 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-b28cbc6e-2498-44df-aadd-3d733cb99510 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=9e1ac705ff1e4e33b91f1c0c39e4ba34&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2708037 Feb 08 18:13:40.421473 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 38204) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:40.446903 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:13:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d9c4bfd1-05d3-43bd-8ab4-0a84499c74bf x-openstack-request-id: req-d9c4bfd1-05d3-43bd-8ab4-0a84499c74bf {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:13:40.447530 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "fb86a1f9-6c7c-4d52-ad74-316450a98f42", "tag": "50fd9608-2dd8-44fa-bf18-dfa18cd45e68", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:13:40.447797 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-d9c4bfd1-05d3-43bd-8ab4-0a84499c74bf {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:13:40.448197 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'fb86a1f9-6c7c-4d52-ad74-316450a98f42', 'tag': '50fd9608-2dd8-44fa-bf18-dfa18cd45e68', 'status': 'completed', 'code': 200} Feb 08 18:13:40.482005 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d146f3ed-1d32-4107-a6e8-cf55c137db9d admin admin] Publish callbacks [] for security_group (8a53c0cc-d2f1-4bea-a805-db7e657de7c6), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:40.495656 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-b6058515-8a6d-41e2-bb5d-69b7af7eaff7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:40.497171 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-b6058515-8a6d-41e2-bb5d-69b7af7eaff7 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=3e4cabb4ec92455bb1039d17ea1c0339&device_id=fb86a1f9-6c7c-4d52-ad74-316450a98f42 HTTP/1.1" status: 200 len: 1132 time: 0.0762103 Feb 08 18:13:40.505177 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d146f3ed-1d32-4107-a6e8-cf55c137db9d admin admin] Publish callbacks [] for security_group (8a53c0cc-d2f1-4bea-a805-db7e657de7c6), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:40.539496 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-ca89e5cd-77f7-4625-b6a1-1879602578cb service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.109&port_id=50fd9608-2dd8-44fa-bf18-dfa18cd45e68 HTTP/1.1" status: 200 len: 217 time: 0.0352862 Feb 08 18:13:40.561482 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d146f3ed-1d32-4107-a6e8-cf55c137db9d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (8a53c0cc-d2f1-4bea-a805-db7e657de7c6), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:40.564835 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d146f3ed-1d32-4107-a6e8-cf55c137db9d admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:40.566339 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-d146f3ed-1d32-4107-a6e8-cf55c137db9d admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/8a53c0cc-d2f1-4bea-a805-db7e657de7c6 HTTP/1.1" status: 204 len: 168 time: 0.1433961 Feb 08 18:13:40.592573 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d146f3ed-1d32-4107-a6e8-cf55c137db9d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8a53c0cc-d2f1-4bea-a805-db7e657de7c6,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:40.624233 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-66befb79-1ae7-4f07-a3bf-6e4a7f28ab91 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:40.625726 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-66befb79-1ae7-4f07-a3bf-6e4a7f28ab91 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=cbe0418d-c54a-4c73-9109-d1357b7f7680 HTTP/1.1" status: 200 len: 843 time: 0.0778174 Feb 08 18:13:40.886954 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50aa56a4-f916-49f0-89b8-6c41d1b2620d req-fcc96c3c-e002-4a20-85ab-778161987a90 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:40.888413 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-50aa56a4-f916-49f0-89b8-6c41d1b2620d req-fcc96c3c-e002-4a20-85ab-778161987a90 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.2938223 Feb 08 18:13:40.903373 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-aec46445-6334-46d5-9c66-63bb036e3f99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:40.904786 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-aec46445-6334-46d5-9c66-63bb036e3f99 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=0e45e9f5-b786-4875-81b2-3623bb709dc6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1216 time: 0.2714341 Feb 08 18:13:40.986224 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-50aa56a4-f916-49f0-89b8-6c41d1b2620d req-e9e5d1d5-3498-462c-8e5f-48a26ecca7a6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0912786 Feb 08 18:13:41.019310 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-b3d4d5a2-2c1e-4468-b5ff-527a21beac54 service neutron] 10.222.0.109 "GET /v2.0/networks/0e45e9f5-b786-4875-81b2-3623bb709dc6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1039054 Feb 08 18:13:41.112241 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-33bdf8c7-b089-46f0-8450-457ce8ab9199 req-64532477-2b69-4460-a8c6-200fc8d4978a service neutron] 10.222.0.109 "GET /v2.0/networks/0e45e9f5-b786-4875-81b2-3623bb709dc6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0855780 Feb 08 18:13:41.218383 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69960b7b-7cc1-47c1-b086-7b5187855c84 req-9f480dda-da05-4163-900d-1f0974210c7d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:41.220296 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-69960b7b-7cc1-47c1-b086-7b5187855c84 req-9f480dda-da05-4163-900d-1f0974210c7d service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=3e4cabb4ec92455bb1039d17ea1c0339&device_id=fb86a1f9-6c7c-4d52-ad74-316450a98f42 HTTP/1.1" status: 200 len: 1132 time: 0.0469828 Feb 08 18:13:41.224088 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 38228) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:41.321865 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69960b7b-7cc1-47c1-b086-7b5187855c84 req-10b0c9f7-d865-4757-9e8a-8d6c9e2e45ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:41.323476 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-69960b7b-7cc1-47c1-b086-7b5187855c84 req-10b0c9f7-d865-4757-9e8a-8d6c9e2e45ce service neutron] 10.222.0.109 "GET /v2.0/networks?id=0e45e9f5-b786-4875-81b2-3623bb709dc6 HTTP/1.1" status: 200 len: 871 time: 0.0936894 Feb 08 18:13:41.387140 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-abf80337-0c33-4da3-95e6-1d131c4f1db7 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-835787450-network', 'tenant_id': '768f50510c57419e8a49ed0988014174'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:13:41.390746 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-69960b7b-7cc1-47c1-b086-7b5187855c84 req-b52f8df5-b0e7-4a72-b157-50a37d7add6d service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.109&port_id=50fd9608-2dd8-44fa-bf18-dfa18cd45e68 HTTP/1.1" status: 200 len: 217 time: 0.0601876 Feb 08 18:13:41.438821 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-abf80337-0c33-4da3-95e6-1d131c4f1db7 admin admin] Made reservation on behalf of 768f50510c57419e8a49ed0988014174 for: {'network': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:13:41.441167 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-abf80337-0c33-4da3-95e6-1d131c4f1db7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for network (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:41.448830 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ba4d7cb-0d42-45f5-bf56-612e13a44a0f req-18336d19-ae14-4dfa-b633-071f287764b7 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:41.450617 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5ba4d7cb-0d42-45f5-bf56-612e13a44a0f req-18336d19-ae14-4dfa-b633-071f287764b7 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.118 "GET /v2.0/ports?device_id=fb86a1f9-6c7c-4d52-ad74-316450a98f42 HTTP/1.1" status: 200 len: 948 time: 0.0575292 Feb 08 18:13:41.451530 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-abf80337-0c33-4da3-95e6-1d131c4f1db7 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:41.483502 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69960b7b-7cc1-47c1-b086-7b5187855c84 req-adbc3e2f-89bc-4058-935f-b3fff2920795 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:41.484966 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-69960b7b-7cc1-47c1-b086-7b5187855c84 req-adbc3e2f-89bc-4058-935f-b3fff2920795 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=cbe0418d-c54a-4c73-9109-d1357b7f7680 HTTP/1.1" status: 200 len: 843 time: 0.0877032 Feb 08 18:13:41.540671 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5ba4d7cb-0d42-45f5-bf56-612e13a44a0f req-34af7690-8029-4a5f-91df-43e43d46c6ad tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.118 "GET /v2.0/security-groups?id=554e9f35-c52e-4f9b-8a51-a983fe72dbe4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0831089 Feb 08 18:13:41.564295 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69960b7b-7cc1-47c1-b086-7b5187855c84 req-a4129459-fd35-4b4d-9d1f-52dfc002bff4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:41.565816 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-69960b7b-7cc1-47c1-b086-7b5187855c84 req-a4129459-fd35-4b4d-9d1f-52dfc002bff4 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=0e45e9f5-b786-4875-81b2-3623bb709dc6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1216 time: 0.0736663 Feb 08 18:13:41.623396 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-abf80337-0c33-4da3-95e6-1d131c4f1db7 admin admin] Publish callbacks [] for security_group (0e4ad37c-be38-425e-861c-c171db8e9663), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:41.629679 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-abf80337-0c33-4da3-95e6-1d131c4f1db7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (0e4ad37c-be38-425e-861c-c171db8e9663), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:41.659127 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-abf80337-0c33-4da3-95e6-1d131c4f1db7 admin admin] vlan segment allocate from pool success with {'vlan_id': 1066, 'physical_network': 'physnet1'} {{(pid=102559) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Feb 08 18:13:41.679893 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abf80337-0c33-4da3-95e6-1d131c4f1db7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0e4ad37c-be38-425e-861c-c171db8e9663,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:41.682816 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-abf80337-0c33-4da3-95e6-1d131c4f1db7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (fc5ec9ee-df90-46f3-bddf-aef0221d9066), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:41.683167 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.db.segments_db [None req-abf80337-0c33-4da3-95e6-1d131c4f1db7 admin admin] Added segment fc5ec9ee-df90-46f3-bddf-aef0221d9066 of type vlan for network 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 Feb 08 18:13:41.739417 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-69960b7b-7cc1-47c1-b086-7b5187855c84 req-61239089-0930-41ad-978d-e760d7d955fc service neutron] 10.222.0.109 "GET /v2.0/networks/0e45e9f5-b786-4875-81b2-3623bb709dc6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1656680 Feb 08 18:13:41.740882 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-abf80337-0c33-4da3-95e6-1d131c4f1db7 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8770558521384'] for network (2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:41.810425 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-abf80337-0c33-4da3-95e6-1d131c4f1db7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for network (2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:41.811436 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-abf80337-0c33-4da3-95e6-1d131c4f1db7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:41.812010 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-abf80337-0c33-4da3-95e6-1d131c4f1db7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:41.884328 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-abf80337-0c33-4da3-95e6-1d131c4f1db7 admin admin] 10.222.0.118 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.6590693 Feb 08 18:13:41.887542 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 38240) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:41.892500 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-f453db61-463a-4c89-81dc-2f1e0b157d80 admin admin] Request body: {'subnet': {'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-835787450-subnet', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'ip_version': 4}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:13:41.901473 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abf80337-0c33-4da3-95e6-1d131c4f1db7 admin admin] Pushing event updated for resources: {'Network': ['ID=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:41.906876 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-69960b7b-7cc1-47c1-b086-7b5187855c84 req-480ccb98-51cf-4cc8-a751-2819d523fd39 service neutron] 10.222.0.109 "GET /v2.0/networks/0e45e9f5-b786-4875-81b2-3623bb709dc6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1504385 Feb 08 18:13:41.911505 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Network 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 details requested by agent ovs-agent-dv-cinder-773985-21-iscsi with host dv-cinder-773985-21-iscsi {{(pid=102561) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Feb 08 18:13:41.915680 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f453db61-463a-4c89-81dc-2f1e0b157d80 admin admin] Made reservation on behalf of 768f50510c57419e8a49ed0988014174 for: {'subnet': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:13:41.918747 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f453db61-463a-4c89-81dc-2f1e0b157d80 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-64597491'] for subnet (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:42.087306 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f453db61-463a-4c89-81dc-2f1e0b157d80 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-64531473', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-64597453'] for subnet (7b1e16de-d9af-4f50-86d7-ee22c9e14b1b), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:42.104823 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 50fd9608-2dd8-44fa-bf18-dfa18cd45e68 details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:13:42.107282 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64039595-7802-452b-a5dd-542252a5371a req-d321850a-ca26-4ab6-9ed5-133a7d349b66 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:42.109437 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-64039595-7802-452b-a5dd-542252a5371a req-d321850a-ca26-4ab6-9ed5-133a7d349b66 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0564282 Feb 08 18:13:42.143974 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f453db61-463a-4c89-81dc-2f1e0b157d80 admin admin] Pushing event updated for resources: {'Subnet': ['ID=7b1e16de-d9af-4f50-86d7-ee22c9e14b1b,revision_number=0']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:42.154135 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f453db61-463a-4c89-81dc-2f1e0b157d80 admin admin] Checking segment: {'id': 'fc5ec9ee-df90-46f3-bddf-aef0221d9066', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1066, 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102560) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:13:42.154492 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f453db61-463a-4c89-81dc-2f1e0b157d80 admin admin] Network hostable DHCP agents. Network: 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74, hostable agents: ['006b5388-ac7d-4794-a124-14bb8e5d8fec'], hosted agents: [] {{(pid=102560) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Feb 08 18:13:42.165046 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-64039595-7802-452b-a5dd-542252a5371a req-5318838e-04c2-4665-a36e-fb4c8abb1393 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446265 Feb 08 18:13:42.172371 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f453db61-463a-4c89-81dc-2f1e0b157d80 admin admin] Network 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 is scheduled to be hosted by DHCP agent 006b5388-ac7d-4794-a124-14bb8e5d8fec with binding_index 1 {{(pid=102560) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Feb 08 18:13:42.187971 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-f453db61-463a-4c89-81dc-2f1e0b157d80 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773985-21-iscsi, 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74) {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:13:42.192329 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f453db61-463a-4c89-81dc-2f1e0b157d80 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:42.192923 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f453db61-463a-4c89-81dc-2f1e0b157d80 admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:42.197454 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ebc42e81-827b-4d71-8c4e-d4cc01c6453c None None] Network 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:13:42.209068 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-f453db61-463a-4c89-81dc-2f1e0b157d80 admin admin] 10.222.0.118 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.3204134 Feb 08 18:13:42.211721 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 38244) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:42.216163 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-b62cfa76-cedd-4844-99d8-b2e30ab7a020 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:13:42.236104 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b62cfa76-cedd-4844-99d8-b2e30ab7a020 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-557369', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6968'] for router (72b4fd56-6775-4076-9195-fe85693f53aa), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:42.237148 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b62cfa76-cedd-4844-99d8-b2e30ab7a020 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-557389', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-560615', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-578936', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6961'] for router (72b4fd56-6775-4076-9195-fe85693f53aa), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:42.270013 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 50fd9608-2dd8-44fa-bf18-dfa18cd45e68, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=50fd9608-2dd8-44fa-bf18-dfa18cd45e68,segment=NetworkSegment(154cb5f9-649d-4c0e-87ea-ee1bef794d47),segment_id=154cb5f9-649d-4c0e-87ea-ee1bef794d47)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:13:42.287088 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': '50fd9608-2dd8-44fa-bf18-dfa18cd45e68', 'network_id': '0e45e9f5-b786-4875-81b2-3623bb709dc6', 'port_id': '50fd9608-2dd8-44fa-bf18-dfa18cd45e68', 'mac_address': 'fa:16:3e:d9:71:49', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1059, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'cbe0418d-c54a-4c73-9109-d1357b7f7680', 'ip_address': '192.168.233.109'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:13:42.287943 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b62cfa76-cedd-4844-99d8-b2e30ab7a020 admin admin] Publish callbacks [] for router_controller (72b4fd56-6775-4076-9195-fe85693f53aa), precommit_add_association {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:42.353662 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 50fd9608-2dd8-44fa-bf18-dfa18cd45e68 is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:42.354042 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (50fd9608-2dd8-44fa-bf18-dfa18cd45e68), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:42.357587 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-85226bba-fd82-4b59-a70d-ee9b3f3cd789 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp7dd4f88d-be07-54f7-888b-e9d2dcd2237c-2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'project_id': '768f50510c57419e8a49ed0988014174', 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b'}]}} from dv-cinder-773985-21-iscsi. {{(pid=102561) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Feb 08 18:13:42.358352 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-85226bba-fd82-4b59-a70d-ee9b3f3cd789 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:42.380329 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 50fd9608-2dd8-44fa-bf18-dfa18cd45e68 {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:13:42.409235 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 50fd9608-2dd8-44fa-bf18-dfa18cd45e68, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=50fd9608-2dd8-44fa-bf18-dfa18cd45e68,segment=NetworkSegment(154cb5f9-649d-4c0e-87ea-ee1bef794d47),segment_id=154cb5f9-649d-4c0e-87ea-ee1bef794d47)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:13:42.426585 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b62cfa76-cedd-4844-99d8-b2e30ab7a020 admin admin] Publish callbacks [] for router_gateway (72b4fd56-6775-4076-9195-fe85693f53aa), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:42.586504 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (50fd9608-2dd8-44fa-bf18-dfa18cd45e68), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:42.675819 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=50fd9608-2dd8-44fa-bf18-dfa18cd45e68,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:42.682588 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b62cfa76-cedd-4844-99d8-b2e30ab7a020 admin admin] Publish callbacks [] for router_gateway (72b4fd56-6775-4076-9195-fe85693f53aa), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:42.693924 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.db_base_plugin_common [None req-85226bba-fd82-4b59-a70d-ee9b3f3cd789 None None] Allocated IP 172.20.0.2 (2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74/7b1e16de-d9af-4f50-86d7-ee22c9e14b1b/c2028811-a043-476c-9ae2-a8c0c41ed569) {{(pid=102561) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:13:42.704892 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b62cfa76-cedd-4844-99d8-b2e30ab7a020 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:42.722268 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5535ff70-3b06-4a30-92bb-239b97ac388d req-9968b117-2ac7-42ea-87f2-8f0b2d2216d4 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:42.723786 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5535ff70-3b06-4a30-92bb-239b97ac388d req-9968b117-2ac7-42ea-87f2-8f0b2d2216d4 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.118 "GET /v2.0/ports?device_id=fb86a1f9-6c7c-4d52-ad74-316450a98f42 HTTP/1.1" status: 200 len: 949 time: 0.1103728 Feb 08 18:13:42.844443 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5535ff70-3b06-4a30-92bb-239b97ac388d req-7f17eda2-b5ca-4b92-bc07-f430eb243665 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.118 "GET /v2.0/security-groups?id=554e9f35-c52e-4f9b-8a51-a983fe72dbe4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0889151 Feb 08 18:13:42.858815 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-85226bba-fd82-4b59-a70d-ee9b3f3cd789 None None] Publish callbacks [] for port (c2028811-a043-476c-9ae2-a8c0c41ed569), precommit_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:42.872662 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_common [None req-b62cfa76-cedd-4844-99d8-b2e30ab7a020 admin admin] Allocated IP 172.27.1.81 (77055816-7c88-403d-8f8a-9be2c1faa10d/18547c52-7b23-42cd-bb53-214663ed102b/a7d5d25e-891f-4939-b21a-46de63af2d71) {{(pid=102560) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:13:42.875109 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-85226bba-fd82-4b59-a70d-ee9b3f3cd789 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (c2028811-a043-476c-9ae2-a8c0c41ed569), after_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:42.913996 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['50fd9608-2dd8-44fa-bf18-dfa18cd45e68'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:13:42.918455 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85226bba-fd82-4b59-a70d-ee9b3f3cd789 None None] Network 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 is already hosted by enough agents. {{(pid=102561) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:13:42.962091 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.scheduler.base_scheduler [None req-85226bba-fd82-4b59-a70d-ee9b3f3cd789 None None] Resources bound (agent type, host, resource id): {{(pid=102561) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:13:42.966455 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85226bba-fd82-4b59-a70d-ee9b3f3cd789 None None] Received port after_create {{(pid=102561) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:13:42.969344 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85226bba-fd82-4b59-a70d-ee9b3f3cd789 None None] Pushing event updated for resources: {'Port': ['ID=c2028811-a043-476c-9ae2-a8c0c41ed569,revision_number=1']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:42.971916 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-664f9443-32c7-4059-9b30-fd89e008024e tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:42.974425 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-664f9443-32c7-4059-9b30-fd89e008024e tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/networks?id=622fcad3-2fd8-49df-8f66-feb243e2b24d HTTP/1.1" status: 200 len: 815 time: 0.1190553 Feb 08 18:13:43.000834 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-30223fe5-9f1f-4ed7-a74b-feb727c18a9c tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/quotas/602d106ac7104b10bebcfc0421ea5edc HTTP/1.1" status: 200 len: 375 time: 0.0204213 Feb 08 18:13:43.003113 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b62cfa76-cedd-4844-99d8-b2e30ab7a020 admin admin] Publish callbacks [] for port (a7d5d25e-891f-4939-b21a-46de63af2d71), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:43.054486 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b62cfa76-cedd-4844-99d8-b2e30ab7a020 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (a7d5d25e-891f-4939-b21a-46de63af2d71), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:43.059711 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-85226bba-fd82-4b59-a70d-ee9b3f3cd789 None None] Attempting to bind port c2028811-a043-476c-9ae2-a8c0c41ed569 on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:13:43.060122 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-85226bba-fd82-4b59-a70d-ee9b3f3cd789 None None] Attempting to bind port c2028811-a043-476c-9ae2-a8c0c41ed569 by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': 'fc5ec9ee-df90-46f3-bddf-aef0221d9066', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1066, 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74'}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:13:43.060437 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85226bba-fd82-4b59-a70d-ee9b3f3cd789 None None] Attempting to bind port c2028811-a043-476c-9ae2-a8c0c41ed569 on network 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:13:43.075864 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85226bba-fd82-4b59-a70d-ee9b3f3cd789 None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 13, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:13:43.076236 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85226bba-fd82-4b59-a70d-ee9b3f3cd789 None None] Checking segment: {'id': 'fc5ec9ee-df90-46f3-bddf-aef0221d9066', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1066, 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102561) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:13:43.076635 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-85226bba-fd82-4b59-a70d-ee9b3f3cd789 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:43.077019 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85226bba-fd82-4b59-a70d-ee9b3f3cd789 None None] Bound using segment: {'id': 'fc5ec9ee-df90-46f3-bddf-aef0221d9066', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1066, 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74'} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:13:43.077482 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-85226bba-fd82-4b59-a70d-ee9b3f3cd789 None None] Bound port: c2028811-a043-476c-9ae2-a8c0c41ed569, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fc5ec9ee-df90-46f3-bddf-aef0221d9066', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1066, 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74'}}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:13:43.077872 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-85226bba-fd82-4b59-a70d-ee9b3f3cd789 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (c2028811-a043-476c-9ae2-a8c0c41ed569), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:43.078505 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-25dd3fc7-46ae-4f3c-a29a-e709761f76f6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?tenant_id=602d106ac7104b10bebcfc0421ea5edc&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0763943 Feb 08 18:13:43.104789 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b62cfa76-cedd-4844-99d8-b2e30ab7a020 admin admin] Network 77055816-7c88-403d-8f8a-9be2c1faa10d is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:13:43.110401 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-b62cfa76-cedd-4844-99d8-b2e30ab7a020 admin admin] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:13:43.112935 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b62cfa76-cedd-4844-99d8-b2e30ab7a020 admin admin] Received port after_create {{(pid=102560) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:13:43.144576 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b62cfa76-cedd-4844-99d8-b2e30ab7a020 admin admin] Pushing event updated for resources: {'Port': ['ID=a7d5d25e-891f-4939-b21a-46de63af2d71,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:43.200717 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2bbcd22-1634-4e43-a9aa-3bf018506df5 req-859b9fbd-1583-4c78-98d2-198fee97477f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:43.202285 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a2bbcd22-1634-4e43-a9aa-3bf018506df5 req-859b9fbd-1583-4c78-98d2-198fee97477f service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 1130 time: 0.0746071 Feb 08 18:13:43.210187 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-6de6efe5-ea8a-4f14-b3d5-52ab89ec9a04 service neutron] 10.222.0.118 "GET /v2.0/networks/622fcad3-2fd8-49df-8f66-feb243e2b24d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1307640 Feb 08 18:13:43.231520 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-85226bba-fd82-4b59-a70d-ee9b3f3cd789 None None] For port c2028811-a043-476c-9ae2-a8c0c41ed569, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102561) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:13:43.245619 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-85226bba-fd82-4b59-a70d-ee9b3f3cd789 None None] For port c2028811-a043-476c-9ae2-a8c0c41ed569, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=c2028811-a043-476c-9ae2-a8c0c41ed569,segment=NetworkSegment(fc5ec9ee-df90-46f3-bddf-aef0221d9066),segment_id=fc5ec9ee-df90-46f3-bddf-aef0221d9066)] {{(pid=102561) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:13:43.259250 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-85226bba-fd82-4b59-a70d-ee9b3f3cd789 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (c2028811-a043-476c-9ae2-a8c0c41ed569), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:43.306191 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a2bbcd22-1634-4e43-a9aa-3bf018506df5 req-d1a3db8e-26c2-4183-9afd-dd15e1d0f058 service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0938487 Feb 08 18:13:43.329627 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85226bba-fd82-4b59-a70d-ee9b3f3cd789 None None] Pushing event updated for resources: {'Port': ['ID=c2028811-a043-476c-9ae2-a8c0c41ed569,revision_number=2']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:43.340648 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-8b1908ad-f8c8-4805-a170-6a12a9a313c2 service neutron] 10.222.0.118 "GET /v2.0/networks/622fcad3-2fd8-49df-8f66-feb243e2b24d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1295412 Feb 08 18:13:43.398289 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61484855-b444-4156-8130-cbba6045416f req-4685f647-53c5-4531-9ca9-c03ad56514aa tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:43.399840 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-61484855-b444-4156-8130-cbba6045416f req-4685f647-53c5-4531-9ca9-c03ad56514aa tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.1534216 Feb 08 18:13:43.491938 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-61484855-b444-4156-8130-cbba6045416f req-f939cbd5-5bd9-404b-b693-9eba139b34e5 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0782752 Feb 08 18:13:43.493318 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b62cfa76-cedd-4844-99d8-b2e30ab7a020 admin admin] Publish callbacks [] for router_gateway (72b4fd56-6775-4076-9195-fe85693f53aa), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:43.533209 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2a913950-7771-4d62-a1ee-8cac902cdba5 req-b2baab2a-0206-40d6-a9d7-39fec802da64 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea HTTP/1.1" status: 200 len: 210 time: 0.0313056 Feb 08 18:13:43.742993 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b62cfa76-cedd-4844-99d8-b2e30ab7a020 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-557494', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-560688'] for router (72b4fd56-6775-4076-9195-fe85693f53aa), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:43.881099 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b62cfa76-cedd-4844-99d8-b2e30ab7a020 admin admin] Router 72b4fd56-6775-4076-9195-fe85693f53aa is scheduled to L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 with binding_index 1 {{(pid=102560) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Feb 08 18:13:44.038272 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7403b161-dc64-40e3-9782-2baad0cf257f req-5f0f6e00-746d-45a5-bb59-9a042978852d tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:44.039734 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-7403b161-dc64-40e3-9782-2baad0cf257f req-5f0f6e00-746d-45a5-bb59-9a042978852d tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.118 "GET /v2.0/ports?device_id=fb86a1f9-6c7c-4d52-ad74-316450a98f42 HTTP/1.1" status: 200 len: 949 time: 0.1073442 Feb 08 18:13:44.044098 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b62cfa76-cedd-4844-99d8-b2e30ab7a020 admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:13:44.054523 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] Sync routers for ids ['72b4fd56-6775-4076-9195-fe85693f53aa'] in dv-cinder-773985-21-iscsi {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:13:44.078023 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b62cfa76-cedd-4844-99d8-b2e30ab7a020 admin admin] Publish callbacks [] for router (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:44.080263 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] Routers {'72b4fd56-6775-4076-9195-fe85693f53aa'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:13:44.081095 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:13:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['72b4fd56-6775-4076-9195-fe85693f53aa'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:13:44.082040 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 38280) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:44.082182 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-b62cfa76-cedd-4844-99d8-b2e30ab7a020 admin admin] 10.222.0.118 "POST /v2.0/routers HTTP/1.1" status: 201 len: 922 time: 1.8693466 Feb 08 18:13:44.105865 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 50fd9608-2dd8-44fa-bf18-dfa18cd45e68 up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:13:44.111438 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-7403b161-dc64-40e3-9782-2baad0cf257f req-28418ae2-039e-41aa-8bc8-6cf76f46f76c tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.118 "GET /v2.0/security-groups?id=554e9f35-c52e-4f9b-8a51-a983fe72dbe4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0654290 Feb 08 18:13:44.214854 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning for port 50fd9608-2dd8-44fa-bf18-dfa18cd45e68 completed by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Feb 08 18:13:44.219711 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port 50fd9608-2dd8-44fa-bf18-dfa18cd45e68 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:44.220276 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (50fd9608-2dd8-44fa-bf18-dfa18cd45e68), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:44.233877 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] Set router 72b4fd56-6775-4076-9195-fe85693f53aa gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:13:44.321255 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 50fd9608-2dd8-44fa-bf18-dfa18cd45e68 is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:44.322232 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (50fd9608-2dd8-44fa-bf18-dfa18cd45e68), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:44.365070 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 50fd9608-2dd8-44fa-bf18-dfa18cd45e68, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=50fd9608-2dd8-44fa-bf18-dfa18cd45e68,segment=NetworkSegment(154cb5f9-649d-4c0e-87ea-ee1bef794d47),segment_id=154cb5f9-649d-4c0e-87ea-ee1bef794d47)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:13:44.366296 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fb86a1f9-6c7c-4d52-ad74-316450a98f42', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '50fd9608-2dd8-44fa-bf18-dfa18cd45e68'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:13:44.370958 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-14ee3663-f009-4636-af65-d156799823f4" -d '{"events": [{"server_uuid": "fb86a1f9-6c7c-4d52-ad74-316450a98f42", "name": "network-vif-plugged", "status": "completed", "tag": "50fd9608-2dd8-44fa-bf18-dfa18cd45e68"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:13:44.375791 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (50fd9608-2dd8-44fa-bf18-dfa18cd45e68), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:44.421056 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:13:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c7d4ee74-11c9-46a7-ae49-eb19d920786f x-openstack-request-id: req-c7d4ee74-11c9-46a7-ae49-eb19d920786f {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:13:44.421479 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fb86a1f9-6c7c-4d52-ad74-316450a98f42", "name": "network-vif-plugged", "status": "completed", "tag": "50fd9608-2dd8-44fa-bf18-dfa18cd45e68", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:13:44.421849 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-c7d4ee74-11c9-46a7-ae49-eb19d920786f {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:13:44.422350 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fb86a1f9-6c7c-4d52-ad74-316450a98f42', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '50fd9608-2dd8-44fa-bf18-dfa18cd45e68', 'code': 200} Feb 08 18:13:44.441675 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=50fd9608-2dd8-44fa-bf18-dfa18cd45e68,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:44.456969 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:43Z', 'revision_number': 3, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:42Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:13:44.483806 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] Checking router: 72b4fd56-6775-4076-9195-fe85693f53aa for host: dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:13:44.484152 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] Updating router 72b4fd56-6775-4076-9195-fe85693f53aa port a7d5d25e-891f-4939-b21a-46de63af2d71 binding host dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Feb 08 18:13:44.505720 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b9cf4de3-fa78-48b0-a463-868a600b2231 None None] Network 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:13:44.552815 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (a7d5d25e-891f-4939-b21a-46de63af2d71), before_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:44.642541 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-66d73696-2ba8-408b-801c-17413c3c3fda None None] Provisioning complete for port c2028811-a043-476c-9ae2-a8c0c41ed569 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:44.642826 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-66d73696-2ba8-408b-801c-17413c3c3fda None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (c2028811-a043-476c-9ae2-a8c0c41ed569), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:44.670027 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9db72f9d-739d-45d6-ac70-d736c4e85d29 req-5c6b9738-0510-4997-bc27-16ea159a3c72 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:44.677941 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-9db72f9d-739d-45d6-ac70-d736c4e85d29 req-5c6b9738-0510-4997-bc27-16ea159a3c72 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.1059065 Feb 08 18:13:44.711888 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-adbf5777-5200-47c3-9f33-cb3933a9dab0 req-aa22c9c9-9c35-4efb-9bd8-26bf8230763b tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea HTTP/1.1" status: 200 len: 210 time: 0.0467246 Feb 08 18:13:44.721210 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-de7dddb8-77eb-40b9-b68f-3b1e4f8e8b43 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:44.741901 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de2ea506-5044-46e2-979d-593d4f91f9cf req-9841bb26-e47c-4f1b-a26a-013306a901fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:44.743466 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-de2ea506-5044-46e2-979d-593d4f91f9cf req-9841bb26-e47c-4f1b-a26a-013306a901fa service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=fb86a1f9-6c7c-4d52-ad74-316450a98f42 HTTP/1.1" status: 200 len: 1134 time: 0.1175907 Feb 08 18:13:44.793485 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-9db72f9d-739d-45d6-ac70-d736c4e85d29 req-df454f99-a57c-4ee0-ba9f-118bdd1fdbdd tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1139185 Feb 08 18:13:44.822930 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-66d73696-2ba8-408b-801c-17413c3c3fda None None] Current status of the port c2028811-a043-476c-9ae2-a8c0c41ed569 is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:44.823317 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-66d73696-2ba8-408b-801c-17413c3c3fda None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (c2028811-a043-476c-9ae2-a8c0c41ed569), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:44.887826 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-66d73696-2ba8-408b-801c-17413c3c3fda None None] For port c2028811-a043-476c-9ae2-a8c0c41ed569, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=c2028811-a043-476c-9ae2-a8c0c41ed569,segment=NetworkSegment(fc5ec9ee-df90-46f3-bddf-aef0221d9066),segment_id=fc5ec9ee-df90-46f3-bddf-aef0221d9066)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:13:44.897783 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-66d73696-2ba8-408b-801c-17413c3c3fda None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (c2028811-a043-476c-9ae2-a8c0c41ed569), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:44.906352 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-de2ea506-5044-46e2-979d-593d4f91f9cf req-0474161d-2935-436a-9426-6344c2f1f0f2 service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=554e9f35-c52e-4f9b-8a51-a983fe72dbe4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1509032 Feb 08 18:13:44.973627 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-da0052ef-76c2-4d02-9ba1-4d9c792ba66e tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:44.975539 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-da0052ef-76c2-4d02-9ba1-4d9c792ba66e tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.109 "GET /v2.0/networks?id=622fcad3-2fd8-49df-8f66-feb243e2b24d HTTP/1.1" status: 200 len: 815 time: 0.1806927 Feb 08 18:13:44.992719 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66d73696-2ba8-408b-801c-17413c3c3fda None None] Pushing event updated for resources: {'Port': ['ID=c2028811-a043-476c-9ae2-a8c0c41ed569,revision_number=3']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:45.006610 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [None req-de7dddb8-77eb-40b9-b68f-3b1e4f8e8b43 admin admin] Allocated IP 172.20.0.1 (2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74/7b1e16de-d9af-4f50-86d7-ee22c9e14b1b/13fcfd03-fc49-4bba-8574-ec74e795e2bd) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:13:45.060335 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] Publish callbacks [] for port (a7d5d25e-891f-4939-b21a-46de63af2d71), precommit_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:45.066813 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (a7d5d25e-891f-4939-b21a-46de63af2d71), after_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:45.114302 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93cc4ee6-2920-4b1b-9efe-17cf2171036e None None] Pushing event updated for resources: {'Port': ['ID=a7d5d25e-891f-4939-b21a-46de63af2d71,revision_number=2']} {{(pid=102562) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:45.125975 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93cc4ee6-2920-4b1b-9efe-17cf2171036e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:45.126340 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93cc4ee6-2920-4b1b-9efe-17cf2171036e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:45.126747 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93cc4ee6-2920-4b1b-9efe-17cf2171036e None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:45.127043 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93cc4ee6-2920-4b1b-9efe-17cf2171036e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:45.127364 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93cc4ee6-2920-4b1b-9efe-17cf2171036e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:45.127680 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93cc4ee6-2920-4b1b-9efe-17cf2171036e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:45.128172 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93cc4ee6-2920-4b1b-9efe-17cf2171036e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:45.128643 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93cc4ee6-2920-4b1b-9efe-17cf2171036e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:45.128964 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93cc4ee6-2920-4b1b-9efe-17cf2171036e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:45.129293 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93cc4ee6-2920-4b1b-9efe-17cf2171036e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:45.129609 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93cc4ee6-2920-4b1b-9efe-17cf2171036e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:45.130240 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93cc4ee6-2920-4b1b-9efe-17cf2171036e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:45.130590 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-93cc4ee6-2920-4b1b-9efe-17cf2171036e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:13:45.135900 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-7eb28af6-b98f-40cf-80cd-8d7689f70508 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Request body: {'port': {'device_id': '126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea', 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d', 'admin_state_up': True, 'tenant_id': '602d106ac7104b10bebcfc0421ea5edc'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:13:45.138470 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] Attempting to bind port a7d5d25e-891f-4939-b21a-46de63af2d71 on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:13:45.139045 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] Attempting to bind port a7d5d25e-891f-4939-b21a-46de63af2d71 by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}] {{(pid=102562) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:13:45.139402 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] Attempting to bind port a7d5d25e-891f-4939-b21a-46de63af2d71 on network 77055816-7c88-403d-8f8a-9be2c1faa10d {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:13:45.147175 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 13, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:13:45.147540 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] Checking segment: {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102562) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:13:45.147993 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:45.148313 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] Bound using segment: {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'} {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:13:45.148765 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] Bound port: a7d5d25e-891f-4939-b21a-46de63af2d71, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}}] {{(pid=102562) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:13:45.149124 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (a7d5d25e-891f-4939-b21a-46de63af2d71), before_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:45.176863 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-de7dddb8-77eb-40b9-b68f-3b1e4f8e8b43 admin admin] Publish callbacks [] for port (13fcfd03-fc49-4bba-8574-ec74e795e2bd), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:45.217276 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.db [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] For port a7d5d25e-891f-4939-b21a-46de63af2d71, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102562) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:13:45.222107 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-de7dddb8-77eb-40b9-b68f-3b1e4f8e8b43 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (13fcfd03-fc49-4bba-8574-ec74e795e2bd), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:45.223553 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.db [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] For port a7d5d25e-891f-4939-b21a-46de63af2d71, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=a7d5d25e-891f-4939-b21a-46de63af2d71,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102562) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:13:45.235766 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (a7d5d25e-891f-4939-b21a-46de63af2d71), after_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:45.256490 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-9b83fb86-6741-4fdf-829f-212a77b678dc None None] Provisioning complete for port c2028811-a043-476c-9ae2-a8c0c41ed569 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:45.257112 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-9b83fb86-6741-4fdf-829f-212a77b678dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (c2028811-a043-476c-9ae2-a8c0c41ed569), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:45.270054 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de7dddb8-77eb-40b9-b68f-3b1e4f8e8b43 admin admin] Network 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:13:45.274279 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-de7dddb8-77eb-40b9-b68f-3b1e4f8e8b43 admin admin] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:13:45.278458 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [None req-de7dddb8-77eb-40b9-b68f-3b1e4f8e8b43 admin admin] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:13:45.278636 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-de7dddb8-77eb-40b9-b68f-3b1e4f8e8b43 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-560871'] for router_interface (72b4fd56-6775-4076-9195-fe85693f53aa), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:45.324401 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93cc4ee6-2920-4b1b-9efe-17cf2171036e None None] Pushing event updated for resources: {'Port': ['ID=a7d5d25e-891f-4939-b21a-46de63af2d71,revision_number=3']} {{(pid=102562) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:45.366702 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] Routers {'72b4fd56-6775-4076-9195-fe85693f53aa'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:13:45.367363 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:13:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['72b4fd56-6775-4076-9195-fe85693f53aa'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:13:45.373379 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de7dddb8-77eb-40b9-b68f-3b1e4f8e8b43 admin admin] Pushing event updated for resources: {'Port': ['ID=13fcfd03-fc49-4bba-8574-ec74e795e2bd,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:45.398276 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cd4be16-8a0d-4782-9208-d540cc069699 req-7a153856-c930-4b00-bdfa-d7f870aac5e6 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:45.405544 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5cd4be16-8a0d-4782-9208-d540cc069699 req-7a153856-c930-4b00-bdfa-d7f870aac5e6 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.118 "GET /v2.0/ports?device_id=fb86a1f9-6c7c-4d52-ad74-316450a98f42 HTTP/1.1" status: 200 len: 950 time: 0.1696994 Feb 08 18:13:45.450198 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-9b83fb86-6741-4fdf-829f-212a77b678dc None None] Current status of the port c2028811-a043-476c-9ae2-a8c0c41ed569 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:45.464170 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-da74e1b0-ff60-4c60-9d4e-4629a97c7e16 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:45.524391 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5cd4be16-8a0d-4782-9208-d540cc069699 req-8293c2eb-d501-4987-9edb-646304504d4f tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.118 "GET /v2.0/security-groups?id=554e9f35-c52e-4f9b-8a51-a983fe72dbe4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1179316 Feb 08 18:13:45.583188 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-de7dddb8-77eb-40b9-b68f-3b1e4f8e8b43 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (13fcfd03-fc49-4bba-8574-ec74e795e2bd), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:45.600793 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] Set router 72b4fd56-6775-4076-9195-fe85693f53aa gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:13:45.623621 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-7eb28af6-b98f-40cf-80cd-8d7689f70508 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Made reservation on behalf of 602d106ac7104b10bebcfc0421ea5edc for: {'port': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:13:45.628154 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-7eb28af6-b98f-40cf-80cd-8d7689f70508 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:45.682847 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device c2028811-a043-476c-9ae2-a8c0c41ed569 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:13:45.712905 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-c9d95c6f-4222-4a53-b472-03daf31f8569 None None] Provisioning complete for port 13fcfd03-fc49-4bba-8574-ec74e795e2bd triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:45.713651 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-c9d95c6f-4222-4a53-b472-03daf31f8569 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (13fcfd03-fc49-4bba-8574-ec74e795e2bd), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:45.772458 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-c9d95c6f-4222-4a53-b472-03daf31f8569 None None] Port 13fcfd03-fc49-4bba-8574-ec74e795e2bd cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:13:45.783152 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port c2028811-a043-476c-9ae2-a8c0c41ed569 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:45.783987 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (c2028811-a043-476c-9ae2-a8c0c41ed569), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:45.793110 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-de7dddb8-77eb-40b9-b68f-3b1e4f8e8b43 admin admin] Publish callbacks [] for port (13fcfd03-fc49-4bba-8574-ec74e795e2bd), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:45.804266 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-de7dddb8-77eb-40b9-b68f-3b1e4f8e8b43 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (13fcfd03-fc49-4bba-8574-ec74e795e2bd), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:45.805011 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-de7dddb8-77eb-40b9-b68f-3b1e4f8e8b43 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-631683', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-559991'] for router_interface (72b4fd56-6775-4076-9195-fe85693f53aa), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:45.818618 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_common [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-7eb28af6-b98f-40cf-80cd-8d7689f70508 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Allocated IP 172.20.0.9 (622fcad3-2fd8-49df-8f66-feb243e2b24d/080b9f96-e4e1-410a-a6ed-01cf523843d5/58368d01-b8e8-4efd-b4a1-c88b7cdc4771) {{(pid=102560) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:13:45.862246 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-7c78ddac-1035-4b17-9f45-4d3d7611232a req-71755909-7da0-4e2c-874a-bc4e9312ed37 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea HTTP/1.1" status: 200 len: 210 time: 0.0323594 Feb 08 18:13:45.864055 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de7dddb8-77eb-40b9-b68f-3b1e4f8e8b43 admin admin] Pushing event updated for resources: {'Port': ['ID=13fcfd03-fc49-4bba-8574-ec74e795e2bd,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:45.909983 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port c2028811-a043-476c-9ae2-a8c0c41ed569 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:45.971239 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:43Z', 'revision_number': 3, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:13:45.997910 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed5bfaeb-8f9a-471a-befa-dc931f0dbf90 None None] The sync data for ids ['72b4fd56-6775-4076-9195-fe85693f53aa'] in dv-cinder-773985-21-iscsi is: [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:43Z', 'revision_number': 3, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}] {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:13:46.036962 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-7eb28af6-b98f-40cf-80cd-8d7689f70508 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks [] for port (58368d01-b8e8-4efd-b4a1-c88b7cdc4771), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:46.074625 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-7eb28af6-b98f-40cf-80cd-8d7689f70508 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (58368d01-b8e8-4efd-b4a1-c88b7cdc4771), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:46.090462 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['5676d44a-8ef0-472a-9703-1a68bebb5ad4'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:13:46.125760 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-7eb28af6-b98f-40cf-80cd-8d7689f70508 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Network 622fcad3-2fd8-49df-8f66-feb243e2b24d is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:13:46.129006 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-7eb28af6-b98f-40cf-80cd-8d7689f70508 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:13:46.132832 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-7eb28af6-b98f-40cf-80cd-8d7689f70508 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Received port after_create {{(pid=102560) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:13:46.157081 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eb28af6-b98f-40cf-80cd-8d7689f70508 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Pushing event updated for resources: {'Port': ['ID=58368d01-b8e8-4efd-b4a1-c88b7cdc4771,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:46.192567 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-7eb28af6-b98f-40cf-80cd-8d7689f70508 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:46.193967 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-7eb28af6-b98f-40cf-80cd-8d7689f70508 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:46.213334 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-7eb28af6-b98f-40cf-80cd-8d7689f70508 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.109 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0814879 Feb 08 18:13:46.223419 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13f2e5b8-355c-4f06-bf9d-9b7d37ebda51 req-a85a3bcf-779c-4385-b32d-d8339e040674 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:46.224988 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-13f2e5b8-355c-4f06-bf9d-9b7d37ebda51 req-a85a3bcf-779c-4385-b32d-d8339e040674 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.3392031 Feb 08 18:13:46.234900 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-de7dddb8-77eb-40b9-b68f-3b1e4f8e8b43 admin admin] Network 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:13:46.242070 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-de7dddb8-77eb-40b9-b68f-3b1e4f8e8b43 admin admin] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:13:46.250742 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] Request body: {'port': {'device_id': '126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77398'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:13:46.381234 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-13f2e5b8-355c-4f06-bf9d-9b7d37ebda51 req-c88658a5-f285-4a6a-9968-13d3977c653a tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1482861 Feb 08 18:13:46.414441 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (58368d01-b8e8-4efd-b4a1-c88b7cdc4771), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:46.430740 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-de7dddb8-77eb-40b9-b68f-3b1e4f8e8b43 admin admin] Router 72b4fd56-6775-4076-9195-fe85693f53aa has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102559) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:13:46.565463 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-de7dddb8-77eb-40b9-b68f-3b1e4f8e8b43 admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102559) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:13:46.579753 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-de7dddb8-77eb-40b9-b68f-3b1e4f8e8b43 admin admin] 10.222.0.118 "PUT /v2.0/routers/72b4fd56-6775-4076-9195-fe85693f53aa/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4886079 Feb 08 18:13:46.708414 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-0fda2d7a-63a4-4787-8f6d-5d8a5fdd930f None None] Provisioning complete for port 13fcfd03-fc49-4bba-8574-ec74e795e2bd triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:46.710469 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-0fda2d7a-63a4-4787-8f6d-5d8a5fdd930f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (13fcfd03-fc49-4bba-8574-ec74e795e2bd), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:46.765187 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-0fda2d7a-63a4-4787-8f6d-5d8a5fdd930f None None] Port 13fcfd03-fc49-4bba-8574-ec74e795e2bd cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:13:46.807986 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2c15c08-8590-40bf-91f6-89d9914a5d18 req-9ea558dc-c72d-41e0-a026-11be7906dd41 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:46.809530 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b2c15c08-8590-40bf-91f6-89d9914a5d18 req-9ea558dc-c72d-41e0-a026-11be7906dd41 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.118 "GET /v2.0/ports?device_id=fb86a1f9-6c7c-4d52-ad74-316450a98f42 HTTP/1.1" status: 200 len: 950 time: 0.1875162 Feb 08 18:13:46.842382 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e7fa0bc-1de5-4db7-b745-ed07347e6501 req-a79421d9-2d3c-405f-b4d9-1d291b97629a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:46.844209 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0e7fa0bc-1de5-4db7-b745-ed07347e6501 req-a79421d9-2d3c-405f-b4d9-1d291b97629a service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=3fb51fc0e23f4c66a482d4d406197299&device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 1130 time: 0.1089587 Feb 08 18:13:46.856654 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eca29e6-8961-4a66-80d6-3d34f6d0a0f4 req-515a92bc-e0a6-4032-bee9-59c62b7562e3 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:46.863645 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5eca29e6-8961-4a66-80d6-3d34f6d0a0f4 req-515a92bc-e0a6-4032-bee9-59c62b7562e3 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0815818 Feb 08 18:13:46.869748 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b2c15c08-8590-40bf-91f6-89d9914a5d18 req-a0e55942-f45c-4863-a93d-ab59b18b1e78 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.118 "GET /v2.0/security-groups?id=554e9f35-c52e-4f9b-8a51-a983fe72dbe4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0535288 Feb 08 18:13:46.994375 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 58368d01-b8e8-4efd-b4a1-c88b7cdc4771 {{(pid=102560) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:13:47.004951 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] Publish callbacks [] for port (58368d01-b8e8-4efd-b4a1-c88b7cdc4771), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:47.012052 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5eca29e6-8961-4a66-80d6-3d34f6d0a0f4 req-dbaaf2bf-fdcb-48f0-8ff2-115824517809 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1474702 Feb 08 18:13:47.040445 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.provisioning_blocks [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] Transition to ACTIVE for port object 58368d01-b8e8-4efd-b4a1-c88b7cdc4771 will not be triggered until provisioned by entity L2. {{(pid=102560) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Feb 08 18:13:47.046011 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e7fa0bc-1de5-4db7-b745-ed07347e6501 req-6116b902-9678-4689-a85d-1bb7a3513d90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:47.048070 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0e7fa0bc-1de5-4db7-b745-ed07347e6501 req-6116b902-9678-4689-a85d-1bb7a3513d90 service neutron] 10.222.0.109 "GET /v2.0/networks?id=f089911e-72de-4ff6-880b-ac3dd7927165 HTTP/1.1" status: 200 len: 921 time: 0.1823206 Feb 08 18:13:47.052282 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-64531588'] for port (58368d01-b8e8-4efd-b4a1-c88b7cdc4771), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:47.071306 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64937313-1faf-4684-8404-58990647a848 req-5603d80f-2a9b-490f-84c4-5feb42452146 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:47.072853 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-64937313-1faf-4684-8404-58990647a848 req-5603d80f-2a9b-490f-84c4-5feb42452146 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea HTTP/1.1" status: 200 len: 931 time: 0.0928416 Feb 08 18:13:47.136551 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] Pushing event updated for resources: {'Port': ['ID=58368d01-b8e8-4efd-b4a1-c88b7cdc4771,revision_number=2']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:47.140118 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0e7fa0bc-1de5-4db7-b745-ed07347e6501 req-8cf9eeaa-32d4-4dd4-be1a-f575a78aeb15 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=f63fc38b-d10b-4316-b77f-d1816d07ca90 HTTP/1.1" status: 200 len: 217 time: 0.0765362 Feb 08 18:13:47.211578 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e7fa0bc-1de5-4db7-b745-ed07347e6501 req-21c8bf40-541a-4975-af44-40ed0a6eec92 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:47.213189 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0e7fa0bc-1de5-4db7-b745-ed07347e6501 req-21c8bf40-541a-4975-af44-40ed0a6eec92 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=0af67967-364e-4325-b04f-b7e157c3c3d4 HTTP/1.1" status: 200 len: 859 time: 0.0614135 Feb 08 18:13:47.214444 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-64937313-1faf-4684-8404-58990647a848 req-d174d5c5-896a-4834-9670-6610085842b2 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1211607 Feb 08 18:13:47.244849 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] Attempting to bind port 58368d01-b8e8-4efd-b4a1-c88b7cdc4771 on host hv-cinder-77398 for vnic_type normal with profile {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:13:47.245463 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] Attempting to bind port 58368d01-b8e8-4efd-b4a1-c88b7cdc4771 by drivers openvswitch,hyperv on host hv-cinder-77398 at level 0 using segments [{'id': 'acdb31ea-e529-495f-b01f-8c3d7b96781f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d'}] {{(pid=102560) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:13:47.247159 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] Attempting to bind port 58368d01-b8e8-4efd-b4a1-c88b7cdc4771 on network 622fcad3-2fd8-49df-8f66-feb243e2b24d {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:13:47.252479 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] Port 58368d01-b8e8-4efd-b4a1-c88b7cdc4771 on network 622fcad3-2fd8-49df-8f66-feb243e2b24d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77398 {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Feb 08 18:13:47.253069 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] Attempting to bind port 58368d01-b8e8-4efd-b4a1-c88b7cdc4771 on network 622fcad3-2fd8-49df-8f66-feb243e2b24d {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:13:47.258497 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] Checking agent: {'id': '045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77398', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'started_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 13, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:13:47.258916 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] Checking segment: {'id': 'acdb31ea-e529-495f-b01f-8c3d7b96781f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102560) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:13:47.259445 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] Bound using segment: {'id': 'acdb31ea-e529-495f-b01f-8c3d7b96781f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d'} {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:13:47.259879 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] Bound port: 58368d01-b8e8-4efd-b4a1-c88b7cdc4771, host: hv-cinder-77398, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'acdb31ea-e529-495f-b01f-8c3d7b96781f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d'}}] {{(pid=102560) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:13:47.260246 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (58368d01-b8e8-4efd-b4a1-c88b7cdc4771), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:47.268800 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0e7fa0bc-1de5-4db7-b745-ed07347e6501 req-f8cd9078-54c2-4347-8f6d-aa38279e0eb3 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=f089911e-72de-4ff6-880b-ac3dd7927165&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0330172 Feb 08 18:13:47.343806 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] For port 58368d01-b8e8-4efd-b4a1-c88b7cdc4771, host hv-cinder-77398, cleared binding levels {{(pid=102560) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:13:47.350671 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] For port 58368d01-b8e8-4efd-b4a1-c88b7cdc4771, host hv-cinder-77398, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=58368d01-b8e8-4efd-b4a1-c88b7cdc4771,segment=NetworkSegment(acdb31ea-e529-495f-b01f-8c3d7b96781f),segment_id=acdb31ea-e529-495f-b01f-8c3d7b96781f)] {{(pid=102560) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:13:47.351901 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 38328) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:47.356759 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-5578e045-b3b5-43e7-b0b5-52db33c4e34e admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-458105507-network', 'tenant_id': '2fd83c0bbedb4efca9d6f4979aac10db'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:13:47.370193 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-64531588'] for port (58368d01-b8e8-4efd-b4a1-c88b7cdc4771), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:47.396297 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c93ba352-bfaf-4548-b8f9-ce8036bc3a1e req-3ae8f6b9-de5b-48a3-9831-328847822979 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:47.397792 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c93ba352-bfaf-4548-b8f9-ce8036bc3a1e req-3ae8f6b9-de5b-48a3-9831-328847822979 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.118 "GET /v2.0/ports?device_id=fb86a1f9-6c7c-4d52-ad74-316450a98f42 HTTP/1.1" status: 200 len: 950 time: 0.1318278 Feb 08 18:13:47.409000 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:47.409524 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:47.410985 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] 10.222.0.109 "PUT /v2.0/ports/58368d01-b8e8-4efd-b4a1-c88b7cdc4771 HTTP/1.1" status: 200 len: 1093 time: 1.1798928 Feb 08 18:13:47.411386 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea', 'tag': '58368d01-b8e8-4efd-b4a1-c88b7cdc4771'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:13:47.413635 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1e60bcbc-9b75-4a20-ac3b-67687d06042c" -d '{"events": [{"name": "network-changed", "server_uuid": "126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea", "tag": "58368d01-b8e8-4efd-b4a1-c88b7cdc4771"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:13:47.420758 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5578e045-b3b5-43e7-b0b5-52db33c4e34e admin admin] Made reservation on behalf of 2fd83c0bbedb4efca9d6f4979aac10db for: {'network': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:13:47.423146 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-5578e045-b3b5-43e7-b0b5-52db33c4e34e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for network (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:47.431628 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0e7fa0bc-1de5-4db7-b745-ed07347e6501 req-39423876-f931-4233-b908-9eabc777d92b service neutron] 10.222.0.109 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1327245 Feb 08 18:13:47.438243 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-5578e045-b3b5-43e7-b0b5-52db33c4e34e admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:47.455643 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17de2734-6d87-46c2-822a-68eb5441d19a service neutron] Pushing event updated for resources: {'Port': ['ID=58368d01-b8e8-4efd-b4a1-c88b7cdc4771,revision_number=3']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:47.478742 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:13:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-84372977-5211-4c12-a2b6-5a338c7c6287 x-openstack-request-id: req-84372977-5211-4c12-a2b6-5a338c7c6287 {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:13:47.479053 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea", "tag": "58368d01-b8e8-4efd-b4a1-c88b7cdc4771", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:13:47.479300 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-84372977-5211-4c12-a2b6-5a338c7c6287 {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:13:47.479686 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea', 'tag': '58368d01-b8e8-4efd-b4a1-c88b7cdc4771', 'status': 'completed', 'code': 200} Feb 08 18:13:47.512685 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c93ba352-bfaf-4548-b8f9-ce8036bc3a1e req-db072b8b-e4f4-495f-ba15-c50670c4d825 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.118 "GET /v2.0/security-groups?id=554e9f35-c52e-4f9b-8a51-a983fe72dbe4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1067455 Feb 08 18:13:47.549461 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-d047b612-1346-4930-a868-20d95217f5c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:47.550014 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-d047b612-1346-4930-a868-20d95217f5c2 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=602d106ac7104b10bebcfc0421ea5edc&device_id=126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea HTTP/1.1" status: 200 len: 1127 time: 0.0825408 Feb 08 18:13:47.567221 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0e7fa0bc-1de5-4db7-b745-ed07347e6501 req-a7d49c1e-26d0-4261-a1ad-ca0fe638efb4 service neutron] 10.222.0.109 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1236150 Feb 08 18:13:47.615665 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-4d626987-f86d-4aca-ac29-93c353ff9283 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=58368d01-b8e8-4efd-b4a1-c88b7cdc4771 HTTP/1.1" status: 200 len: 217 time: 0.0576706 Feb 08 18:13:47.620168 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-5578e045-b3b5-43e7-b0b5-52db33c4e34e admin admin] Publish callbacks [] for security_group (27334ad3-e9f3-46d4-aeb4-1e87073bd786), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:47.621532 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device a7d5d25e-891f-4939-b21a-46de63af2d71 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:13:47.624508 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-5578e045-b3b5-43e7-b0b5-52db33c4e34e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (27334ad3-e9f3-46d4-aeb4-1e87073bd786), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:47.674369 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port a7d5d25e-891f-4939-b21a-46de63af2d71 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:47.674924 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (a7d5d25e-891f-4939-b21a-46de63af2d71), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:47.677938 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5578e045-b3b5-43e7-b0b5-52db33c4e34e admin admin] vlan segment allocate from pool success with {'vlan_id': 1064, 'physical_network': 'physnet1'} {{(pid=102560) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Feb 08 18:13:47.693926 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-c1011a86-3387-46ad-aade-c7887cbc9255 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:47.695339 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-c1011a86-3387-46ad-aade-c7887cbc9255 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=080b9f96-e4e1-410a-a6ed-01cf523843d5 HTTP/1.1" status: 200 len: 855 time: 0.0666201 Feb 08 18:13:47.700054 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-5578e045-b3b5-43e7-b0b5-52db33c4e34e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (5a4471c8-e699-485f-ade3-bde146c6c0bb), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:47.700394 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.segments_db [None req-5578e045-b3b5-43e7-b0b5-52db33c4e34e admin admin] Added segment 5a4471c8-e699-485f-ade3-bde146c6c0bb of type vlan for network 3b72196e-a88b-47cc-8d61-dbdb9bd382b8 Feb 08 18:13:47.701668 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5578e045-b3b5-43e7-b0b5-52db33c4e34e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=27334ad3-e9f3-46d4-aeb4-1e87073bd786,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:47.756592 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-ddf77bfd-1316-45b7-a980-a971b20631f3 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=622fcad3-2fd8-49df-8f66-feb243e2b24d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0460286 Feb 08 18:13:47.773971 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-5578e045-b3b5-43e7-b0b5-52db33c4e34e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8770558521384'] for network (3b72196e-a88b-47cc-8d61-dbdb9bd382b8), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:47.777109 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port a7d5d25e-891f-4939-b21a-46de63af2d71 is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:47.777580 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (a7d5d25e-891f-4939-b21a-46de63af2d71), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:47.809435 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] For port a7d5d25e-891f-4939-b21a-46de63af2d71, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=a7d5d25e-891f-4939-b21a-46de63af2d71,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:13:47.816221 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (a7d5d25e-891f-4939-b21a-46de63af2d71), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:47.822073 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-d05d783b-2fdc-4f21-ac56-5b30cfddf9e3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:47.852729 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-5578e045-b3b5-43e7-b0b5-52db33c4e34e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for network (3b72196e-a88b-47cc-8d61-dbdb9bd382b8), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:47.853747 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5578e045-b3b5-43e7-b0b5-52db33c4e34e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:47.854331 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-5578e045-b3b5-43e7-b0b5-52db33c4e34e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:47.865840 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Pushing event updated for resources: {'Port': ['ID=a7d5d25e-891f-4939-b21a-46de63af2d71,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:47.928704 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-5578e045-b3b5-43e7-b0b5-52db33c4e34e admin admin] 10.222.0.118 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.5753584 Feb 08 18:13:47.931621 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 38334) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:47.938712 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-4cf5bb0d-19d8-4480-9124-654875abf985 admin admin] Request body: {'subnet': {'network_id': '3b72196e-a88b-47cc-8d61-dbdb9bd382b8', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-458105507-subnet', 'tenant_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'ip_version': 4}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:13:47.942993 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5578e045-b3b5-43e7-b0b5-52db33c4e34e admin admin] Pushing event updated for resources: {'Network': ['ID=3b72196e-a88b-47cc-8d61-dbdb9bd382b8,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:47.950073 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-3c002ccc-0d93-4418-a3f1-b3dbae860bc8 service neutron] 10.222.0.109 "GET /v2.0/networks/622fcad3-2fd8-49df-8f66-feb243e2b24d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1719346 Feb 08 18:13:47.955859 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Network 3b72196e-a88b-47cc-8d61-dbdb9bd382b8 details requested by agent ovs-agent-dv-cinder-773985-21-iscsi with host dv-cinder-773985-21-iscsi {{(pid=102561) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Feb 08 18:13:47.967504 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4cf5bb0d-19d8-4480-9124-654875abf985 admin admin] Made reservation on behalf of 2fd83c0bbedb4efca9d6f4979aac10db for: {'subnet': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:13:47.970435 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4cf5bb0d-19d8-4480-9124-654875abf985 admin admin] Publish callbacks [] for subnet (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:48.017736 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:48.080697 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1d179a7a-dc2f-42da-bd51-8660114fae1d req-87f9a635-4fdd-4b12-aa99-9388ad1adad5 service neutron] 10.222.0.109 "GET /v2.0/networks/622fcad3-2fd8-49df-8f66-feb243e2b24d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1203568 Feb 08 18:13:48.163762 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59f17095-01d7-4711-8731-fc8599389fd7 req-4c1fed55-e317-4ff9-9c8e-b64036ace905 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:48.165372 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-59f17095-01d7-4711-8731-fc8599389fd7 req-4c1fed55-e317-4ff9-9c8e-b64036ace905 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0587659 Feb 08 18:13:48.172092 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4cf5bb0d-19d8-4480-9124-654875abf985 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for subnet (24466b5d-d35d-4ad0-812e-ceb5c371f644), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:48.193349 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] Sync routers for ids ['72b4fd56-6775-4076-9195-fe85693f53aa'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:13:48.207874 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] Routers {'72b4fd56-6775-4076-9195-fe85693f53aa'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:13:48.208943 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:13:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['72b4fd56-6775-4076-9195-fe85693f53aa'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:13:48.227211 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cf5bb0d-19d8-4480-9124-654875abf985 admin admin] Pushing event updated for resources: {'Subnet': ['ID=24466b5d-d35d-4ad0-812e-ceb5c371f644,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:48.236049 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4cf5bb0d-19d8-4480-9124-654875abf985 admin admin] Checking segment: {'id': '5a4471c8-e699-485f-ade3-bde146c6c0bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1064, 'network_id': '3b72196e-a88b-47cc-8d61-dbdb9bd382b8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102559) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:13:48.236308 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4cf5bb0d-19d8-4480-9124-654875abf985 admin admin] Network hostable DHCP agents. Network: 3b72196e-a88b-47cc-8d61-dbdb9bd382b8, hostable agents: ['006b5388-ac7d-4794-a124-14bb8e5d8fec'], hosted agents: [] {{(pid=102559) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Feb 08 18:13:48.238420 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-59f17095-01d7-4711-8731-fc8599389fd7 req-4a5ae601-bdea-47aa-896d-cfe636af0eab tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0643573 Feb 08 18:13:48.262804 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e60bcbc-9b75-4a20-ac3b-67687d06042c req-4438c232-bb4a-4f71-bbb3-53bf4178a4f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:48.265421 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1e60bcbc-9b75-4a20-ac3b-67687d06042c req-4438c232-bb4a-4f71-bbb3-53bf4178a4f3 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=602d106ac7104b10bebcfc0421ea5edc&device_id=126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea HTTP/1.1" status: 200 len: 1127 time: 0.0990570 Feb 08 18:13:48.265942 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4cf5bb0d-19d8-4480-9124-654875abf985 admin admin] Network 3b72196e-a88b-47cc-8d61-dbdb9bd382b8 is scheduled to be hosted by DHCP agent 006b5388-ac7d-4794-a124-14bb8e5d8fec with binding_index 1 {{(pid=102559) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Feb 08 18:13:48.277045 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-4cf5bb0d-19d8-4480-9124-654875abf985 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773985-21-iscsi, 3b72196e-a88b-47cc-8d61-dbdb9bd382b8) {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:13:48.283011 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4cf5bb0d-19d8-4480-9124-654875abf985 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:48.284210 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4cf5bb0d-19d8-4480-9124-654875abf985 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:48.311598 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-4cf5bb0d-19d8-4480-9124-654875abf985 admin admin] 10.222.0.118 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.3784208 Feb 08 18:13:48.313047 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 38342) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:48.318783 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-bc9f5189-c2fe-4c02-8199-38fc5d1b7f35 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-458105507-router', 'tenant_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:13:48.388466 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-bc9f5189-c2fe-4c02-8199-38fc5d1b7f35 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-557369', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6968'] for router (4383a61e-2e1d-48ae-94de-32830e84c9c4), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:48.390129 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-bc9f5189-c2fe-4c02-8199-38fc5d1b7f35 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-557389', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-560615', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-578936', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6961'] for router (4383a61e-2e1d-48ae-94de-32830e84c9c4), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:48.399427 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e60bcbc-9b75-4a20-ac3b-67687d06042c req-fd877038-9060-42f5-92a6-4fa3020ea82b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:48.401193 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1e60bcbc-9b75-4a20-ac3b-67687d06042c req-fd877038-9060-42f5-92a6-4fa3020ea82b service neutron] 10.222.0.109 "GET /v2.0/networks?id=622fcad3-2fd8-49df-8f66-feb243e2b24d HTTP/1.1" status: 200 len: 917 time: 0.1261184 Feb 08 18:13:48.404464 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20266f44-5179-49d7-9cc9-f2d8771636bb req-9ed563ec-9075-4286-a50c-4110bb39cc6a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:48.405970 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-20266f44-5179-49d7-9cc9-f2d8771636bb req-9ed563ec-9075-4286-a50c-4110bb39cc6a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea HTTP/1.1" status: 200 len: 943 time: 0.0920048 Feb 08 18:13:48.432259 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-850560c6-4820-42ce-835d-ea0a2414d4a2 None None] Network 3b72196e-a88b-47cc-8d61-dbdb9bd382b8 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:13:48.453080 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1e60bcbc-9b75-4a20-ac3b-67687d06042c req-a60572db-261f-4bf1-984f-41673dd51688 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=58368d01-b8e8-4efd-b4a1-c88b7cdc4771 HTTP/1.1" status: 200 len: 217 time: 0.0406580 Feb 08 18:13:48.471789 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-bc9f5189-c2fe-4c02-8199-38fc5d1b7f35 admin admin] Publish callbacks [] for router_controller (4383a61e-2e1d-48ae-94de-32830e84c9c4), precommit_add_association {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:48.507640 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e60bcbc-9b75-4a20-ac3b-67687d06042c req-d7dc83e3-cda7-4892-aa7a-ce692b7cdc1f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:48.509069 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1e60bcbc-9b75-4a20-ac3b-67687d06042c req-d7dc83e3-cda7-4892-aa7a-ce692b7cdc1f service neutron] 10.222.0.109 "GET /v2.0/subnets?id=080b9f96-e4e1-410a-a6ed-01cf523843d5 HTTP/1.1" status: 200 len: 855 time: 0.0460947 Feb 08 18:13:48.521435 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:48.544545 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1e60bcbc-9b75-4a20-ac3b-67687d06042c req-8247315e-fa0e-4055-9c70-42bd8490258e service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=622fcad3-2fd8-49df-8f66-feb243e2b24d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0267982 Feb 08 18:13:48.551951 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-20266f44-5179-49d7-9cc9-f2d8771636bb req-368f0620-e7e2-4b46-a38d-af801384d00f tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1382658 Feb 08 18:13:48.579848 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] Set router 72b4fd56-6775-4076-9195-fe85693f53aa gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:13:48.611014 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb22d00a-3bf5-4adf-8e01-11615580725f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp7dd4f88d-be07-54f7-888b-e9d2dcd2237c-3b72196e-a88b-47cc-8d61-dbdb9bd382b8', 'network_id': '3b72196e-a88b-47cc-8d61-dbdb9bd382b8', 'project_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'fixed_ips': [{'subnet_id': '24466b5d-d35d-4ad0-812e-ceb5c371f644'}]}} from dv-cinder-773985-21-iscsi. {{(pid=102561) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Feb 08 18:13:48.611879 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-eb22d00a-3bf5-4adf-8e01-11615580725f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:48.652400 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-bc9f5189-c2fe-4c02-8199-38fc5d1b7f35 admin admin] Publish callbacks [] for router_gateway (4383a61e-2e1d-48ae-94de-32830e84c9c4), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:48.683627 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1e60bcbc-9b75-4a20-ac3b-67687d06042c req-f1a904a4-df5b-40b9-ad44-44dccf8fb892 service neutron] 10.222.0.109 "GET /v2.0/networks/622fcad3-2fd8-49df-8f66-feb243e2b24d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1313236 Feb 08 18:13:48.772991 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39aeeab2-090c-4f53-b43f-7516b378007f req-2813153e-4fa5-468c-9f08-31aad54d8e39 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:48.773430 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-39aeeab2-090c-4f53-b43f-7516b378007f req-2813153e-4fa5-468c-9f08-31aad54d8e39 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.118 "GET /v2.0/ports?device_id=fb86a1f9-6c7c-4d52-ad74-316450a98f42 HTTP/1.1" status: 200 len: 950 time: 0.1333778 Feb 08 18:13:48.850938 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-39aeeab2-090c-4f53-b43f-7516b378007f req-924dfefe-e844-465a-bd16-3a4284de568e tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.118 "GET /v2.0/security-groups?id=554e9f35-c52e-4f9b-8a51-a983fe72dbe4&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0686150 Feb 08 18:13:48.853224 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1e60bcbc-9b75-4a20-ac3b-67687d06042c req-c551bdae-0bcf-4a59-accc-7d4189b7133a service neutron] 10.222.0.109 "GET /v2.0/networks/622fcad3-2fd8-49df-8f66-feb243e2b24d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1616101 Feb 08 18:13:48.877038 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.db_base_plugin_common [None req-eb22d00a-3bf5-4adf-8e01-11615580725f None None] Allocated IP 172.20.0.2 (3b72196e-a88b-47cc-8d61-dbdb9bd382b8/24466b5d-d35d-4ad0-812e-ceb5c371f644/0cad626a-b423-4561-8abb-3bb66a3cad8d) {{(pid=102561) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:13:48.883532 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-bc9f5189-c2fe-4c02-8199-38fc5d1b7f35 admin admin] Publish callbacks [] for router_gateway (4383a61e-2e1d-48ae-94de-32830e84c9c4), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:48.902563 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-bc9f5189-c2fe-4c02-8199-38fc5d1b7f35 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:48.998382 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 4, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '13fcfd03-fc49-4bba-8574-ec74e795e2bd', 'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'mac_address': 'fa:16:3e:4b:7b:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:44Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 2, 'project_id': '768f50510c57419e8a49ed0988014174', 'subnets': [{'id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:13:49.004862 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [None req-bc9f5189-c2fe-4c02-8199-38fc5d1b7f35 admin admin] Allocated IP 172.27.1.252 (77055816-7c88-403d-8f8a-9be2c1faa10d/18547c52-7b23-42cd-bb53-214663ed102b/6bd2e4e4-f071-46c0-b5fe-db175f638a13) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:13:49.032382 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] Checking router: 72b4fd56-6775-4076-9195-fe85693f53aa for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:13:49.032735 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] Updating router 72b4fd56-6775-4076-9195-fe85693f53aa port 13fcfd03-fc49-4bba-8574-ec74e795e2bd binding host dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Feb 08 18:13:49.088217 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (13fcfd03-fc49-4bba-8574-ec74e795e2bd), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:49.110798 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-eb22d00a-3bf5-4adf-8e01-11615580725f None None] Publish callbacks [] for port (0cad626a-b423-4561-8abb-3bb66a3cad8d), precommit_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:49.114091 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-bc9f5189-c2fe-4c02-8199-38fc5d1b7f35 admin admin] Publish callbacks [] for port (6bd2e4e4-f071-46c0-b5fe-db175f638a13), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:49.118863 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-eb22d00a-3bf5-4adf-8e01-11615580725f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (0cad626a-b423-4561-8abb-3bb66a3cad8d), after_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:49.150577 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-bc9f5189-c2fe-4c02-8199-38fc5d1b7f35 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (6bd2e4e4-f071-46c0-b5fe-db175f638a13), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:49.186409 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb22d00a-3bf5-4adf-8e01-11615580725f None None] Network 3b72196e-a88b-47cc-8d61-dbdb9bd382b8 is already hosted by enough agents. {{(pid=102561) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:13:49.189365 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc9f5189-c2fe-4c02-8199-38fc5d1b7f35 admin admin] Network 77055816-7c88-403d-8f8a-9be2c1faa10d is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:13:49.192495 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-bc9f5189-c2fe-4c02-8199-38fc5d1b7f35 admin admin] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:13:49.193592 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.scheduler.base_scheduler [None req-eb22d00a-3bf5-4adf-8e01-11615580725f None None] Resources bound (agent type, host, resource id): {{(pid=102561) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:13:49.195963 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bc9f5189-c2fe-4c02-8199-38fc5d1b7f35 admin admin] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:13:49.200427 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb22d00a-3bf5-4adf-8e01-11615580725f None None] Received port after_create {{(pid=102561) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:13:49.201756 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc9f5189-c2fe-4c02-8199-38fc5d1b7f35 admin admin] Pushing event updated for resources: {'Port': ['ID=6bd2e4e4-f071-46c0-b5fe-db175f638a13,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:49.242006 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb22d00a-3bf5-4adf-8e01-11615580725f None None] Pushing event updated for resources: {'Port': ['ID=0cad626a-b423-4561-8abb-3bb66a3cad8d,revision_number=1']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:49.330687 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-eb22d00a-3bf5-4adf-8e01-11615580725f None None] Attempting to bind port 0cad626a-b423-4561-8abb-3bb66a3cad8d on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:13:49.331083 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-eb22d00a-3bf5-4adf-8e01-11615580725f None None] Attempting to bind port 0cad626a-b423-4561-8abb-3bb66a3cad8d by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': '5a4471c8-e699-485f-ade3-bde146c6c0bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1064, 'network_id': '3b72196e-a88b-47cc-8d61-dbdb9bd382b8'}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:13:49.331440 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb22d00a-3bf5-4adf-8e01-11615580725f None None] Attempting to bind port 0cad626a-b423-4561-8abb-3bb66a3cad8d on network 3b72196e-a88b-47cc-8d61-dbdb9bd382b8 {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:13:49.341477 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3390fec2-24ea-4d81-8785-cfb20f8bc080 req-025027e4-99f3-40fc-94e3-5b7a92802afd tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:49.343188 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-3390fec2-24ea-4d81-8785-cfb20f8bc080 req-025027e4-99f3-40fc-94e3-5b7a92802afd tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.109 "GET /v2.0/ports?device_id=fb86a1f9-6c7c-4d52-ad74-316450a98f42 HTTP/1.1" status: 200 len: 950 time: 0.0659425 Feb 08 18:13:49.365192 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb22d00a-3bf5-4adf-8e01-11615580725f None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 13, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:13:49.365529 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb22d00a-3bf5-4adf-8e01-11615580725f None None] Checking segment: {'id': '5a4471c8-e699-485f-ade3-bde146c6c0bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1064, 'network_id': '3b72196e-a88b-47cc-8d61-dbdb9bd382b8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102561) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:13:49.365960 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-eb22d00a-3bf5-4adf-8e01-11615580725f None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:49.366317 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb22d00a-3bf5-4adf-8e01-11615580725f None None] Bound using segment: {'id': '5a4471c8-e699-485f-ade3-bde146c6c0bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1064, 'network_id': '3b72196e-a88b-47cc-8d61-dbdb9bd382b8'} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:13:49.366814 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-eb22d00a-3bf5-4adf-8e01-11615580725f None None] Bound port: 0cad626a-b423-4561-8abb-3bb66a3cad8d, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5a4471c8-e699-485f-ade3-bde146c6c0bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1064, 'network_id': '3b72196e-a88b-47cc-8d61-dbdb9bd382b8'}}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:13:49.367196 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-eb22d00a-3bf5-4adf-8e01-11615580725f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (0cad626a-b423-4561-8abb-3bb66a3cad8d), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:49.451669 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a1ba1a4-922f-41ff-9b45-826dbc98902e req-b828b6bf-315e-446e-9ea7-5797b6f34b34 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:49.453173 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0a1ba1a4-922f-41ff-9b45-826dbc98902e req-b828b6bf-315e-446e-9ea7-5797b6f34b34 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.1310163 Feb 08 18:13:49.461034 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-3390fec2-24ea-4d81-8785-cfb20f8bc080 req-66ca178d-97ee-4fc6-9bfd-c72100cc4dd0 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Deleting port 50fd9608-2dd8-44fa-bf18-dfa18cd45e68 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:13:49.461272 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-bc9f5189-c2fe-4c02-8199-38fc5d1b7f35 admin admin] Publish callbacks [] for router_gateway (4383a61e-2e1d-48ae-94de-32830e84c9c4), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:49.461356 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-3390fec2-24ea-4d81-8785-cfb20f8bc080 req-66ca178d-97ee-4fc6-9bfd-c72100cc4dd0 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (50fd9608-2dd8-44fa-bf18-dfa18cd45e68), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:49.476162 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-eb22d00a-3bf5-4adf-8e01-11615580725f None None] For port 0cad626a-b423-4561-8abb-3bb66a3cad8d, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102561) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:13:49.480363 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-eb22d00a-3bf5-4adf-8e01-11615580725f None None] For port 0cad626a-b423-4561-8abb-3bb66a3cad8d, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=0cad626a-b423-4561-8abb-3bb66a3cad8d,segment=NetworkSegment(5a4471c8-e699-485f-ade3-bde146c6c0bb),segment_id=5a4471c8-e699-485f-ade3-bde146c6c0bb)] {{(pid=102561) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:13:49.490702 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-eb22d00a-3bf5-4adf-8e01-11615580725f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (0cad626a-b423-4561-8abb-3bb66a3cad8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:49.564465 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-3390fec2-24ea-4d81-8785-cfb20f8bc080 req-66ca178d-97ee-4fc6-9bfd-c72100cc4dd0 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] For port 50fd9608-2dd8-44fa-bf18-dfa18cd45e68, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=50fd9608-2dd8-44fa-bf18-dfa18cd45e68,segment=NetworkSegment(154cb5f9-649d-4c0e-87ea-ee1bef794d47),segment_id=154cb5f9-649d-4c0e-87ea-ee1bef794d47)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:13:49.564842 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-3390fec2-24ea-4d81-8785-cfb20f8bc080 req-66ca178d-97ee-4fc6-9bfd-c72100cc4dd0 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (50fd9608-2dd8-44fa-bf18-dfa18cd45e68), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:49.577706 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb22d00a-3bf5-4adf-8e01-11615580725f None None] Pushing event updated for resources: {'Port': ['ID=0cad626a-b423-4561-8abb-3bb66a3cad8d,revision_number=2']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:49.578794 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-3390fec2-24ea-4d81-8785-cfb20f8bc080 req-66ca178d-97ee-4fc6-9bfd-c72100cc4dd0 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Calling delete_port for 50fd9608-2dd8-44fa-bf18-dfa18cd45e68 owned by compute:nova {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:13:49.586357 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] Publish callbacks [] for port (13fcfd03-fc49-4bba-8574-ec74e795e2bd), precommit_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:49.598910 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (13fcfd03-fc49-4bba-8574-ec74e795e2bd), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:49.599523 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0a1ba1a4-922f-41ff-9b45-826dbc98902e req-26a8ed96-71d2-4eba-ba86-00b848ef8368 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0989950 Feb 08 18:13:49.663542 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e1a3d46-0878-4e17-b1a6-c358b11a1946 None None] Pushing event updated for resources: {'Port': ['ID=13fcfd03-fc49-4bba-8574-ec74e795e2bd,revision_number=3']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:49.665914 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device a7d5d25e-891f-4939-b21a-46de63af2d71 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:13:49.772343 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] Attempting to bind port 13fcfd03-fc49-4bba-8574-ec74e795e2bd on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:13:49.773043 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] Attempting to bind port 13fcfd03-fc49-4bba-8574-ec74e795e2bd by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': 'fc5ec9ee-df90-46f3-bddf-aef0221d9066', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1066, 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74'}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:13:49.773605 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] Attempting to bind port 13fcfd03-fc49-4bba-8574-ec74e795e2bd on network 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:13:49.780474 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port a7d5d25e-891f-4939-b21a-46de63af2d71 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:49.781084 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (a7d5d25e-891f-4939-b21a-46de63af2d71), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:49.783195 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 13, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:13:49.783829 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] Checking segment: {'id': 'fc5ec9ee-df90-46f3-bddf-aef0221d9066', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1066, 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102561) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:13:49.784421 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:49.784988 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] Bound using segment: {'id': 'fc5ec9ee-df90-46f3-bddf-aef0221d9066', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1066, 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74'} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:13:49.785876 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] Bound port: 13fcfd03-fc49-4bba-8574-ec74e795e2bd, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'fc5ec9ee-df90-46f3-bddf-aef0221d9066', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1066, 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74'}}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:13:49.786586 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (13fcfd03-fc49-4bba-8574-ec74e795e2bd), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:49.801877 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-bc9f5189-c2fe-4c02-8199-38fc5d1b7f35 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-557494', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-560688'] for router (4383a61e-2e1d-48ae-94de-32830e84c9c4), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:49.849282 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-583e61b4-2133-4e59-b4f6-e9d16a579c5e req-5304be1f-b49d-4f9b-841f-c986f766aad2 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:49.854919 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-583e61b4-2133-4e59-b4f6-e9d16a579c5e req-5304be1f-b49d-4f9b-841f-c986f766aad2 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea HTTP/1.1" status: 200 len: 943 time: 0.1187389 Feb 08 18:13:49.856969 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-3390fec2-24ea-4d81-8785-cfb20f8bc080 req-66ca178d-97ee-4fc6-9bfd-c72100cc4dd0 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (50fd9608-2dd8-44fa-bf18-dfa18cd45e68), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:49.874205 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['50fd9608-2dd8-44fa-bf18-dfa18cd45e68'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:13:49.950078 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66ca178d-97ee-4fc6-9bfd-c72100cc4dd0 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Pushing event deleted for resources: {'Port': ['ID=50fd9608-2dd8-44fa-bf18-dfa18cd45e68,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:49.958705 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] For port 13fcfd03-fc49-4bba-8574-ec74e795e2bd, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102561) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:13:50.006398 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] For port 13fcfd03-fc49-4bba-8574-ec74e795e2bd, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=13fcfd03-fc49-4bba-8574-ec74e795e2bd,segment=NetworkSegment(fc5ec9ee-df90-46f3-bddf-aef0221d9066),segment_id=fc5ec9ee-df90-46f3-bddf-aef0221d9066)] {{(pid=102561) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:13:50.015718 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port a7d5d25e-891f-4939-b21a-46de63af2d71 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:50.045183 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [req-3390fec2-24ea-4d81-8785-cfb20f8bc080 req-66ca178d-97ee-4fc6-9bfd-c72100cc4dd0 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] No DVR routers for this DVR port 50fd9608-2dd8-44fa-bf18-dfa18cd45e68 on host hv-cinder-77398 {{(pid=102560) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:13:50.046370 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (13fcfd03-fc49-4bba-8574-ec74e795e2bd), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:50.057226 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-3390fec2-24ea-4d81-8785-cfb20f8bc080 req-66ca178d-97ee-4fc6-9bfd-c72100cc4dd0 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:50.060783 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-3390fec2-24ea-4d81-8785-cfb20f8bc080 req-66ca178d-97ee-4fc6-9bfd-c72100cc4dd0 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.109 "DELETE /v2.0/ports/50fd9608-2dd8-44fa-bf18-dfa18cd45e68 HTTP/1.1" status: 204 len: 173 time: 0.7101605 Feb 08 18:13:50.061256 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'fb86a1f9-6c7c-4d52-ad74-316450a98f42', 'name': 'network-vif-deleted', 'tag': '50fd9608-2dd8-44fa-bf18-dfa18cd45e68'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:13:50.063675 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2d0139db-0e2e-418b-95e4-8fe920c1aeb3" -d '{"events": [{"server_uuid": "fb86a1f9-6c7c-4d52-ad74-316450a98f42", "name": "network-vif-deleted", "tag": "50fd9608-2dd8-44fa-bf18-dfa18cd45e68"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:13:50.086331 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-583e61b4-2133-4e59-b4f6-e9d16a579c5e req-5d0bba7c-1ccc-4f8f-a66f-c314a1c14adb tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2101185 Feb 08 18:13:50.146529 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 58368d01-b8e8-4efd-b4a1-c88b7cdc4771 details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:13:50.160476 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-4552074c-e057-45cd-986c-852e4d67033d req-40c9630e-574c-450a-8b31-ee4828ce73f5 tempest-VolumesNegativeTest-2048222159 tempest-VolumesNegativeTest-2048222159-project] 10.222.0.118 "GET /v2.0/ports?device_id=fb86a1f9-6c7c-4d52-ad74-316450a98f42 HTTP/1.1" status: 200 len: 210 time: 0.0640905 Feb 08 18:13:50.208392 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:13:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-04fae3cf-7848-4a23-a013-8872e1cd63c5 x-openstack-request-id: req-04fae3cf-7848-4a23-a013-8872e1cd63c5 {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:13:50.208392 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "fb86a1f9-6c7c-4d52-ad74-316450a98f42", "name": "network-vif-deleted", "tag": "50fd9608-2dd8-44fa-bf18-dfa18cd45e68", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:13:50.208392 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-04fae3cf-7848-4a23-a013-8872e1cd63c5 {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:13:50.208392 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'fb86a1f9-6c7c-4d52-ad74-316450a98f42', 'name': 'network-vif-deleted', 'tag': '50fd9608-2dd8-44fa-bf18-dfa18cd45e68', 'status': 'completed', 'code': 200} Feb 08 18:13:50.223217 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:50.231698 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e1a3d46-0878-4e17-b1a6-c358b11a1946 None None] Pushing event updated for resources: {'Port': ['ID=13fcfd03-fc49-4bba-8574-ec74e795e2bd,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:50.236987 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] Routers {'72b4fd56-6775-4076-9195-fe85693f53aa'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:13:50.237619 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:13:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['72b4fd56-6775-4076-9195-fe85693f53aa'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:13:50.239957 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bc9f5189-c2fe-4c02-8199-38fc5d1b7f35 admin admin] Router 4383a61e-2e1d-48ae-94de-32830e84c9c4 is scheduled to L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 with binding_index 1 {{(pid=102559) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Feb 08 18:13:50.380111 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bc9f5189-c2fe-4c02-8199-38fc5d1b7f35 admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102559) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:13:50.393205 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] Sync routers for ids ['4383a61e-2e1d-48ae-94de-32830e84c9c4'] in dv-cinder-773985-21-iscsi {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:13:50.404330 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] Routers {'4383a61e-2e1d-48ae-94de-32830e84c9c4'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:13:50.405296 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:13:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['4383a61e-2e1d-48ae-94de-32830e84c9c4'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:13:50.407835 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-bc9f5189-c2fe-4c02-8199-38fc5d1b7f35 admin admin] Publish callbacks [] for router (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:50.412051 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-bc9f5189-c2fe-4c02-8199-38fc5d1b7f35 admin admin] 10.222.0.118 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 2.0940921 Feb 08 18:13:50.412878 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 38354) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:50.526219 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-d63367b5-dbf2-44b5-8180-d338761acb9d None None] Provisioning complete for port 13fcfd03-fc49-4bba-8574-ec74e795e2bd triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:50.526592 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-d63367b5-dbf2-44b5-8180-d338761acb9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (13fcfd03-fc49-4bba-8574-ec74e795e2bd), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:50.553789 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] Set router 4383a61e-2e1d-48ae-94de-32830e84c9c4 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:13:50.611986 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 58368d01-b8e8-4efd-b4a1-c88b7cdc4771, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=58368d01-b8e8-4efd-b4a1-c88b7cdc4771,segment=NetworkSegment(acdb31ea-e529-495f-b01f-8c3d7b96781f),segment_id=acdb31ea-e529-495f-b01f-8c3d7b96781f)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:13:50.668963 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': '58368d01-b8e8-4efd-b4a1-c88b7cdc4771', 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d', 'port_id': '58368d01-b8e8-4efd-b4a1-c88b7cdc4771', 'mac_address': 'fa:16:3e:30:be:9a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1074, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '080b9f96-e4e1-410a-a6ed-01cf523843d5', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:13:50.697466 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] Set router 72b4fd56-6775-4076-9195-fe85693f53aa gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:13:50.763921 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4383a61e-2e1d-48ae-94de-32830e84c9c4', 'name': 'tempest-TestVolumeBootPattern-458105507-router', 'tenant_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '6bd2e4e4-f071-46c0-b5fe-db175f638a13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:48Z', 'updated_at': '2022-02-08T18:13:49Z', 'revision_number': 3, 'project_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'gw_port': {'id': '6bd2e4e4-f071-46c0-b5fe-db175f638a13', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:10:51:18', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4383a61e-2e1d-48ae-94de-32830e84c9c4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 387, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:48Z', 'updated_at': '2022-02-08T18:13:49Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:13:50.797315 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] Checking router: 4383a61e-2e1d-48ae-94de-32830e84c9c4 for host: dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:13:50.798370 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] Updating router 4383a61e-2e1d-48ae-94de-32830e84c9c4 port 6bd2e4e4-f071-46c0-b5fe-db175f638a13 binding host dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Feb 08 18:13:50.814719 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96b4a993-8224-4389-8ce8-cefe6b72a286 req-6f87996f-0d7d-4a30-8fae-3e94caeb7dfc tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:50.816915 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-96b4a993-8224-4389-8ce8-cefe6b72a286 req-6f87996f-0d7d-4a30-8fae-3e94caeb7dfc tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.1197805 Feb 08 18:13:50.822186 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 58368d01-b8e8-4efd-b4a1-c88b7cdc4771 is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:50.827006 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (58368d01-b8e8-4efd-b4a1-c88b7cdc4771), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:50.833175 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (6bd2e4e4-f071-46c0-b5fe-db175f638a13), before_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:50.929999 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 58368d01-b8e8-4efd-b4a1-c88b7cdc4771 {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:13:50.952855 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-96b4a993-8224-4389-8ce8-cefe6b72a286 req-65a83282-fcaa-4dc3-974a-027278040c2c tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1291842 Feb 08 18:13:50.964786 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 58368d01-b8e8-4efd-b4a1-c88b7cdc4771, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=58368d01-b8e8-4efd-b4a1-c88b7cdc4771,segment=NetworkSegment(acdb31ea-e529-495f-b01f-8c3d7b96781f),segment_id=acdb31ea-e529-495f-b01f-8c3d7b96781f)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:13:50.976891 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-d63367b5-dbf2-44b5-8180-d338761acb9d None None] Current status of the port 13fcfd03-fc49-4bba-8574-ec74e795e2bd is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:50.977452 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-d63367b5-dbf2-44b5-8180-d338761acb9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (13fcfd03-fc49-4bba-8574-ec74e795e2bd), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:51.004257 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (58368d01-b8e8-4efd-b4a1-c88b7cdc4771), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:51.010895 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2d6cb40e-ba0d-4b04-a695-7d752a3cd605 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:51.121108 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-d63367b5-dbf2-44b5-8180-d338761acb9d None None] For port 13fcfd03-fc49-4bba-8574-ec74e795e2bd, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=13fcfd03-fc49-4bba-8574-ec74e795e2bd,segment=NetworkSegment(fc5ec9ee-df90-46f3-bddf-aef0221d9066),segment_id=fc5ec9ee-df90-46f3-bddf-aef0221d9066)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:13:51.141230 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-d63367b5-dbf2-44b5-8180-d338761acb9d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (13fcfd03-fc49-4bba-8574-ec74e795e2bd), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:51.181632 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=58368d01-b8e8-4efd-b4a1-c88b7cdc4771,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:51.187347 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] Publish callbacks [] for port (6bd2e4e4-f071-46c0-b5fe-db175f638a13), precommit_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:51.201664 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (6bd2e4e4-f071-46c0-b5fe-db175f638a13), after_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:51.280113 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7ddac3-8015-44c6-9d5d-cb8494088b00 None None] Pushing event updated for resources: {'Port': ['ID=6bd2e4e4-f071-46c0-b5fe-db175f638a13,revision_number=2']} {{(pid=102562) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:51.293852 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] Attempting to bind port 6bd2e4e4-f071-46c0-b5fe-db175f638a13 on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:13:51.294901 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] Attempting to bind port 6bd2e4e4-f071-46c0-b5fe-db175f638a13 by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}] {{(pid=102562) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:13:51.295819 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] Attempting to bind port 6bd2e4e4-f071-46c0-b5fe-db175f638a13 on network 77055816-7c88-403d-8f8a-9be2c1faa10d {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:13:51.301033 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 13, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:13:51.301418 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] Checking segment: {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102562) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:13:51.302189 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:51.302456 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] Bound using segment: {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'} {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:13:51.302950 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] Bound port: 6bd2e4e4-f071-46c0-b5fe-db175f638a13, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}}] {{(pid=102562) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:13:51.303675 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (6bd2e4e4-f071-46c0-b5fe-db175f638a13), before_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:51.340620 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d63367b5-dbf2-44b5-8180-d338761acb9d None None] Pushing event updated for resources: {'Port': ['ID=13fcfd03-fc49-4bba-8574-ec74e795e2bd,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:51.349009 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-571e0971-a45c-4377-b426-10cc81bbb393 None None] Network 3b72196e-a88b-47cc-8d61-dbdb9bd382b8 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:13:51.371239 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_common [None req-2d6cb40e-ba0d-4b04-a695-7d752a3cd605 admin admin] Allocated IP 172.20.0.1 (3b72196e-a88b-47cc-8d61-dbdb9bd382b8/24466b5d-d35d-4ad0-812e-ceb5c371f644/91ab6805-d053-4617-b07e-1f7786dcb82f) {{(pid=102560) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:13:51.389053 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.db [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] For port 6bd2e4e4-f071-46c0-b5fe-db175f638a13, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102562) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:13:51.394506 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.db [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] For port 6bd2e4e4-f071-46c0-b5fe-db175f638a13, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=6bd2e4e4-f071-46c0-b5fe-db175f638a13,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102562) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:13:51.414757 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (6bd2e4e4-f071-46c0-b5fe-db175f638a13), after_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:51.443624 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7541464-2909-4082-b012-7e950a591925 req-2ad9e465-8e26-4450-b6a3-9303814e1368 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:51.450625 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a7541464-2909-4082-b012-7e950a591925 req-2ad9e465-8e26-4450-b6a3-9303814e1368 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea HTTP/1.1" status: 200 len: 944 time: 0.2128067 Feb 08 18:13:51.498793 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['58368d01-b8e8-4efd-b4a1-c88b7cdc4771'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:13:51.534267 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a7541464-2909-4082-b012-7e950a591925 req-63173c64-5962-46f7-9b9b-4113bd3bdd5d tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0779819 Feb 08 18:13:51.573850 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2d6cb40e-ba0d-4b04-a695-7d752a3cd605 admin admin] Publish callbacks [] for port (91ab6805-d053-4617-b07e-1f7786dcb82f), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:51.585506 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ba65d371-2361-4f76-aed8-a2c15d6383dc None None] Provisioning complete for port 13fcfd03-fc49-4bba-8574-ec74e795e2bd triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:51.585988 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ba65d371-2361-4f76-aed8-a2c15d6383dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (13fcfd03-fc49-4bba-8574-ec74e795e2bd), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:51.620626 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc7ddac3-8015-44c6-9d5d-cb8494088b00 None None] Pushing event updated for resources: {'Port': ['ID=6bd2e4e4-f071-46c0-b5fe-db175f638a13,revision_number=3']} {{(pid=102562) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:51.645729 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2d6cb40e-ba0d-4b04-a695-7d752a3cd605 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (91ab6805-d053-4617-b07e-1f7786dcb82f), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:51.658464 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] Routers {'4383a61e-2e1d-48ae-94de-32830e84c9c4'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:13:51.659057 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:13:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['4383a61e-2e1d-48ae-94de-32830e84c9c4'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:13:51.767472 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d6cb40e-ba0d-4b04-a695-7d752a3cd605 admin admin] Network 3b72196e-a88b-47cc-8d61-dbdb9bd382b8 is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:13:51.768516 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 0cad626a-b423-4561-8abb-3bb66a3cad8d up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:13:51.774436 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-2d6cb40e-ba0d-4b04-a695-7d752a3cd605 admin admin] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:13:51.776621 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:51.783110 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d6cb40e-ba0d-4b04-a695-7d752a3cd605 admin admin] Received port after_create {{(pid=102560) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:13:51.867149 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] Set router 4383a61e-2e1d-48ae-94de-32830e84c9c4 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:13:51.878844 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2d6cb40e-ba0d-4b04-a695-7d752a3cd605 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-560871'] for router_interface (4383a61e-2e1d-48ae-94de-32830e84c9c4), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:51.937336 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d6cb40e-ba0d-4b04-a695-7d752a3cd605 admin admin] Pushing event updated for resources: {'Port': ['ID=91ab6805-d053-4617-b07e-1f7786dcb82f,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:52.002462 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 4, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '13fcfd03-fc49-4bba-8574-ec74e795e2bd', 'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'mac_address': 'fa:16:3e:4b:7b:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:44Z', 'updated_at': '2022-02-08T18:13:49Z', 'revision_number': 4, 'project_id': '768f50510c57419e8a49ed0988014174', 'subnets': [{'id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:13:52.068814 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90253ca5-7b2d-4603-8d54-50a0f06fe6cf None None] The sync data for ids ['72b4fd56-6775-4076-9195-fe85693f53aa'] in dv-cinder-773985-21-iscsi is: [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 4, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '13fcfd03-fc49-4bba-8574-ec74e795e2bd', 'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'mac_address': 'fa:16:3e:4b:7b:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:44Z', 'updated_at': '2022-02-08T18:13:49Z', 'revision_number': 4, 'project_id': '768f50510c57419e8a49ed0988014174', 'subnets': [{'id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:13:52.085775 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2d6cb40e-ba0d-4b04-a695-7d752a3cd605 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (91ab6805-d053-4617-b07e-1f7786dcb82f), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:52.109430 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ba65d371-2361-4f76-aed8-a2c15d6383dc None None] Current status of the port 13fcfd03-fc49-4bba-8574-ec74e795e2bd is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:52.125811 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 50fd9608-2dd8-44fa-bf18-dfa18cd45e68 no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:13:52.188564 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] No Port match for: 50fd9608-2dd8-44fa-bf18-dfa18cd45e68 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:13:52.188976 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 50fd9608-2dd8-44fa-bf18-dfa18cd45e68 not bound to the agent host hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:13:52.192241 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 0cad626a-b423-4561-8abb-3bb66a3cad8d triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:52.192750 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (0cad626a-b423-4561-8abb-3bb66a3cad8d), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:52.198298 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ba65d371-2361-4f76-aed8-a2c15d6383dc None None] Provisioning complete for port 0cad626a-b423-4561-8abb-3bb66a3cad8d triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:52.205024 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ba65d371-2361-4f76-aed8-a2c15d6383dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (0cad626a-b423-4561-8abb-3bb66a3cad8d), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:52.262662 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4383a61e-2e1d-48ae-94de-32830e84c9c4', 'name': 'tempest-TestVolumeBootPattern-458105507-router', 'tenant_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '6bd2e4e4-f071-46c0-b5fe-db175f638a13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:48Z', 'updated_at': '2022-02-08T18:13:49Z', 'revision_number': 3, 'project_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'gw_port': {'id': '6bd2e4e4-f071-46c0-b5fe-db175f638a13', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:10:51:18', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4383a61e-2e1d-48ae-94de-32830e84c9c4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 387, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:48Z', 'updated_at': '2022-02-08T18:13:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:13:52.322123 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-90ab67ca-0d9a-43eb-80d1-7ef5447de652 None None] The sync data for ids ['4383a61e-2e1d-48ae-94de-32830e84c9c4'] in dv-cinder-773985-21-iscsi is: [{'id': '4383a61e-2e1d-48ae-94de-32830e84c9c4', 'name': 'tempest-TestVolumeBootPattern-458105507-router', 'tenant_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '6bd2e4e4-f071-46c0-b5fe-db175f638a13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:48Z', 'updated_at': '2022-02-08T18:13:49Z', 'revision_number': 3, 'project_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'gw_port': {'id': '6bd2e4e4-f071-46c0-b5fe-db175f638a13', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:10:51:18', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4383a61e-2e1d-48ae-94de-32830e84c9c4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 387, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:48Z', 'updated_at': '2022-02-08T18:13:51Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}] {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:13:52.398413 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 0cad626a-b423-4561-8abb-3bb66a3cad8d is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:52.401415 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (0cad626a-b423-4561-8abb-3bb66a3cad8d), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:52.468211 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2d6cb40e-ba0d-4b04-a695-7d752a3cd605 admin admin] Publish callbacks [] for port (91ab6805-d053-4617-b07e-1f7786dcb82f), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:52.492155 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2d6cb40e-ba0d-4b04-a695-7d752a3cd605 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-64531588'] for port (91ab6805-d053-4617-b07e-1f7786dcb82f), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:52.514937 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] For port 0cad626a-b423-4561-8abb-3bb66a3cad8d, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=0cad626a-b423-4561-8abb-3bb66a3cad8d,segment=NetworkSegment(5a4471c8-e699-485f-ade3-bde146c6c0bb),segment_id=5a4471c8-e699-485f-ade3-bde146c6c0bb)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:13:52.528929 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (0cad626a-b423-4561-8abb-3bb66a3cad8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:52.533080 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ba65d371-2361-4f76-aed8-a2c15d6383dc None None] Current status of the port 0cad626a-b423-4561-8abb-3bb66a3cad8d is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:52.533457 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ba65d371-2361-4f76-aed8-a2c15d6383dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (0cad626a-b423-4561-8abb-3bb66a3cad8d), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:52.675439 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Pushing event updated for resources: {'Port': ['ID=0cad626a-b423-4561-8abb-3bb66a3cad8d,revision_number=3']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:52.714975 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.db.api [None req-ba65d371-2361-4f76-aed8-a2c15d6383dc None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102561) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Feb 08 18:13:52.715936 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG oslo_db.api [None req-ba65d371-2361-4f76-aed8-a2c15d6383dc None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Feb 08 18:13:52.801773 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2595b954-9c5f-467b-9139-e9855cc0fff7 req-0aa6e032-dce0-411a-83a1-f8c9bdd2b34c tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:52.805137 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2595b954-9c5f-467b-9139-e9855cc0fff7 req-0aa6e032-dce0-411a-83a1-f8c9bdd2b34c tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea HTTP/1.1" status: 200 len: 944 time: 0.1514373 Feb 08 18:13:52.897143 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2595b954-9c5f-467b-9139-e9855cc0fff7 req-da304f56-c5f9-477e-8aae-42da743ed93e tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0864055 Feb 08 18:13:53.005564 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2d6cb40e-ba0d-4b04-a695-7d752a3cd605 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-631683', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-559991'] for router_interface (4383a61e-2e1d-48ae-94de-32830e84c9c4), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:53.174077 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d6cb40e-ba0d-4b04-a695-7d752a3cd605 admin admin] Pushing event updated for resources: {'Port': ['ID=91ab6805-d053-4617-b07e-1f7786dcb82f,revision_number=2']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:53.283447 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ba65d371-2361-4f76-aed8-a2c15d6383dc None None] Current status of the port 0cad626a-b423-4561-8abb-3bb66a3cad8d is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:53.320797 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e7d9909-9b0e-4390-9636-8ade3a4e2a62 req-1b43833b-6caf-4695-bbc8-8408f06bb315 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:53.324744 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8e7d9909-9b0e-4390-9636-8ade3a4e2a62 req-1b43833b-6caf-4695-bbc8-8408f06bb315 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.2802753 Feb 08 18:13:53.379212 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2d6cb40e-ba0d-4b04-a695-7d752a3cd605 admin admin] Network 3b72196e-a88b-47cc-8d61-dbdb9bd382b8 is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:13:53.384742 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-2d6cb40e-ba0d-4b04-a695-7d752a3cd605 admin admin] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:13:53.427856 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-8c239e72-b19a-4940-9235-013bf517b86d None None] Provisioning complete for port 91ab6805-d053-4617-b07e-1f7786dcb82f triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:53.428664 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-8c239e72-b19a-4940-9235-013bf517b86d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (91ab6805-d053-4617-b07e-1f7786dcb82f), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:53.502693 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8e7d9909-9b0e-4390-9636-8ade3a4e2a62 req-e23573f8-a921-4142-85d6-12282726578d tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1717851 Feb 08 18:13:53.585079 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-8c239e72-b19a-4940-9235-013bf517b86d None None] Port 91ab6805-d053-4617-b07e-1f7786dcb82f cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:13:53.639542 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-8c239e72-b19a-4940-9235-013bf517b86d None None] Provisioning complete for port 0cad626a-b423-4561-8abb-3bb66a3cad8d triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:53.640012 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-8c239e72-b19a-4940-9235-013bf517b86d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (0cad626a-b423-4561-8abb-3bb66a3cad8d), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:53.654885 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2d6cb40e-ba0d-4b04-a695-7d752a3cd605 admin admin] Router 4383a61e-2e1d-48ae-94de-32830e84c9c4 has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:13:53.877585 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 6bd2e4e4-f071-46c0-b5fe-db175f638a13 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:13:53.894481 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2d6cb40e-ba0d-4b04-a695-7d752a3cd605 admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:13:53.907028 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-2d6cb40e-ba0d-4b04-a695-7d752a3cd605 admin admin] 10.222.0.118 "PUT /v2.0/routers/4383a61e-2e1d-48ae-94de-32830e84c9c4/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4924064 Feb 08 18:13:53.981167 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:13:54.027031 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-8c239e72-b19a-4940-9235-013bf517b86d None None] Current status of the port 0cad626a-b423-4561-8abb-3bb66a3cad8d is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:54.074210 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 6bd2e4e4-f071-46c0-b5fe-db175f638a13 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:54.075185 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (6bd2e4e4-f071-46c0-b5fe-db175f638a13), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:54.117584 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6688041a-ad6e-4c64-9d95-d2b657478c61 req-a4e4b069-6ad7-4241-8c62-3bdbef7073f5 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:54.120181 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-6688041a-ad6e-4c64-9d95-d2b657478c61 req-a4e4b069-6ad7-4241-8c62-3bdbef7073f5 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea HTTP/1.1" status: 200 len: 944 time: 0.1096375 Feb 08 18:13:54.149603 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 58368d01-b8e8-4efd-b4a1-c88b7cdc4771 up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:13:54.193023 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-6688041a-ad6e-4c64-9d95-d2b657478c61 req-27087f5d-ec23-47d9-be6f-f4c0fe60f205 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0628877 Feb 08 18:13:54.264107 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-369f6603-052b-4d22-be27-bff10ef6cf65 None None] Provisioning complete for port 91ab6805-d053-4617-b07e-1f7786dcb82f triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:54.264580 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-369f6603-052b-4d22-be27-bff10ef6cf65 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (91ab6805-d053-4617-b07e-1f7786dcb82f), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:54.269835 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning for port 58368d01-b8e8-4efd-b4a1-c88b7cdc4771 completed by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Feb 08 18:13:54.318084 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port 58368d01-b8e8-4efd-b4a1-c88b7cdc4771 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:54.319227 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (58368d01-b8e8-4efd-b4a1-c88b7cdc4771), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:54.361044 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-369f6603-052b-4d22-be27-bff10ef6cf65 None None] Port 91ab6805-d053-4617-b07e-1f7786dcb82f cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:13:54.375573 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 6bd2e4e4-f071-46c0-b5fe-db175f638a13 is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:54.375967 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (6bd2e4e4-f071-46c0-b5fe-db175f638a13), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:54.399003 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] For port 6bd2e4e4-f071-46c0-b5fe-db175f638a13, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=6bd2e4e4-f071-46c0-b5fe-db175f638a13,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:13:54.405694 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (6bd2e4e4-f071-46c0-b5fe-db175f638a13), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:54.406506 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 13fcfd03-fc49-4bba-8574-ec74e795e2bd up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:13:54.664742 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 58368d01-b8e8-4efd-b4a1-c88b7cdc4771 is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:54.665264 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (58368d01-b8e8-4efd-b4a1-c88b7cdc4771), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:54.667206 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Pushing event updated for resources: {'Port': ['ID=6bd2e4e4-f071-46c0-b5fe-db175f638a13,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:54.698001 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '58368d01-b8e8-4efd-b4a1-c88b7cdc4771'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:13:54.700504 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a991e471-b61b-43ae-a652-8fb195b32669" -d '{"events": [{"server_uuid": "126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea", "name": "network-vif-plugged", "status": "completed", "tag": "58368d01-b8e8-4efd-b4a1-c88b7cdc4771"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:13:54.704952 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 13fcfd03-fc49-4bba-8574-ec74e795e2bd triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:54.705326 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (13fcfd03-fc49-4bba-8574-ec74e795e2bd), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:54.733926 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 58368d01-b8e8-4efd-b4a1-c88b7cdc4771, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=58368d01-b8e8-4efd-b4a1-c88b7cdc4771,segment=NetworkSegment(acdb31ea-e529-495f-b01f-8c3d7b96781f),segment_id=acdb31ea-e529-495f-b01f-8c3d7b96781f)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:13:54.747071 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (58368d01-b8e8-4efd-b4a1-c88b7cdc4771), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:54.750183 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:13:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0aa8f747-3d36-4163-9aa1-5d7252496b1b x-openstack-request-id: req-0aa8f747-3d36-4163-9aa1-5d7252496b1b {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:13:54.750501 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea", "name": "network-vif-plugged", "status": "completed", "tag": "58368d01-b8e8-4efd-b4a1-c88b7cdc4771", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:13:54.750753 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-0aa8f747-3d36-4163-9aa1-5d7252496b1b {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:13:54.751155 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '58368d01-b8e8-4efd-b4a1-c88b7cdc4771', 'code': 200} Feb 08 18:13:54.812348 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=58368d01-b8e8-4efd-b4a1-c88b7cdc4771,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:54.859589 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 13fcfd03-fc49-4bba-8574-ec74e795e2bd is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:54.862930 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 0cad626a-b423-4561-8abb-3bb66a3cad8d up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:13:54.935300 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 0cad626a-b423-4561-8abb-3bb66a3cad8d triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:54.936003 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (0cad626a-b423-4561-8abb-3bb66a3cad8d), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:55.036045 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 38630) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:55.042968 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-3117341e-0c65-406e-b95a-94ffb21e6523 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1840993501', 'description': 'tempest-secgroup-smoke-1840993501 description', 'project_id': '768f50510c57419e8a49ed0988014174'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:13:55.080422 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8298bf4a-da4a-4116-a149-a4a5dc73e17a req-64b2732a-50a1-4f58-8d0a-75805b545b8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:55.082621 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8298bf4a-da4a-4116-a149-a4a5dc73e17a req-64b2732a-50a1-4f58-8d0a-75805b545b8d service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea HTTP/1.1" status: 200 len: 1129 time: 0.0966930 Feb 08 18:13:55.108138 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-3117341e-0c65-406e-b95a-94ffb21e6523 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:55.136005 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 0cad626a-b423-4561-8abb-3bb66a3cad8d is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:55.193539 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8298bf4a-da4a-4116-a149-a4a5dc73e17a req-2e651971-22b1-467c-ac77-2001be50fd0d service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0883956 Feb 08 18:13:55.195412 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-3117341e-0c65-406e-b95a-94ffb21e6523 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group (2d4a2503-75cd-4739-b472-f29476744b67), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:55.202376 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-3117341e-0c65-406e-b95a-94ffb21e6523 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (2d4a2503-75cd-4739-b472-f29476744b67), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:55.236119 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-3117341e-0c65-406e-b95a-94ffb21e6523 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:55.237461 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-3117341e-0c65-406e-b95a-94ffb21e6523 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.2001090 Feb 08 18:13:55.240652 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 38646) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:55.247759 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-2816daaf-1ad9-44d2-96f4-c30a446b2ad1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Request body: {'security_group_rule': {'security_group_id': '2d4a2503-75cd-4739-b472-f29476744b67', 'project_id': '768f50510c57419e8a49ed0988014174', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:13:55.254162 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3117341e-0c65-406e-b95a-94ffb21e6523 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Pushing event updated for resources: {'SecurityGroup': ['ID=2d4a2503-75cd-4739-b472-f29476744b67,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:55.284676 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2816daaf-1ad9-44d2-96f4-c30a446b2ad1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group_rule (816e6390-d5f0-40a4-aeaa-376e9294ecdf), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:55.369879 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] Sync routers for ids ['4383a61e-2e1d-48ae-94de-32830e84c9c4'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:13:55.384310 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] Routers {'4383a61e-2e1d-48ae-94de-32830e84c9c4'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:13:55.385021 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:13:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['4383a61e-2e1d-48ae-94de-32830e84c9c4'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:13:55.403032 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adc30540-ae53-467e-8430-889221f48f2f req-7d71d135-3472-4583-80ac-2826b2f8a233 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:55.405377 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-adc30540-ae53-467e-8430-889221f48f2f req-7d71d135-3472-4583-80ac-2826b2f8a233 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea HTTP/1.1" status: 200 len: 945 time: 0.1066320 Feb 08 18:13:55.424534 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2816daaf-1ad9-44d2-96f4-c30a446b2ad1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group_rule (816e6390-d5f0-40a4-aeaa-376e9294ecdf), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:55.432362 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2816daaf-1ad9-44d2-96f4-c30a446b2ad1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (816e6390-d5f0-40a4-aeaa-376e9294ecdf), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:55.457221 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2816daaf-1ad9-44d2-96f4-c30a446b2ad1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=816e6390-d5f0-40a4-aeaa-376e9294ecdf,revision_number=0']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:55.470415 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2816daaf-1ad9-44d2-96f4-c30a446b2ad1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:55.471609 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-2816daaf-1ad9-44d2-96f4-c30a446b2ad1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2297826 Feb 08 18:13:55.474602 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 38660) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:55.479900 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-eed0cb43-6ba0-4c96-b565-ac7baa44b5f3 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Request body: {'security_group_rule': {'security_group_id': '2d4a2503-75cd-4739-b472-f29476744b67', 'project_id': '768f50510c57419e8a49ed0988014174', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:13:55.495176 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-adc30540-ae53-467e-8430-889221f48f2f req-1d625090-c515-4762-8b80-f7df03e50301 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0829611 Feb 08 18:13:55.529125 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-eed0cb43-6ba0-4c96-b565-ac7baa44b5f3 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group_rule (98c7853c-e44c-4b89-b450-60c204127872), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:55.548795 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] Set router 4383a61e-2e1d-48ae-94de-32830e84c9c4 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:13:55.615742 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 6bd2e4e4-f071-46c0-b5fe-db175f638a13 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:13:55.617829 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-eed0cb43-6ba0-4c96-b565-ac7baa44b5f3 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group_rule (98c7853c-e44c-4b89-b450-60c204127872), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:55.628634 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-eed0cb43-6ba0-4c96-b565-ac7baa44b5f3 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (98c7853c-e44c-4b89-b450-60c204127872), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:55.652735 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eed0cb43-6ba0-4c96-b565-ac7baa44b5f3 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=98c7853c-e44c-4b89-b450-60c204127872,revision_number=0']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:55.669841 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-eed0cb43-6ba0-4c96-b565-ac7baa44b5f3 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:55.672050 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09520a8e-23d1-4316-b56d-73a7c73ea3b8 req-2afaa080-fe19-47e0-84f0-70d00b2a5606 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:55.674920 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-eed0cb43-6ba0-4c96-b565-ac7baa44b5f3 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.1974876 Feb 08 18:13:55.675066 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-09520a8e-23d1-4316-b56d-73a7c73ea3b8 req-2afaa080-fe19-47e0-84f0-70d00b2a5606 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0672333 Feb 08 18:13:55.675980 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 38668) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:55.686684 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-cc5330df-590a-47d3-93ad-dca8727c133e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Request body: {'security_group_rule': {'security_group_id': '2d4a2503-75cd-4739-b472-f29476744b67', 'project_id': '768f50510c57419e8a49ed0988014174', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:13:55.725034 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-cc5330df-590a-47d3-93ad-dca8727c133e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group_rule (c538462e-caf9-4393-a2a5-a5a567798dae), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:55.753328 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-09520a8e-23d1-4316-b56d-73a7c73ea3b8 req-c4084775-224d-4236-a271-191201484432 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0684791 Feb 08 18:13:55.760494 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 6bd2e4e4-f071-46c0-b5fe-db175f638a13 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:55.761073 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (6bd2e4e4-f071-46c0-b5fe-db175f638a13), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:55.815250 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-cc5330df-590a-47d3-93ad-dca8727c133e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group_rule (c538462e-caf9-4393-a2a5-a5a567798dae), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:55.821621 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-cc5330df-590a-47d3-93ad-dca8727c133e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (c538462e-caf9-4393-a2a5-a5a567798dae), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:55.839979 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc5330df-590a-47d3-93ad-dca8727c133e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c538462e-caf9-4393-a2a5-a5a567798dae,revision_number=0']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:55.854073 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-cc5330df-590a-47d3-93ad-dca8727c133e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:55.857856 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-cc5330df-590a-47d3-93ad-dca8727c133e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1781945 Feb 08 18:13:55.858394 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 38684) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:55.867729 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-7f8d4c71-da25-4f5e-9866-4b20a495eba3 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Request body: {'security_group_rule': {'security_group_id': '2d4a2503-75cd-4739-b472-f29476744b67', 'project_id': '768f50510c57419e8a49ed0988014174', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:13:55.907672 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7f8d4c71-da25-4f5e-9866-4b20a495eba3 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group_rule (620e1a34-211a-4651-af08-6336c9eb7925), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:55.918196 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 6bd2e4e4-f071-46c0-b5fe-db175f638a13 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:55.935855 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4383a61e-2e1d-48ae-94de-32830e84c9c4', 'name': 'tempest-TestVolumeBootPattern-458105507-router', 'tenant_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '6bd2e4e4-f071-46c0-b5fe-db175f638a13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:48Z', 'updated_at': '2022-02-08T18:13:52Z', 'revision_number': 4, 'project_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'gw_port': {'id': '6bd2e4e4-f071-46c0-b5fe-db175f638a13', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:10:51:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4383a61e-2e1d-48ae-94de-32830e84c9c4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 387, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:48Z', 'updated_at': '2022-02-08T18:13:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '91ab6805-d053-4617-b07e-1f7786dcb82f', 'name': '', 'network_id': '3b72196e-a88b-47cc-8d61-dbdb9bd382b8', 'tenant_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'mac_address': 'fa:16:3e:50:98:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4383a61e-2e1d-48ae-94de-32830e84c9c4', 'device_owner': 'network:router_interface', 'standard_attr_id': 388, 'fixed_ips': [{'subnet_id': '24466b5d-d35d-4ad0-812e-ceb5c371f644', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:51Z', 'updated_at': '2022-02-08T18:13:52Z', 'revision_number': 2, 'project_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'subnets': [{'id': '24466b5d-d35d-4ad0-812e-ceb5c371f644', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:13:55.962887 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] Checking router: 4383a61e-2e1d-48ae-94de-32830e84c9c4 for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:13:55.963250 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] Updating router 4383a61e-2e1d-48ae-94de-32830e84c9c4 port 91ab6805-d053-4617-b07e-1f7786dcb82f binding host dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Feb 08 18:13:55.976068 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7f8d4c71-da25-4f5e-9866-4b20a495eba3 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group_rule (620e1a34-211a-4651-af08-6336c9eb7925), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:55.981469 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7f8d4c71-da25-4f5e-9866-4b20a495eba3 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (620e1a34-211a-4651-af08-6336c9eb7925), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:55.995788 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (91ab6805-d053-4617-b07e-1f7786dcb82f), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:56.003040 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f8d4c71-da25-4f5e-9866-4b20a495eba3 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=620e1a34-211a-4651-af08-6336c9eb7925,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:56.010218 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7f8d4c71-da25-4f5e-9866-4b20a495eba3 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:56.011617 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-7f8d4c71-da25-4f5e-9866-4b20a495eba3 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1521146 Feb 08 18:13:56.014238 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 38700) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:56.019316 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-322ee333-7ccd-4ae1-95eb-d75b2c227673 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Request body: {'security_group_rule': {'security_group_id': '2d4a2503-75cd-4739-b472-f29476744b67', 'project_id': '768f50510c57419e8a49ed0988014174', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:13:56.049801 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.db.securitygroups_db [None req-322ee333-7ccd-4ae1-95eb-d75b2c227673 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Project 768f50510c57419e8a49ed0988014174 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Feb 08 18:13:56.055729 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-322ee333-7ccd-4ae1-95eb-d75b2c227673 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group_rule (ba8a4db6-22a5-467f-84ed-8d692d28237b), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:56.123191 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-322ee333-7ccd-4ae1-95eb-d75b2c227673 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group_rule (ba8a4db6-22a5-467f-84ed-8d692d28237b), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:56.127444 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-322ee333-7ccd-4ae1-95eb-d75b2c227673 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (ba8a4db6-22a5-467f-84ed-8d692d28237b), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:56.144750 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-322ee333-7ccd-4ae1-95eb-d75b2c227673 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ba8a4db6-22a5-467f-84ed-8d692d28237b,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:56.152981 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-322ee333-7ccd-4ae1-95eb-d75b2c227673 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:56.154175 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-322ee333-7ccd-4ae1-95eb-d75b2c227673 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1389902 Feb 08 18:13:56.156915 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 38704) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:56.161098 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-03cc40cc-8683-4b06-8907-588c47b1b970 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Request body: {'security_group_rule': {'security_group_id': '2d4a2503-75cd-4739-b472-f29476744b67', 'project_id': '768f50510c57419e8a49ed0988014174', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:13:56.180156 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.db.securitygroups_db [None req-03cc40cc-8683-4b06-8907-588c47b1b970 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Project 768f50510c57419e8a49ed0988014174 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Feb 08 18:13:56.184810 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-03cc40cc-8683-4b06-8907-588c47b1b970 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group_rule (38f381a7-7b80-4210-813d-da176f231977), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:56.241791 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-03cc40cc-8683-4b06-8907-588c47b1b970 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group_rule (38f381a7-7b80-4210-813d-da176f231977), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:56.246316 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-03cc40cc-8683-4b06-8907-588c47b1b970 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (38f381a7-7b80-4210-813d-da176f231977), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:56.264018 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03cc40cc-8683-4b06-8907-588c47b1b970 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=38f381a7-7b80-4210-813d-da176f231977,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:56.270577 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] Publish callbacks [] for port (91ab6805-d053-4617-b07e-1f7786dcb82f), precommit_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:56.273299 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-03cc40cc-8683-4b06-8907-588c47b1b970 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:56.274676 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-03cc40cc-8683-4b06-8907-588c47b1b970 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1167922 Feb 08 18:13:56.276843 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (91ab6805-d053-4617-b07e-1f7786dcb82f), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:56.327260 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a476ecc3-c4a0-434e-b53e-87caa0d5de27 None None] Pushing event updated for resources: {'Port': ['ID=91ab6805-d053-4617-b07e-1f7786dcb82f,revision_number=3']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:56.413242 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] Attempting to bind port 91ab6805-d053-4617-b07e-1f7786dcb82f on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:13:56.415440 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] Attempting to bind port 91ab6805-d053-4617-b07e-1f7786dcb82f by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': '5a4471c8-e699-485f-ade3-bde146c6c0bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1064, 'network_id': '3b72196e-a88b-47cc-8d61-dbdb9bd382b8'}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:13:56.415993 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] Attempting to bind port 91ab6805-d053-4617-b07e-1f7786dcb82f on network 3b72196e-a88b-47cc-8d61-dbdb9bd382b8 {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:13:56.422787 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 13, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:13:56.423835 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] Checking segment: {'id': '5a4471c8-e699-485f-ade3-bde146c6c0bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1064, 'network_id': '3b72196e-a88b-47cc-8d61-dbdb9bd382b8'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102561) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:13:56.424655 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:56.425197 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] Bound using segment: {'id': '5a4471c8-e699-485f-ade3-bde146c6c0bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1064, 'network_id': '3b72196e-a88b-47cc-8d61-dbdb9bd382b8'} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:13:56.425847 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] Bound port: 91ab6805-d053-4617-b07e-1f7786dcb82f, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '5a4471c8-e699-485f-ade3-bde146c6c0bb', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1064, 'network_id': '3b72196e-a88b-47cc-8d61-dbdb9bd382b8'}}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:13:56.426517 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (91ab6805-d053-4617-b07e-1f7786dcb82f), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:56.497001 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] For port 91ab6805-d053-4617-b07e-1f7786dcb82f, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102561) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:13:56.502277 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] For port 91ab6805-d053-4617-b07e-1f7786dcb82f, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=91ab6805-d053-4617-b07e-1f7786dcb82f,segment=NetworkSegment(5a4471c8-e699-485f-ade3-bde146c6c0bb),segment_id=5a4471c8-e699-485f-ade3-bde146c6c0bb)] {{(pid=102561) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:13:56.514873 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (91ab6805-d053-4617-b07e-1f7786dcb82f), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:56.577837 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] Routers {'4383a61e-2e1d-48ae-94de-32830e84c9c4'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:13:56.578481 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:13:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['4383a61e-2e1d-48ae-94de-32830e84c9c4'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:13:56.662696 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a476ecc3-c4a0-434e-b53e-87caa0d5de27 None None] Pushing event updated for resources: {'Port': ['ID=91ab6805-d053-4617-b07e-1f7786dcb82f,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:56.700976 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25ab3ac6-c3aa-4e64-9561-620decf49ad2 req-4585cd90-22b7-409b-aba2-e1fb00798106 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:56.702218 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-845e3fc3-29d2-4ada-9b66-45f1e56447b7 None None] Provisioning complete for port 91ab6805-d053-4617-b07e-1f7786dcb82f triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:56.702749 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-845e3fc3-29d2-4ada-9b66-45f1e56447b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (91ab6805-d053-4617-b07e-1f7786dcb82f), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:56.707483 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-25ab3ac6-c3aa-4e64-9561-620decf49ad2 req-4585cd90-22b7-409b-aba2-e1fb00798106 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea HTTP/1.1" status: 200 len: 945 time: 0.1003540 Feb 08 18:13:56.770418 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-25ab3ac6-c3aa-4e64-9561-620decf49ad2 req-284b147d-6f6c-4b2e-835d-94a3293ede30 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0535007 Feb 08 18:13:56.776463 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] Set router 4383a61e-2e1d-48ae-94de-32830e84c9c4 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:13:56.877287 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5427fd16-219c-41d1-8008-20e3fa338331 req-f8e20639-5abf-493f-96c9-bf3747554f8a tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:56.880454 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5427fd16-219c-41d1-8008-20e3fa338331 req-f8e20639-5abf-493f-96c9-bf3747554f8a tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0560870 Feb 08 18:13:56.941757 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5427fd16-219c-41d1-8008-20e3fa338331 req-1f421289-9d6b-40c0-b326-0e0df283cdca tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0542867 Feb 08 18:13:56.966531 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-845e3fc3-29d2-4ada-9b66-45f1e56447b7 None None] Current status of the port 91ab6805-d053-4617-b07e-1f7786dcb82f is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:56.966531 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-845e3fc3-29d2-4ada-9b66-45f1e56447b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (91ab6805-d053-4617-b07e-1f7786dcb82f), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:57.036526 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-845e3fc3-29d2-4ada-9b66-45f1e56447b7 None None] For port 91ab6805-d053-4617-b07e-1f7786dcb82f, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=91ab6805-d053-4617-b07e-1f7786dcb82f,segment=NetworkSegment(5a4471c8-e699-485f-ade3-bde146c6c0bb),segment_id=5a4471c8-e699-485f-ade3-bde146c6c0bb)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:13:57.041239 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-845e3fc3-29d2-4ada-9b66-45f1e56447b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (91ab6805-d053-4617-b07e-1f7786dcb82f), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:57.101143 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-845e3fc3-29d2-4ada-9b66-45f1e56447b7 None None] Pushing event updated for resources: {'Port': ['ID=91ab6805-d053-4617-b07e-1f7786dcb82f,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:57.109089 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4383a61e-2e1d-48ae-94de-32830e84c9c4', 'name': 'tempest-TestVolumeBootPattern-458105507-router', 'tenant_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '6bd2e4e4-f071-46c0-b5fe-db175f638a13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:48Z', 'updated_at': '2022-02-08T18:13:52Z', 'revision_number': 4, 'project_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'gw_port': {'id': '6bd2e4e4-f071-46c0-b5fe-db175f638a13', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:10:51:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4383a61e-2e1d-48ae-94de-32830e84c9c4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 387, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:48Z', 'updated_at': '2022-02-08T18:13:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '91ab6805-d053-4617-b07e-1f7786dcb82f', 'name': '', 'network_id': '3b72196e-a88b-47cc-8d61-dbdb9bd382b8', 'tenant_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'mac_address': 'fa:16:3e:50:98:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4383a61e-2e1d-48ae-94de-32830e84c9c4', 'device_owner': 'network:router_interface', 'standard_attr_id': 388, 'fixed_ips': [{'subnet_id': '24466b5d-d35d-4ad0-812e-ceb5c371f644', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:51Z', 'updated_at': '2022-02-08T18:13:56Z', 'revision_number': 4, 'project_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'subnets': [{'id': '24466b5d-d35d-4ad0-812e-ceb5c371f644', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:13:57.136558 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4997c94a-200d-479d-953b-e6f6d4266129 None None] The sync data for ids ['4383a61e-2e1d-48ae-94de-32830e84c9c4'] in dv-cinder-773985-21-iscsi is: [{'id': '4383a61e-2e1d-48ae-94de-32830e84c9c4', 'name': 'tempest-TestVolumeBootPattern-458105507-router', 'tenant_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '6bd2e4e4-f071-46c0-b5fe-db175f638a13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:48Z', 'updated_at': '2022-02-08T18:13:52Z', 'revision_number': 4, 'project_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'gw_port': {'id': '6bd2e4e4-f071-46c0-b5fe-db175f638a13', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:10:51:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4383a61e-2e1d-48ae-94de-32830e84c9c4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 387, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:48Z', 'updated_at': '2022-02-08T18:13:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '91ab6805-d053-4617-b07e-1f7786dcb82f', 'name': '', 'network_id': '3b72196e-a88b-47cc-8d61-dbdb9bd382b8', 'tenant_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'mac_address': 'fa:16:3e:50:98:e6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4383a61e-2e1d-48ae-94de-32830e84c9c4', 'device_owner': 'network:router_interface', 'standard_attr_id': 388, 'fixed_ips': [{'subnet_id': '24466b5d-d35d-4ad0-812e-ceb5c371f644', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:51Z', 'updated_at': '2022-02-08T18:13:56Z', 'revision_number': 4, 'project_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'subnets': [{'id': '24466b5d-d35d-4ad0-812e-ceb5c371f644', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:13:57.161666 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-799ca6e0-53b6-44e9-a5e7-34e2ad0d5314 None None] Provisioning complete for port 91ab6805-d053-4617-b07e-1f7786dcb82f triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:57.162122 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-799ca6e0-53b6-44e9-a5e7-34e2ad0d5314 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (91ab6805-d053-4617-b07e-1f7786dcb82f), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:57.290309 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-799ca6e0-53b6-44e9-a5e7-34e2ad0d5314 None None] Current status of the port 91ab6805-d053-4617-b07e-1f7786dcb82f is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:57.448373 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 38782) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:57.617645 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 91ab6805-d053-4617-b07e-1f7786dcb82f up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:13:57.829314 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 91ab6805-d053-4617-b07e-1f7786dcb82f triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:13:57.829690 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (91ab6805-d053-4617-b07e-1f7786dcb82f), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:57.848422 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 38788) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:13:57.850157 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-17cf937e-ff96-4818-a962-b5976a6ee159 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=3e4cabb4ec92455bb1039d17ea1c0339&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3981099 Feb 08 18:13:57.934944 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 91ab6805-d053-4617-b07e-1f7786dcb82f is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:13:57.968287 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-474a6678-a80a-43eb-a084-8c48bbd6488c admin admin] Publish callbacks [] for security_group (554e9f35-c52e-4f9b-8a51-a983fe72dbe4), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:57.997844 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae73a6c6-f2ae-46a5-a6f9-94751b1d8e83 req-884850df-9808-4abc-a734-daf3ca678c8f tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:58.005286 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ae73a6c6-f2ae-46a5-a6f9-94751b1d8e83 req-884850df-9808-4abc-a734-daf3ca678c8f tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea HTTP/1.1" status: 200 len: 945 time: 0.1400230 Feb 08 18:13:58.031120 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-474a6678-a80a-43eb-a084-8c48bbd6488c admin admin] Publish callbacks [] for security_group (554e9f35-c52e-4f9b-8a51-a983fe72dbe4), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:58.088703 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93f96097-c37f-48f5-8720-e5476177ab14 req-19fd3e0f-ea9a-450f-a9ed-906532b2d90d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:58.090387 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-93f96097-c37f-48f5-8720-e5476177ab14 req-19fd3e0f-ea9a-450f-a9ed-906532b2d90d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0562038 Feb 08 18:13:58.091604 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ae73a6c6-f2ae-46a5-a6f9-94751b1d8e83 req-46a7df03-9d07-4f19-8e59-85a81e348916 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0850606 Feb 08 18:13:58.123365 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-474a6678-a80a-43eb-a084-8c48bbd6488c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (554e9f35-c52e-4f9b-8a51-a983fe72dbe4), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:58.127692 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-474a6678-a80a-43eb-a084-8c48bbd6488c admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:13:58.131526 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-474a6678-a80a-43eb-a084-8c48bbd6488c admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/554e9f35-c52e-4f9b-8a51-a983fe72dbe4 HTTP/1.1" status: 204 len: 168 time: 0.2816384 Feb 08 18:13:58.143717 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-474a6678-a80a-43eb-a084-8c48bbd6488c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=554e9f35-c52e-4f9b-8a51-a983fe72dbe4,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:13:58.179224 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-93f96097-c37f-48f5-8720-e5476177ab14 req-5e37b47f-b5b7-4f3f-a78f-961a1885d9ae tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0756257 Feb 08 18:13:59.321433 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6f8c643-519c-4c56-80aa-009d2e4db0bd req-abaa4a09-278c-4cb2-9b22-df88cad864c0 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:13:59.322995 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b6f8c643-519c-4c56-80aa-009d2e4db0bd req-abaa4a09-278c-4cb2-9b22-df88cad864c0 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0552516 Feb 08 18:13:59.374053 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b6f8c643-519c-4c56-80aa-009d2e4db0bd req-c4534fca-c8fa-4969-89eb-8357c4406a5d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437295 Feb 08 18:14:00.506337 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d229786-6434-436c-b940-950c6a8dca14 req-0e7ead56-562e-4a1b-9615-38cc47ba7117 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:00.507874 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0d229786-6434-436c-b940-950c6a8dca14 req-0e7ead56-562e-4a1b-9615-38cc47ba7117 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0592494 Feb 08 18:14:00.557775 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0d229786-6434-436c-b940-950c6a8dca14 req-1ef9ee2b-376f-432f-b7f8-16e11e818f0a tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437155 Feb 08 18:14:01.401925 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27da9b3b-c83e-45c9-8f18-61cef0b2de8a req-68947018-e688-404f-9034-8ea50e259dc6 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:01.403416 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-27da9b3b-c83e-45c9-8f18-61cef0b2de8a req-68947018-e688-404f-9034-8ea50e259dc6 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0578823 Feb 08 18:14:01.452658 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-27da9b3b-c83e-45c9-8f18-61cef0b2de8a req-9a8b6c88-4d3d-4a6d-912f-4a8450646599 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430534 Feb 08 18:14:01.688090 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9aaba45c-d7f5-4a78-bece-6a708c791fe5 req-b317d7a8-0456-431e-81ba-84f43e55fabd tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:01.689620 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9aaba45c-d7f5-4a78-bece-6a708c791fe5 req-b317d7a8-0456-431e-81ba-84f43e55fabd tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0567083 Feb 08 18:14:01.737606 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9aaba45c-d7f5-4a78-bece-6a708c791fe5 req-8d0b2195-94e7-4f78-b974-8880bc065f37 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0422373 Feb 08 18:14:02.579798 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aced4e8-5a13-4c70-88fd-32a2eae80db3 req-333dd4b1-ef0c-4f12-9a14-df80c6d1165e tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:02.581244 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7aced4e8-5a13-4c70-88fd-32a2eae80db3 req-333dd4b1-ef0c-4f12-9a14-df80c6d1165e tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0589855 Feb 08 18:14:02.630314 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7aced4e8-5a13-4c70-88fd-32a2eae80db3 req-925c7d20-ab7b-4228-8ad4-563e5c7a40f4 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426366 Feb 08 18:14:02.870624 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-741e68ad-9904-461c-a3c5-8c4d64407703 req-bcd6aa83-e52b-4b8d-a1f0-5bd6404f5cb4 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:02.872300 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-741e68ad-9904-461c-a3c5-8c4d64407703 req-bcd6aa83-e52b-4b8d-a1f0-5bd6404f5cb4 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0540476 Feb 08 18:14:02.919225 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-741e68ad-9904-461c-a3c5-8c4d64407703 req-8a0e8c13-6210-44b9-9d46-ccba37b23a39 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412166 Feb 08 18:14:03.753654 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d866601-fd5f-4cb4-8244-575827e76cee req-fa129667-e7f5-4723-b7d7-490fecb0adfe tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:03.755214 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8d866601-fd5f-4cb4-8244-575827e76cee req-fa129667-e7f5-4723-b7d7-490fecb0adfe tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0529902 Feb 08 18:14:03.810632 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8d866601-fd5f-4cb4-8244-575827e76cee req-aab259b5-1ea7-4dfd-a3cc-740e53a58597 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0497575 Feb 08 18:14:04.052593 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a22d7f31-939c-4503-b3c3-c9580d261100 req-07f0b805-bbd1-4642-98e2-3d59fadadf75 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:04.054456 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a22d7f31-939c-4503-b3c3-c9580d261100 req-07f0b805-bbd1-4642-98e2-3d59fadadf75 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0529315 Feb 08 18:14:04.106664 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a22d7f31-939c-4503-b3c3-c9580d261100 req-f650a150-73f7-4964-8619-89173eb9059f tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463314 Feb 08 18:14:04.953221 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16686ce8-a0aa-461a-999b-e51abf88058b req-b5ebaf14-9acf-4139-bb04-ee512d6a020f tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:04.954683 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-16686ce8-a0aa-461a-999b-e51abf88058b req-b5ebaf14-9acf-4139-bb04-ee512d6a020f tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0552835 Feb 08 18:14:05.004768 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-16686ce8-a0aa-461a-999b-e51abf88058b req-631f33a3-c721-4e27-ae5c-dc4142674bcb tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443609 Feb 08 18:14:05.262951 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ef4c01e-00ba-48b6-b73c-5055bb9c0820 req-c513a120-82e5-4bf0-b860-893f9df5fd78 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:05.264478 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8ef4c01e-00ba-48b6-b73c-5055bb9c0820 req-c513a120-82e5-4bf0-b860-893f9df5fd78 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0628221 Feb 08 18:14:05.313141 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8ef4c01e-00ba-48b6-b73c-5055bb9c0820 req-3c04ca81-6f8c-4b45-96f3-4e86a2fc4cc3 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425751 Feb 08 18:14:06.152200 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e666e75-82ed-4977-b663-1c601e24b2e6 req-63d022d6-2205-4ea0-bb08-e26c922a0121 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:06.153697 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2e666e75-82ed-4977-b663-1c601e24b2e6 req-63d022d6-2205-4ea0-bb08-e26c922a0121 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0717747 Feb 08 18:14:06.210484 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2e666e75-82ed-4977-b663-1c601e24b2e6 req-e0841653-d180-45ff-b8dc-02df71d7154b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0511048 Feb 08 18:14:06.440915 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e65cb823-75db-461b-969c-1906b05f5d60 req-897703aa-6434-45ae-ad40-638c4997cc88 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:06.442360 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e65cb823-75db-461b-969c-1906b05f5d60 req-897703aa-6434-45ae-ad40-638c4997cc88 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0563629 Feb 08 18:14:06.489830 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e65cb823-75db-461b-969c-1906b05f5d60 req-0b54d249-dbd9-4b64-a382-4c498eac4644 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415564 Feb 08 18:14:07.351121 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a45971-57a2-4771-90b1-acca10afd986 req-167ac30a-ad02-4835-a13c-b4aa7b431155 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:07.353768 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e8a45971-57a2-4771-90b1-acca10afd986 req-167ac30a-ad02-4835-a13c-b4aa7b431155 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0647941 Feb 08 18:14:07.411980 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e8a45971-57a2-4771-90b1-acca10afd986 req-7dd73ed7-bda8-425e-af0f-7ca21128def5 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0522332 Feb 08 18:14:07.642167 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba3ea511-d950-401b-b87c-c77bae57b412 req-a78947f7-1bcf-4227-b833-e7bcc10d8fa9 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:07.643946 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ba3ea511-d950-401b-b87c-c77bae57b412 req-a78947f7-1bcf-4227-b833-e7bcc10d8fa9 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0710957 Feb 08 18:14:07.694360 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ba3ea511-d950-401b-b87c-c77bae57b412 req-cb9af21d-4c15-4ce6-a1f3-a2a60b33c983 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444865 Feb 08 18:14:08.390474 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a41b69a-651a-4d88-9986-8f89e160a115 req-e611ba96-068f-4f2c-a651-ff35a4408c90 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:08.391864 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1a41b69a-651a-4d88-9986-8f89e160a115 req-e611ba96-068f-4f2c-a651-ff35a4408c90 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0864267 Feb 08 18:14:08.401259 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fec94192-8ac7-455f-ba31-13ea3dfcde9c req-a71b219b-0f8a-4105-bd23-d14cec32efb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:08.402646 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-fec94192-8ac7-455f-ba31-13ea3dfcde9c req-a71b219b-0f8a-4105-bd23-d14cec32efb8 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=3fb51fc0e23f4c66a482d4d406197299&device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 1130 time: 0.0673411 Feb 08 18:14:08.505137 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1a41b69a-651a-4d88-9986-8f89e160a115 req-23ee44f3-2b96-4a2f-a8f0-210191089632 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1075306 Feb 08 18:14:08.537706 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fec94192-8ac7-455f-ba31-13ea3dfcde9c req-d1304d4d-f783-495e-bf15-570f373fb0a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:08.539449 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-fec94192-8ac7-455f-ba31-13ea3dfcde9c req-d1304d4d-f783-495e-bf15-570f373fb0a7 service neutron] 10.222.0.109 "GET /v2.0/networks?id=f089911e-72de-4ff6-880b-ac3dd7927165 HTTP/1.1" status: 200 len: 921 time: 0.1251211 Feb 08 18:14:08.547967 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffb2653c-60d5-4760-a0cb-14996b40d772 req-f061e256-561f-464d-9d12-ec6082164fe9 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:08.549524 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ffb2653c-60d5-4760-a0cb-14996b40d772 req-f061e256-561f-464d-9d12-ec6082164fe9 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0592704 Feb 08 18:14:08.590659 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-fec94192-8ac7-455f-ba31-13ea3dfcde9c req-e74af4ea-d6e2-43e5-b40a-869b3d248fd0 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=f63fc38b-d10b-4316-b77f-d1816d07ca90 HTTP/1.1" status: 200 len: 217 time: 0.0358236 Feb 08 18:14:08.599497 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ffb2653c-60d5-4760-a0cb-14996b40d772 req-22f8217c-133b-4893-8d48-a1bf00a46820 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439658 Feb 08 18:14:08.638741 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fec94192-8ac7-455f-ba31-13ea3dfcde9c req-8830b04e-7933-4f76-8868-554aa988d4a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:08.640229 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-fec94192-8ac7-455f-ba31-13ea3dfcde9c req-8830b04e-7933-4f76-8868-554aa988d4a9 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=0af67967-364e-4325-b04f-b7e157c3c3d4 HTTP/1.1" status: 200 len: 859 time: 0.0426867 Feb 08 18:14:08.675909 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-fec94192-8ac7-455f-ba31-13ea3dfcde9c req-a76ec805-7a9a-4a2e-8aa4-5ff18aaf26f1 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=f089911e-72de-4ff6-880b-ac3dd7927165&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0265183 Feb 08 18:14:08.791552 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-fec94192-8ac7-455f-ba31-13ea3dfcde9c req-6cbd7be6-5212-45b9-baf2-6c688b042a9b service neutron] 10.222.0.109 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0959520 Feb 08 18:14:08.887752 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5144c64a-5aea-40ee-bc7f-d6fc12d28f8d req-962bcfc7-0da5-4f2d-ae00-bd77eebce311 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:08.889214 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5144c64a-5aea-40ee-bc7f-d6fc12d28f8d req-962bcfc7-0da5-4f2d-ae00-bd77eebce311 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.1166337 Feb 08 18:14:08.923983 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-fec94192-8ac7-455f-ba31-13ea3dfcde9c req-6b024083-76d9-4078-aef9-7c43580c884a service neutron] 10.222.0.109 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1184080 Feb 08 18:14:08.951310 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5144c64a-5aea-40ee-bc7f-d6fc12d28f8d req-5cdda35f-769a-4304-a37f-1b26e2242782 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0558734 Feb 08 18:14:09.535065 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-b5a68fe1-2a84-4bd9-a358-facbccec2f86 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:09.536630 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-b5a68fe1-2a84-4bd9-a358-facbccec2f86 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/networks?id=622fcad3-2fd8-49df-8f66-feb243e2b24d HTTP/1.1" status: 200 len: 815 time: 0.1420813 Feb 08 18:14:09.551766 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-5c93f9de-75cb-4bc7-b98e-8fdcd560ce23 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/quotas/602d106ac7104b10bebcfc0421ea5edc HTTP/1.1" status: 200 len: 375 time: 0.0096040 Feb 08 18:14:09.616929 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-bd9bc3ed-f39c-4be6-a94d-45efa5004b4e tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?tenant_id=602d106ac7104b10bebcfc0421ea5edc&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0556519 Feb 08 18:14:09.644867 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17ae508b-b819-41bb-8274-628409a1c3f8 req-ee47eb02-3df4-481b-86b9-6883444338b5 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:09.646356 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-17ae508b-b819-41bb-8274-628409a1c3f8 req-ee47eb02-3df4-481b-86b9-6883444338b5 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0591576 Feb 08 18:14:09.701801 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-17ae508b-b819-41bb-8274-628409a1c3f8 req-623883b5-0f0b-4b6a-a01d-ca83cca58501 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485623 Feb 08 18:14:09.724604 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-cc4b1093-d7f6-4f0d-ba33-47d1ef02f5cb service neutron] 10.222.0.118 "GET /v2.0/networks/622fcad3-2fd8-49df-8f66-feb243e2b24d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0980909 Feb 08 18:14:09.820399 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb841b99-9f8d-4219-a40d-0472cce3e433 req-75bafc41-a983-460f-9850-717d3e325143 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:09.821872 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-bb841b99-9f8d-4219-a40d-0472cce3e433 req-75bafc41-a983-460f-9850-717d3e325143 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0563388 Feb 08 18:14:09.824879 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3390682a-8de6-4a14-bfaf-28741f629206 service neutron] 10.222.0.118 "GET /v2.0/networks/622fcad3-2fd8-49df-8f66-feb243e2b24d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0970068 Feb 08 18:14:09.873822 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-bb841b99-9f8d-4219-a40d-0472cce3e433 req-e993de78-2954-4354-a9d6-bd7a64922e6d tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455687 Feb 08 18:14:09.994186 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ed032165-af79-4a0c-b5ca-b0961d604806 req-d92dc0b8-1f71-49ba-9832-bfa8fc2345f3 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=505d3a98-d004-47d4-9a5f-f3b39fa267a3 HTTP/1.1" status: 200 len: 210 time: 0.0316133 Feb 08 18:14:10.095256 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c776cc05-f2ce-4b1e-ac16-e5d51db72f36 req-ddcdcb6b-069b-461c-83d2-ce69de31e529 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:10.096912 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c776cc05-f2ce-4b1e-ac16-e5d51db72f36 req-ddcdcb6b-069b-461c-83d2-ce69de31e529 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0536587 Feb 08 18:14:10.150227 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c776cc05-f2ce-4b1e-ac16-e5d51db72f36 req-6e99c302-761c-4c6a-bb9b-ffcd53e53188 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0474901 Feb 08 18:14:10.854232 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e01f59e4-09a2-42e4-afe4-d1cbb9c9083b req-3f8d9807-4fbf-43e6-8127-3834d7b14379 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:10.855974 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e01f59e4-09a2-42e4-afe4-d1cbb9c9083b req-3f8d9807-4fbf-43e6-8127-3834d7b14379 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0773227 Feb 08 18:14:10.909678 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e01f59e4-09a2-42e4-afe4-d1cbb9c9083b req-80412b77-3117-4604-bb33-874e46b81023 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450110 Feb 08 18:14:11.012544 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c2cd644-44b1-46c1-a294-2ac3d012292b req-1341135f-bd46-4433-8994-e7e1e41f9911 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:11.014020 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5c2cd644-44b1-46c1-a294-2ac3d012292b req-1341135f-bd46-4433-8994-e7e1e41f9911 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0655429 Feb 08 18:14:11.076234 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5c2cd644-44b1-46c1-a294-2ac3d012292b req-d484b636-827f-450f-a9a6-4c306c24a7f6 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0563855 Feb 08 18:14:11.124742 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-440f5884-c1af-45a0-b9d0-3221554fcd25 req-8d449c1f-05a3-4d19-89be-0d0f3befb8bb tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=505d3a98-d004-47d4-9a5f-f3b39fa267a3 HTTP/1.1" status: 200 len: 210 time: 0.0568845 Feb 08 18:14:11.176631 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-7dab378c-b07e-4c67-a73f-aa97870e14d7 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:11.178371 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-7dab378c-b07e-4c67-a73f-aa97870e14d7 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.109 "GET /v2.0/networks?id=622fcad3-2fd8-49df-8f66-feb243e2b24d HTTP/1.1" status: 200 len: 815 time: 0.1171510 Feb 08 18:14:11.191823 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Request body: {'port': {'device_id': '505d3a98-d004-47d4-9a5f-f3b39fa267a3', 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d', 'admin_state_up': True, 'tenant_id': '602d106ac7104b10bebcfc0421ea5edc'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:14:11.324249 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f01b9e8-99ec-4997-a9e2-c295619c5bce req-3228d2ee-b119-4cec-80ff-4d44aab39a2d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:11.325713 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4f01b9e8-99ec-4997-a9e2-c295619c5bce req-3228d2ee-b119-4cec-80ff-4d44aab39a2d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0881195 Feb 08 18:14:11.353089 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Made reservation on behalf of 602d106ac7104b10bebcfc0421ea5edc for: {'port': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:14:11.356411 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:11.428847 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4f01b9e8-99ec-4997-a9e2-c295619c5bce req-53ba9de3-976d-4e57-9bfe-33ba5b7df3ae tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0959353 Feb 08 18:14:11.502155 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_common [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Allocated IP 172.20.0.10 (622fcad3-2fd8-49df-8f66-feb243e2b24d/080b9f96-e4e1-410a-a6ed-01cf523843d5/0e17ac77-e9a3-4c18-9145-3f139aa468e9) {{(pid=102560) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:14:11.662497 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks [] for port (0e17ac77-e9a3-4c18-9145-3f139aa468e9), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:11.699414 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (0e17ac77-e9a3-4c18-9145-3f139aa468e9), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:11.724031 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['5676d44a-8ef0-472a-9703-1a68bebb5ad4', '58368d01-b8e8-4efd-b4a1-c88b7cdc4771'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:14:11.745107 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Network 622fcad3-2fd8-49df-8f66-feb243e2b24d is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:14:11.748160 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:14:11.752365 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Received port after_create {{(pid=102560) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:14:11.756298 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Pushing event updated for resources: {'Port': ['ID=0e17ac77-e9a3-4c18-9145-3f139aa468e9,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:14:11.786426 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:11.786788 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:11.787109 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:11.787433 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:11.787751 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:11.788123 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:11.788445 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:11.788760 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:11.789074 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:11.789384 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:11.789692 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:11.790127 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:11.790426 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:11.813898 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:11.814500 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:11.830566 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-e85bbed2-1bee-4768-b6a5-1fb6e3c07c98 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.109 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6426873 Feb 08 18:14:11.843994 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] Request body: {'port': {'device_id': '505d3a98-d004-47d4-9a5f-f3b39fa267a3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77398'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:14:11.902466 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (0e17ac77-e9a3-4c18-9145-3f139aa468e9), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:12.036727 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1cc81f9b-24a4-4086-8ebc-1cf7eb1e3d70 req-d5ddb67a-9e8a-473a-afa0-246523134eb3 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:12.038314 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1cc81f9b-24a4-4086-8ebc-1cf7eb1e3d70 req-d5ddb67a-9e8a-473a-afa0-246523134eb3 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0556479 Feb 08 18:14:12.086236 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1cc81f9b-24a4-4086-8ebc-1cf7eb1e3d70 req-1139d6f6-2553-4e3d-9ade-0e14eefc2342 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421522 Feb 08 18:14:12.191787 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0e17ac77-e9a3-4c18-9145-3f139aa468e9 {{(pid=102560) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:14:12.200673 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] Publish callbacks [] for port (0e17ac77-e9a3-4c18-9145-3f139aa468e9), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:12.218028 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.provisioning_blocks [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] Transition to ACTIVE for port object 0e17ac77-e9a3-4c18-9145-3f139aa468e9 will not be triggered until provisioned by entity L2. {{(pid=102560) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Feb 08 18:14:12.224649 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-64531588'] for port (0e17ac77-e9a3-4c18-9145-3f139aa468e9), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:12.236071 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61adfce0-98a0-48de-8ac8-b62716b949e5 req-cc884743-1e69-4836-a25e-bba3f08784e7 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:12.237555 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-61adfce0-98a0-48de-8ac8-b62716b949e5 req-cc884743-1e69-4836-a25e-bba3f08784e7 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0801036 Feb 08 18:14:12.253526 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b45b5cdf-11df-440a-aa8e-6314eafbce84 req-da187985-29ec-478e-b943-d7a16c0cc1d9 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:12.255054 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b45b5cdf-11df-440a-aa8e-6314eafbce84 req-da187985-29ec-478e-b943-d7a16c0cc1d9 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=505d3a98-d004-47d4-9a5f-f3b39fa267a3 HTTP/1.1" status: 200 len: 932 time: 0.0600317 Feb 08 18:14:12.301964 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] Pushing event updated for resources: {'Port': ['ID=0e17ac77-e9a3-4c18-9145-3f139aa468e9,revision_number=2']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:14:12.309316 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b45b5cdf-11df-440a-aa8e-6314eafbce84 req-79d11415-5c23-4e9d-8001-bde34464d0c7 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485287 Feb 08 18:14:12.363997 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-61adfce0-98a0-48de-8ac8-b62716b949e5 req-2ed04ae0-a014-4d88-9761-88d8ad72a81d tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1055269 Feb 08 18:14:12.398825 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] Attempting to bind port 0e17ac77-e9a3-4c18-9145-3f139aa468e9 on host hv-cinder-77398 for vnic_type normal with profile {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:14:12.399225 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] Attempting to bind port 0e17ac77-e9a3-4c18-9145-3f139aa468e9 by drivers openvswitch,hyperv on host hv-cinder-77398 at level 0 using segments [{'id': 'acdb31ea-e529-495f-b01f-8c3d7b96781f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d'}] {{(pid=102560) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:14:12.399636 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] Attempting to bind port 0e17ac77-e9a3-4c18-9145-3f139aa468e9 on network 622fcad3-2fd8-49df-8f66-feb243e2b24d {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:14:12.406704 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] Port 0e17ac77-e9a3-4c18-9145-3f139aa468e9 on network 622fcad3-2fd8-49df-8f66-feb243e2b24d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77398 {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Feb 08 18:14:12.407052 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] Attempting to bind port 0e17ac77-e9a3-4c18-9145-3f139aa468e9 on network 622fcad3-2fd8-49df-8f66-feb243e2b24d {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:14:12.415058 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] Checking agent: {'id': '045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77398', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'started_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 13, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:14:12.415399 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] Checking segment: {'id': 'acdb31ea-e529-495f-b01f-8c3d7b96781f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102560) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:14:12.415778 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] Bound using segment: {'id': 'acdb31ea-e529-495f-b01f-8c3d7b96781f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d'} {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:14:12.416198 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] Bound port: 0e17ac77-e9a3-4c18-9145-3f139aa468e9, host: hv-cinder-77398, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'acdb31ea-e529-495f-b01f-8c3d7b96781f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d'}}] {{(pid=102560) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:14:12.416547 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (0e17ac77-e9a3-4c18-9145-3f139aa468e9), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:12.482161 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] For port 0e17ac77-e9a3-4c18-9145-3f139aa468e9, host hv-cinder-77398, cleared binding levels {{(pid=102560) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:14:12.485606 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] For port 0e17ac77-e9a3-4c18-9145-3f139aa468e9, host hv-cinder-77398, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=0e17ac77-e9a3-4c18-9145-3f139aa468e9,segment=NetworkSegment(acdb31ea-e529-495f-b01f-8c3d7b96781f),segment_id=acdb31ea-e529-495f-b01f-8c3d7b96781f)] {{(pid=102560) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:14:12.492380 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-64531588'] for port (0e17ac77-e9a3-4c18-9145-3f139aa468e9), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:12.524457 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:12.525129 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:12.526494 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] 10.222.0.109 "PUT /v2.0/ports/0e17ac77-e9a3-4c18-9145-3f139aa468e9 HTTP/1.1" status: 200 len: 1094 time: 0.6874850 Feb 08 18:14:12.526954 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '505d3a98-d004-47d4-9a5f-f3b39fa267a3', 'tag': '0e17ac77-e9a3-4c18-9145-3f139aa468e9'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:14:12.529239 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-91a794e6-17fd-4024-bd0a-fecaa95dedbb" -d '{"events": [{"name": "network-changed", "server_uuid": "505d3a98-d004-47d4-9a5f-f3b39fa267a3", "tag": "0e17ac77-e9a3-4c18-9145-3f139aa468e9"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:14:12.557351 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bda25a5-e177-46dd-8996-731e751271ab service neutron] Pushing event updated for resources: {'Port': ['ID=0e17ac77-e9a3-4c18-9145-3f139aa468e9,revision_number=3']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:14:12.562092 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-655ae1d1-d0a2-4e6d-8185-b5410029788f req-cd649fbc-b5f4-46a4-b730-44249161dd3e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:12.563702 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-655ae1d1-d0a2-4e6d-8185-b5410029788f req-cd649fbc-b5f4-46a4-b730-44249161dd3e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0625968 Feb 08 18:14:12.579726 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:14:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0254358c-bb27-42c3-bdce-9081df1351a5 x-openstack-request-id: req-0254358c-bb27-42c3-bdce-9081df1351a5 {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:14:12.580005 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "505d3a98-d004-47d4-9a5f-f3b39fa267a3", "tag": "0e17ac77-e9a3-4c18-9145-3f139aa468e9", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:14:12.580249 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-0254358c-bb27-42c3-bdce-9081df1351a5 {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:14:12.580656 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '505d3a98-d004-47d4-9a5f-f3b39fa267a3', 'tag': '0e17ac77-e9a3-4c18-9145-3f139aa468e9', 'status': 'completed', 'code': 200} Feb 08 18:14:12.617030 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-655ae1d1-d0a2-4e6d-8185-b5410029788f req-86b34b44-0ac0-4cfa-98a5-391b83fac60e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454237 Feb 08 18:14:12.630880 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-e86abbb4-6102-47f8-930c-85d7b4954e70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:12.632349 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-e86abbb4-6102-47f8-930c-85d7b4954e70 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=602d106ac7104b10bebcfc0421ea5edc&device_id=505d3a98-d004-47d4-9a5f-f3b39fa267a3 HTTP/1.1" status: 200 len: 1128 time: 0.0445914 Feb 08 18:14:12.683452 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-aec25e2c-0ada-41c2-b840-7dc8601219b7 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=0e17ac77-e9a3-4c18-9145-3f139aa468e9 HTTP/1.1" status: 200 len: 217 time: 0.0370624 Feb 08 18:14:12.743896 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-1c8da654-d0e1-4f25-9f33-db33183893aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:12.745391 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-1c8da654-d0e1-4f25-9f33-db33183893aa service neutron] 10.222.0.109 "GET /v2.0/subnets?id=080b9f96-e4e1-410a-a6ed-01cf523843d5 HTTP/1.1" status: 200 len: 855 time: 0.0475738 Feb 08 18:14:12.779262 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-553c3965-985f-44a9-afe5-b59d4ccbc61b service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=622fcad3-2fd8-49df-8f66-feb243e2b24d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0267658 Feb 08 18:14:12.894616 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-3659dab1-3d3e-449a-8f74-14cbfaf72271 service neutron] 10.222.0.109 "GET /v2.0/networks/622fcad3-2fd8-49df-8f66-feb243e2b24d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0959527 Feb 08 18:14:12.990985 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f264244f-4491-4340-9ee0-9abd39dcf34f req-ccd9d87d-7f53-43cb-8e05-2b0b4e3c05d0 service neutron] 10.222.0.109 "GET /v2.0/networks/622fcad3-2fd8-49df-8f66-feb243e2b24d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0865149 Feb 08 18:14:13.115748 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91a794e6-17fd-4024-bd0a-fecaa95dedbb req-fb96c660-e077-48f5-953d-40a3deb3bfc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:13.117108 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-91a794e6-17fd-4024-bd0a-fecaa95dedbb req-fb96c660-e077-48f5-953d-40a3deb3bfc5 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=602d106ac7104b10bebcfc0421ea5edc&device_id=505d3a98-d004-47d4-9a5f-f3b39fa267a3 HTTP/1.1" status: 200 len: 1128 time: 0.0476766 Feb 08 18:14:13.241573 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91a794e6-17fd-4024-bd0a-fecaa95dedbb req-dc7a7df6-e1b1-47cf-89dd-a4007a95d797 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:13.243181 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-91a794e6-17fd-4024-bd0a-fecaa95dedbb req-dc7a7df6-e1b1-47cf-89dd-a4007a95d797 service neutron] 10.222.0.109 "GET /v2.0/networks?id=622fcad3-2fd8-49df-8f66-feb243e2b24d HTTP/1.1" status: 200 len: 917 time: 0.1189792 Feb 08 18:14:13.252710 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-793ee94a-68ae-4311-9e0c-e1da34e9e195 req-7fcb987a-a14f-4bb4-9018-a96960f305ee tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:13.254068 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-793ee94a-68ae-4311-9e0c-e1da34e9e195 req-7fcb987a-a14f-4bb4-9018-a96960f305ee tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0836205 Feb 08 18:14:13.435846 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5640567-9859-40fc-9269-82a030e2938c req-f9f7c4fc-90a7-4666-9bf7-354c50d56e2b tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:13.437412 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e5640567-9859-40fc-9269-82a030e2938c req-f9f7c4fc-90a7-4666-9bf7-354c50d56e2b tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=505d3a98-d004-47d4-9a5f-f3b39fa267a3 HTTP/1.1" status: 200 len: 944 time: 0.0581343 Feb 08 18:14:13.486326 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e5640567-9859-40fc-9269-82a030e2938c req-57c58523-c3f5-41f6-954c-d7b3a5b9ebd7 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429819 Feb 08 18:14:13.524600 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-91a794e6-17fd-4024-bd0a-fecaa95dedbb req-df6b15a3-1598-4244-8914-65dc0f0a4644 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=0e17ac77-e9a3-4c18-9145-3f139aa468e9 HTTP/1.1" status: 200 len: 217 time: 0.2695646 Feb 08 18:14:13.592835 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-793ee94a-68ae-4311-9e0c-e1da34e9e195 req-2ece56c6-1ac1-41cd-b1a3-e416658a0c61 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3310721 Feb 08 18:14:13.594301 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91a794e6-17fd-4024-bd0a-fecaa95dedbb req-72d8d9d8-5c77-457d-bca1-cd0d74c9d78a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:13.594688 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44af8a77-c8c6-4b39-9ab5-14d28108d36e req-5a7ef6f5-62a8-45d0-8077-6d6777f0ea7b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:13.595665 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-91a794e6-17fd-4024-bd0a-fecaa95dedbb req-72d8d9d8-5c77-457d-bca1-cd0d74c9d78a service neutron] 10.222.0.109 "GET /v2.0/subnets?id=080b9f96-e4e1-410a-a6ed-01cf523843d5 HTTP/1.1" status: 200 len: 855 time: 0.0633407 Feb 08 18:14:13.596491 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-44af8a77-c8c6-4b39-9ab5-14d28108d36e req-5a7ef6f5-62a8-45d0-8077-6d6777f0ea7b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0531807 Feb 08 18:14:13.628938 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-91a794e6-17fd-4024-bd0a-fecaa95dedbb req-8c9cfa52-4317-4035-b74f-ebb8a23cbe6e service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=622fcad3-2fd8-49df-8f66-feb243e2b24d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0255780 Feb 08 18:14:13.642673 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-44af8a77-c8c6-4b39-9ab5-14d28108d36e req-8c7bb90d-80f1-47c3-8540-00ebf474cfd7 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0408206 Feb 08 18:14:13.755293 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-91a794e6-17fd-4024-bd0a-fecaa95dedbb req-25f92ac4-e790-4f06-848d-2831e654e53c service neutron] 10.222.0.109 "GET /v2.0/networks/622fcad3-2fd8-49df-8f66-feb243e2b24d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1114426 Feb 08 18:14:13.766409 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6df1a91-2766-4b2b-a11d-db3324a14416 req-2d9d638b-3560-4add-8324-aa28ef4bf891 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:13.767831 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e6df1a91-2766-4b2b-a11d-db3324a14416 req-2d9d638b-3560-4add-8324-aa28ef4bf891 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0776646 Feb 08 18:14:13.867071 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e6df1a91-2766-4b2b-a11d-db3324a14416 req-06b08c64-96b1-4502-85c6-0b96f848b012 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0912604 Feb 08 18:14:13.881858 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-91a794e6-17fd-4024-bd0a-fecaa95dedbb req-311a4126-777a-44fe-a8c2-8e86e6736ebf service neutron] 10.222.0.109 "GET /v2.0/networks/622fcad3-2fd8-49df-8f66-feb243e2b24d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1131487 Feb 08 18:14:14.614356 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ccad857-78b5-441b-b415-8ad268c4a318 req-ef32bb97-ce5a-40ad-b8af-b32e62fdb193 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:14.615857 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-4ccad857-78b5-441b-b415-8ad268c4a318 req-ef32bb97-ce5a-40ad-b8af-b32e62fdb193 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=505d3a98-d004-47d4-9a5f-f3b39fa267a3 HTTP/1.1" status: 200 len: 944 time: 0.0557325 Feb 08 18:14:14.667946 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-4ccad857-78b5-441b-b415-8ad268c4a318 req-1f308501-6325-4595-84f8-e7353b363c05 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0462627 Feb 08 18:14:14.713916 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d15d792-0761-4186-b2ac-e04496943ca1 req-6d572d12-8eb4-41a1-ae7e-79b6761c310e tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:14.715484 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-7d15d792-0761-4186-b2ac-e04496943ca1 req-6d572d12-8eb4-41a1-ae7e-79b6761c310e tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0541539 Feb 08 18:14:14.760439 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-7d15d792-0761-4186-b2ac-e04496943ca1 req-05fb0bf0-c95e-45c0-8945-62e909e0ed3b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395341 Feb 08 18:14:14.774462 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-687ebe00-6209-46e4-99ef-d4ff098b11d8 req-7a3a61a9-991d-46f7-ba08-49e8d7289b08 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:14.776058 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-687ebe00-6209-46e4-99ef-d4ff098b11d8 req-7a3a61a9-991d-46f7-ba08-49e8d7289b08 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0531185 Feb 08 18:14:14.822648 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-687ebe00-6209-46e4-99ef-d4ff098b11d8 req-7b11ba29-60b7-4517-84fc-8c2735567942 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0409877 Feb 08 18:14:15.008028 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8644c4aa-6bd3-46b0-8a2d-54bc63ea60b9 req-dff51615-6bb6-42e9-a6c2-eb64cb9bc725 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:15.009630 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8644c4aa-6bd3-46b0-8a2d-54bc63ea60b9 req-dff51615-6bb6-42e9-a6c2-eb64cb9bc725 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0611513 Feb 08 18:14:15.059313 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8644c4aa-6bd3-46b0-8a2d-54bc63ea60b9 req-1a878ff2-fd57-461c-b87d-93714db21da7 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436268 Feb 08 18:14:15.371743 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-8a7455b6-4ef9-4090-b9df-ad861a8a2849 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:15.794040 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4b9e56f-89c2-4a36-bca2-55e703a0ad72 req-2f21dc74-806f-42b4-833a-f951e1a737dd tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:15.796487 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f4b9e56f-89c2-4a36-bca2-55e703a0ad72 req-2f21dc74-806f-42b4-833a-f951e1a737dd tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=505d3a98-d004-47d4-9a5f-f3b39fa267a3 HTTP/1.1" status: 200 len: 944 time: 0.0562985 Feb 08 18:14:15.846393 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f4b9e56f-89c2-4a36-bca2-55e703a0ad72 req-56957bc6-d9aa-4ba7-8e03-d512812e2ae0 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450945 Feb 08 18:14:15.885786 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b3ccce0-5348-47a0-a27e-d3932446fac3 req-60d367c8-fd02-4887-b191-6b994c3f25b3 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:15.887815 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-9b3ccce0-5348-47a0-a27e-d3932446fac3 req-60d367c8-fd02-4887-b191-6b994c3f25b3 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0605345 Feb 08 18:14:15.936096 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-9b3ccce0-5348-47a0-a27e-d3932446fac3 req-67ef39ee-a97d-4b24-98d4-afea8cc308cb tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417917 Feb 08 18:14:15.965598 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abde1e2e-9900-4cfa-9ee3-a93652186590 req-bc5713e5-1143-41ea-b67a-e103651e38ce tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:15.967114 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-abde1e2e-9900-4cfa-9ee3-a93652186590 req-bc5713e5-1143-41ea-b67a-e103651e38ce tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0580916 Feb 08 18:14:16.017686 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-abde1e2e-9900-4cfa-9ee3-a93652186590 req-94121d59-bbd0-43c3-92e2-121f2e22014c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441651 Feb 08 18:14:16.168211 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-8088707b-568f-4293-8290-01af08617a8a tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1840993501&fields=id&tenant_id=768f50510c57419e8a49ed0988014174 HTTP/1.1" status: 200 len: 267 time: 0.0461266 Feb 08 18:14:16.183267 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-884d89d4-0ef3-4797-9a91-e0248de5a815 req-e82ab041-dd08-484b-93c2-b9218775c3d9 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:16.185059 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-884d89d4-0ef3-4797-9a91-e0248de5a815 req-e82ab041-dd08-484b-93c2-b9218775c3d9 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0555849 Feb 08 18:14:16.232592 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-884d89d4-0ef3-4797-9a91-e0248de5a815 req-19dcaf4d-f374-4d32-99ef-e334c0aa4519 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418158 Feb 08 18:14:16.275434 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-f64c913d-2b82-4e18-a6c8-6721dc3fa04e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:16.276958 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-f64c913d-2b82-4e18-a6c8-6721dc3fa04e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/networks?id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 HTTP/1.1" status: 200 len: 811 time: 0.1022024 Feb 08 18:14:16.277584 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 0e17ac77-e9a3-4c18-9145-3f139aa468e9 details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:14:16.291515 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-2e559829-a79e-4c60-ba03-98dbe1b5a89f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/quotas/768f50510c57419e8a49ed0988014174 HTTP/1.1" status: 200 len: 375 time: 0.0092185 Feb 08 18:14:16.345379 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-70385f66-097f-41d3-b2c7-885045cf6849 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?tenant_id=768f50510c57419e8a49ed0988014174&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0484486 Feb 08 18:14:16.375599 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 0e17ac77-e9a3-4c18-9145-3f139aa468e9, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=0e17ac77-e9a3-4c18-9145-3f139aa468e9,segment=NetworkSegment(acdb31ea-e529-495f-b01f-8c3d7b96781f),segment_id=acdb31ea-e529-495f-b01f-8c3d7b96781f)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:14:16.387754 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': '0e17ac77-e9a3-4c18-9145-3f139aa468e9', 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d', 'port_id': '0e17ac77-e9a3-4c18-9145-3f139aa468e9', 'mac_address': 'fa:16:3e:6e:51:68', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1074, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '080b9f96-e4e1-410a-a6ed-01cf523843d5', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:14:16.427940 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 0e17ac77-e9a3-4c18-9145-3f139aa468e9 is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:14:16.428331 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (0e17ac77-e9a3-4c18-9145-3f139aa468e9), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:16.441835 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0e17ac77-e9a3-4c18-9145-3f139aa468e9 {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:14:16.445566 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-4b7c8e31-79d9-490e-b82a-e5217a1cd4ed service neutron] 10.222.0.118 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0888722 Feb 08 18:14:16.461637 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 0e17ac77-e9a3-4c18-9145-3f139aa468e9, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=0e17ac77-e9a3-4c18-9145-3f139aa468e9,segment=NetworkSegment(acdb31ea-e529-495f-b01f-8c3d7b96781f),segment_id=acdb31ea-e529-495f-b01f-8c3d7b96781f)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:14:16.465492 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (0e17ac77-e9a3-4c18-9145-3f139aa468e9), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:16.518994 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=0e17ac77-e9a3-4c18-9145-3f139aa468e9,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:14:16.540589 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-2d923c52-c093-447b-ba01-ee6b8af4b029 service neutron] 10.222.0.118 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0870669 Feb 08 18:14:16.800765 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['0e17ac77-e9a3-4c18-9145-3f139aa468e9'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:14:16.849453 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ff3595a8-e354-4cad-bba3-2b761a7b2ef6 req-0ab12260-7c15-4917-95ba-7bdc0d7481a2 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 210 time: 0.0271544 Feb 08 18:14:16.981595 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57dc0ea4-f69f-4938-af4c-b818a04f3c0d req-7053d065-1758-4df4-bb45-557db869b4ec tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:16.983255 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-57dc0ea4-f69f-4938-af4c-b818a04f3c0d req-7053d065-1758-4df4-bb45-557db869b4ec tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=505d3a98-d004-47d4-9a5f-f3b39fa267a3 HTTP/1.1" status: 200 len: 945 time: 0.0596704 Feb 08 18:14:17.046451 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-57dc0ea4-f69f-4938-af4c-b818a04f3c0d req-157dbed4-8b6a-441c-84eb-1dee404f437d tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0566049 Feb 08 18:14:17.086615 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4931408c-7da1-4fc8-b82c-a1103dba5994 req-94e9d1ef-ee2e-4fc5-b195-befbb335c372 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:17.088714 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-4931408c-7da1-4fc8-b82c-a1103dba5994 req-94e9d1ef-ee2e-4fc5-b195-befbb335c372 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0770435 Feb 08 18:14:17.141852 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-4931408c-7da1-4fc8-b82c-a1103dba5994 req-b2535a53-46cb-4342-97e3-c9dfa4d34f08 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470226 Feb 08 18:14:17.162903 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c76f28ee-31c1-4142-bba8-ba74e43b53bc req-d573bd5e-b5a9-4c32-a94f-1b3e5b8e1a3d tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:17.164362 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c76f28ee-31c1-4142-bba8-ba74e43b53bc req-d573bd5e-b5a9-4c32-a94f-1b3e5b8e1a3d tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0527160 Feb 08 18:14:17.217087 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c76f28ee-31c1-4142-bba8-ba74e43b53bc req-bac66904-5106-4ae2-8d56-762b3f9a645a tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423944 Feb 08 18:14:17.359113 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e893c00b-3129-4d9a-a0bc-8677c3148448 req-3c84c95d-49fb-4520-9d4b-653577fdb7a7 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:17.360641 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e893c00b-3129-4d9a-a0bc-8677c3148448 req-3c84c95d-49fb-4520-9d4b-653577fdb7a7 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0558922 Feb 08 18:14:17.408559 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e893c00b-3129-4d9a-a0bc-8677c3148448 req-e0d21195-448a-4683-bef6-d9a40f0061f4 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418186 Feb 08 18:14:17.435644 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d03a91ba-bd16-4667-a973-7846a336001b req-00b1450e-7e80-4a73-b8b1-404d08e6a3a9 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:17.440786 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d03a91ba-bd16-4667-a973-7846a336001b req-00b1450e-7e80-4a73-b8b1-404d08e6a3a9 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0625904 Feb 08 18:14:17.485203 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d03a91ba-bd16-4667-a973-7846a336001b req-9e15ab7f-f790-4485-9d70-185cf1463793 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432568 Feb 08 18:14:17.545434 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a56625db-cfa6-4af5-8d38-7a24577fb439 req-14fe5be8-ad4c-40e6-89f0-a8d9319bb6af service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:17.547255 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a56625db-cfa6-4af5-8d38-7a24577fb439 req-14fe5be8-ad4c-40e6-89f0-a8d9319bb6af service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=630172c388404c75bda3d0ba2d9d5834&device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 1130 time: 0.0566723 Feb 08 18:14:17.568630 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e99e0e3d-e66a-4bd5-bb0e-31ca12ff7c9f req-67f0d0d8-3a23-426c-bdf7-00ffa06c2660 service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0519321 Feb 08 18:14:17.638381 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a56625db-cfa6-4af5-8d38-7a24577fb439 req-694a4c37-13cc-4088-9b05-dfd26984c5bf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:17.638584 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e99e0e3d-e66a-4bd5-bb0e-31ca12ff7c9f req-c00fb1de-8839-4dff-a16b-613a40d57714 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:17.639788 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a56625db-cfa6-4af5-8d38-7a24577fb439 req-694a4c37-13cc-4088-9b05-dfd26984c5bf service neutron] 10.222.0.109 "GET /v2.0/networks?id=e430084e-9b28-426f-9937-61346814b135 HTTP/1.1" status: 200 len: 912 time: 0.0831306 Feb 08 18:14:17.639898 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e99e0e3d-e66a-4bd5-bb0e-31ca12ff7c9f req-c00fb1de-8839-4dff-a16b-613a40d57714 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=3fb51fc0e23f4c66a482d4d406197299&device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 1129 time: 0.0444355 Feb 08 18:14:17.717678 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a56625db-cfa6-4af5-8d38-7a24577fb439 req-c8417efa-36ad-423e-9917-da234ff6d806 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb HTTP/1.1" status: 200 len: 1002 time: 0.0665152 Feb 08 18:14:17.741828 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e99e0e3d-e66a-4bd5-bb0e-31ca12ff7c9f req-014680a3-2797-4d02-839e-01c027b619d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:17.743405 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e99e0e3d-e66a-4bd5-bb0e-31ca12ff7c9f req-014680a3-2797-4d02-839e-01c027b619d1 service neutron] 10.222.0.109 "GET /v2.0/networks?id=f089911e-72de-4ff6-880b-ac3dd7927165 HTTP/1.1" status: 200 len: 921 time: 0.0820944 Feb 08 18:14:17.765957 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a56625db-cfa6-4af5-8d38-7a24577fb439 req-89fd2337-72bf-4460-93e6-8fe9721426d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:17.767477 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a56625db-cfa6-4af5-8d38-7a24577fb439 req-89fd2337-72bf-4460-93e6-8fe9721426d9 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=86592955-e7d0-4e8a-9490-976e17240d7c HTTP/1.1" status: 200 len: 849 time: 0.0421262 Feb 08 18:14:17.788238 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e99e0e3d-e66a-4bd5-bb0e-31ca12ff7c9f req-f5d7727d-4f24-40c7-8da4-76e2286b351f service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=062ed5c0-df28-461b-87fe-826944e42c54 HTTP/1.1" status: 200 len: 217 time: 0.0365744 Feb 08 18:14:17.816391 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-6ba17952-0d02-4506-814d-345b0bebc85b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:17.820298 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a56625db-cfa6-4af5-8d38-7a24577fb439 req-24aca2dd-fd00-4289-b838-2152d7396a63 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:17.821840 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a56625db-cfa6-4af5-8d38-7a24577fb439 req-24aca2dd-fd00-4289-b838-2152d7396a63 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=e430084e-9b28-426f-9937-61346814b135&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0451710 Feb 08 18:14:17.844232 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e99e0e3d-e66a-4bd5-bb0e-31ca12ff7c9f req-0c52a04b-4ec9-4e18-93ab-9e5531f00346 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:17.845691 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e99e0e3d-e66a-4bd5-bb0e-31ca12ff7c9f req-0c52a04b-4ec9-4e18-93ab-9e5531f00346 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=0af67967-364e-4325-b04f-b7e157c3c3d4 HTTP/1.1" status: 200 len: 859 time: 0.0454404 Feb 08 18:14:17.884927 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e99e0e3d-e66a-4bd5-bb0e-31ca12ff7c9f req-43354112-203a-4f56-bb9f-b8d480f288e8 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=f089911e-72de-4ff6-880b-ac3dd7927165&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0255110 Feb 08 18:14:17.919882 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a56625db-cfa6-4af5-8d38-7a24577fb439 req-ea6b7f8c-8a5e-4216-b690-3866200670df service neutron] 10.222.0.109 "GET /v2.0/networks/e430084e-9b28-426f-9937-61346814b135?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0871606 Feb 08 18:14:17.955160 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4550d833-6556-4f40-b774-1e052923a312 req-3f7640b7-7e6f-4711-be46-60f537735a62 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 210 time: 0.0338931 Feb 08 18:14:17.965869 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:18.014788 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e99e0e3d-e66a-4bd5-bb0e-31ca12ff7c9f req-7028d606-fb53-4bec-a540-283cb0b4ad44 service neutron] 10.222.0.109 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1223571 Feb 08 18:14:18.042438 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a56625db-cfa6-4af5-8d38-7a24577fb439 req-8bce9659-8ccb-4fcb-9336-92a2757fda95 service neutron] 10.222.0.109 "GET /v2.0/networks/e430084e-9b28-426f-9937-61346814b135?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1124930 Feb 08 18:14:18.195344 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-55750d4f-d2f3-45dd-9126-30e3b6626ddb tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:18.196828 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-55750d4f-d2f3-45dd-9126-30e3b6626ddb tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.109 "GET /v2.0/networks?id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 HTTP/1.1" status: 200 len: 811 time: 0.1935337 Feb 08 18:14:18.210750 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e99e0e3d-e66a-4bd5-bb0e-31ca12ff7c9f req-1c601001-5d8a-4719-8297-1e0e2b45960f service neutron] 10.222.0.109 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1840420 Feb 08 18:14:18.226496 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfaf1f9d-374b-4161-aca0-11f7ce6fbf56 req-16b52c16-ae54-4ff4-a6a9-cd68fc8d3026 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:18.228056 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-cfaf1f9d-374b-4161-aca0-11f7ce6fbf56 req-16b52c16-ae54-4ff4-a6a9-cd68fc8d3026 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=505d3a98-d004-47d4-9a5f-f3b39fa267a3 HTTP/1.1" status: 200 len: 945 time: 0.1071694 Feb 08 18:14:18.278279 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:14:18.281260 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 0e17ac77-e9a3-4c18-9145-3f139aa468e9 up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:14:18.284390 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ec59f6a-de40-4dec-a0ac-23dab74b3df5 req-ff8b375d-4d61-48ed-b3a0-bffc53c84fd3 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:18.285925 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4ec59f6a-de40-4dec-a0ac-23dab74b3df5 req-ff8b375d-4d61-48ed-b3a0-bffc53c84fd3 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0733624 Feb 08 18:14:18.319552 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-cfaf1f9d-374b-4161-aca0-11f7ce6fbf56 req-f208913c-49be-46f1-8f58-988c262cba56 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0811954 Feb 08 18:14:18.324851 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-27275177-d193-421c-9ebf-38577dfe08d1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.109 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=768f50510c57419e8a49ed0988014174 HTTP/1.1" status: 200 len: 380 time: 0.0957541 Feb 08 18:14:18.341146 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Request body: {'port': {'device_id': '276ac338-a990-44da-a077-251beabd094d', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'admin_state_up': True, 'tenant_id': '768f50510c57419e8a49ed0988014174', 'security_groups': ['2d4a2503-75cd-4739-b472-f29476744b67']}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:14:18.344472 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4ec59f6a-de40-4dec-a0ac-23dab74b3df5 req-50dd833e-f086-4c78-b5c2-35e8c2a1430d tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0526142 Feb 08 18:14:18.388999 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning for port 0e17ac77-e9a3-4c18-9145-3f139aa468e9 completed by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Feb 08 18:14:18.396762 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port 0e17ac77-e9a3-4c18-9145-3f139aa468e9 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:14:18.397082 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (0e17ac77-e9a3-4c18-9145-3f139aa468e9), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:18.453553 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Made reservation on behalf of 768f50510c57419e8a49ed0988014174 for: {'port': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:14:18.457031 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:14:18.457210 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:18.480015 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'port_id': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8', 'mac_address': 'fa:16:3e:15:4a:9a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1053, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '73de7865-d87d-4a2a-a702-160c400f145f', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:14:18.510450 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:18.555350 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 is: ACTIVE; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:14:18.555790 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:18.566516 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 0e17ac77-e9a3-4c18-9145-3f139aa468e9 is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:14:18.566924 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (0e17ac77-e9a3-4c18-9145-3f139aa468e9), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:18.583132 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:14:18.598978 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '505d3a98-d004-47d4-9a5f-f3b39fa267a3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0e17ac77-e9a3-4c18-9145-3f139aa468e9'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:14:18.601232 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7ed43224-84d7-49ff-8ca7-24af29392868" -d '{"events": [{"server_uuid": "505d3a98-d004-47d4-9a5f-f3b39fa267a3", "name": "network-vif-plugged", "status": "completed", "tag": "0e17ac77-e9a3-4c18-9145-3f139aa468e9"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:14:18.617654 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7c523b0-8cf5-438b-8bbb-0304423386ae req-3fc0fdfe-975a-48e0-9dc8-1546a5a97955 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:18.620766 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2d72937-5426-4fdc-800a-48e7133c8d22 req-2013d765-0c40-406e-b834-e4b05f1828e8 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:18.622456 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f2d72937-5426-4fdc-800a-48e7133c8d22 req-2013d765-0c40-406e-b834-e4b05f1828e8 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0598266 Feb 08 18:14:18.624729 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d7c523b0-8cf5-438b-8bbb-0304423386ae req-3fc0fdfe-975a-48e0-9dc8-1546a5a97955 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.1063721 Feb 08 18:14:18.628096 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 0e17ac77-e9a3-4c18-9145-3f139aa468e9, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=0e17ac77-e9a3-4c18-9145-3f139aa468e9,segment=NetworkSegment(acdb31ea-e529-495f-b01f-8c3d7b96781f),segment_id=acdb31ea-e529-495f-b01f-8c3d7b96781f)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:14:18.630084 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:14:18.634464 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (0e17ac77-e9a3-4c18-9145-3f139aa468e9), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:18.639223 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:18.657004 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Allocated IP 172.20.0.12 (2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74/7b1e16de-d9af-4f50-86d7-ee22c9e14b1b/feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:14:18.694390 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=0e17ac77-e9a3-4c18-9145-3f139aa468e9,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:14:18.695953 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d7c523b0-8cf5-438b-8bbb-0304423386ae req-d29438f6-ab4d-425f-b397-dc3c3bbda214 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0703871 Feb 08 18:14:18.697070 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f2d72937-5426-4fdc-800a-48e7133c8d22 req-ec9aaf85-0bb9-47ba-9447-48d4349350b0 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0675766 Feb 08 18:14:18.759225 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8,revision_number=6']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:14:18.776491 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:14:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-81dc33a2-b8d8-454a-ae00-e5742092a42f x-openstack-request-id: req-81dc33a2-b8d8-454a-ae00-e5742092a42f {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:14:18.776963 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "505d3a98-d004-47d4-9a5f-f3b39fa267a3", "name": "network-vif-plugged", "status": "completed", "tag": "0e17ac77-e9a3-4c18-9145-3f139aa468e9", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:14:18.777387 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-81dc33a2-b8d8-454a-ae00-e5742092a42f {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:14:18.777926 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '505d3a98-d004-47d4-9a5f-f3b39fa267a3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0e17ac77-e9a3-4c18-9145-3f139aa468e9', 'code': 200} Feb 08 18:14:18.801558 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['2f2d1cfd-91ec-450a-bfe2-52d21f9196e8'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:14:18.916232 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for port (feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:18.965849 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:18.995906 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Network 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:14:19.017532 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:14:19.022156 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:14:19.029129 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:19.029129 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:19.082101 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.109 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.7499583 Feb 08 18:14:19.082694 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Pushing event updated for resources: {'Port': ['ID=feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:14:19.092367 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:19.092708 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:19.093611 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:19.093611 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:19.093847 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:19.093997 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:19.094317 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:19.094639 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:19.094991 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:19.095311 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:19.095656 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:19.095970 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:19.096282 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-28a1b280-5fe7-4b0a-8b73-8c85925b5062 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:19.107406 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] Request body: {'port': {'device_id': '276ac338-a990-44da-a077-251beabd094d', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77398'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:14:19.124131 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e06b57f-7096-4250-9906-b69167a807e1 req-f61bd102-f559-4386-8f64-6da34f1d841f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:19.125871 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-9e06b57f-7096-4250-9906-b69167a807e1 req-f61bd102-f559-4386-8f64-6da34f1d841f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 932 time: 0.0667212 Feb 08 18:14:19.151060 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b6db499-6680-4ece-80d7-1f3a79766b5f req-7dfc0562-52ea-46b4-b850-862af99bfd80 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:19.152576 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-4b6db499-6680-4ece-80d7-1f3a79766b5f req-7dfc0562-52ea-46b4-b850-862af99bfd80 service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=505d3a98-d004-47d4-9a5f-f3b39fa267a3 HTTP/1.1" status: 200 len: 1130 time: 0.1036665 Feb 08 18:14:19.181462 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-9e06b57f-7096-4250-9906-b69167a807e1 req-7adab682-48a7-4b32-a1e3-460cefb3f11b tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0497181 Feb 08 18:14:19.191961 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:19.246240 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-4b6db499-6680-4ece-80d7-1f3a79766b5f req-48a838f1-cc2b-4e52-a67e-5cde20ecb709 service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0747197 Feb 08 18:14:19.284744 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ece2d9a9-b000-4cfe-96c7-c1ad5a55ed9c None None] Provisioning complete for port feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:14:19.285369 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ece2d9a9-b000-4cfe-96c7-c1ad5a55ed9c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:19.319356 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ece2d9a9-b000-4cfe-96c7-c1ad5a55ed9c None None] Port feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:14:19.464469 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de6e59b8-f223-49b9-8871-8c7d1f663575 req-b1214f88-e596-4b70-b90d-5d33ffc0cb3b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:19.465985 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-de6e59b8-f223-49b9-8871-8c7d1f663575 req-b1214f88-e596-4b70-b90d-5d33ffc0cb3b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0529051 Feb 08 18:14:19.478918 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a4175da-08a9-4b5b-a092-5f8f2d9cb6f7 req-25fd5293-76e4-40f1-9e98-01c0745ecb54 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:19.480404 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8a4175da-08a9-4b5b-a092-5f8f2d9cb6f7 req-25fd5293-76e4-40f1-9e98-01c0745ecb54 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=505d3a98-d004-47d4-9a5f-f3b39fa267a3 HTTP/1.1" status: 200 len: 946 time: 0.0923080 Feb 08 18:14:19.511555 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-de6e59b8-f223-49b9-8871-8c7d1f663575 req-baf367aa-f077-421d-877b-e8201d9b8396 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395846 Feb 08 18:14:19.530128 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 {{(pid=102559) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:14:19.544475 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] Publish callbacks [] for port (feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:19.575085 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.provisioning_blocks [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] Transition to ACTIVE for port object feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 will not be triggered until provisioned by entity L2. {{(pid=102559) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Feb 08 18:14:19.581014 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8a4175da-08a9-4b5b-a092-5f8f2d9cb6f7 req-81c262ca-fa87-444e-abff-5c0e6f7e642e tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0950651 Feb 08 18:14:19.582502 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:19.632358 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] Pushing event updated for resources: {'Port': ['ID=feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:14:19.668497 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] Attempting to bind port feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 on host hv-cinder-77398 for vnic_type normal with profile {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:14:19.668840 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] Attempting to bind port feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 by drivers openvswitch,hyperv on host hv-cinder-77398 at level 0 using segments [{'id': 'fc5ec9ee-df90-46f3-bddf-aef0221d9066', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1066, 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74'}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:14:19.669174 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] Attempting to bind port feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 on network 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:14:19.674392 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] Port feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 on network 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77398 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Feb 08 18:14:19.674720 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] Attempting to bind port feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 on network 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:14:19.680605 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] Checking agent: {'id': '045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77398', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'started_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 14, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:14:19.680943 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] Checking segment: {'id': 'fc5ec9ee-df90-46f3-bddf-aef0221d9066', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1066, 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102559) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:14:19.681329 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] Bound using segment: {'id': 'fc5ec9ee-df90-46f3-bddf-aef0221d9066', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1066, 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74'} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:14:19.681755 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] Bound port: feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8, host: hv-cinder-77398, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fc5ec9ee-df90-46f3-bddf-aef0221d9066', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1066, 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74'}}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:14:19.682117 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:19.752111 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] For port feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8, host hv-cinder-77398, cleared binding levels {{(pid=102559) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:14:19.755339 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] For port feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8, host hv-cinder-77398, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8,segment=NetworkSegment(fc5ec9ee-df90-46f3-bddf-aef0221d9066),segment_id=fc5ec9ee-df90-46f3-bddf-aef0221d9066)] {{(pid=102559) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:14:19.763619 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:19.801318 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:19.801947 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:19.803780 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] 10.222.0.109 "PUT /v2.0/ports/feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 HTTP/1.1" status: 200 len: 1094 time: 0.7006931 Feb 08 18:14:19.804184 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '276ac338-a990-44da-a077-251beabd094d', 'tag': 'feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:14:19.806692 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fa7992da-66b9-43db-bc65-c7683adf412c" -d '{"events": [{"name": "network-changed", "server_uuid": "276ac338-a990-44da-a077-251beabd094d", "tag": "feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:14:19.836654 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b64de74d-0b1d-457c-82ce-da2cb457a5d0 service neutron] Pushing event updated for resources: {'Port': ['ID=feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8,revision_number=3']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:14:19.874703 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f10451fb-d18d-422f-b49f-b55a92e2a671 req-3e20b553-4716-441f-9e0c-6bcde86681d4 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:19.879436 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f10451fb-d18d-422f-b49f-b55a92e2a671 req-3e20b553-4716-441f-9e0c-6bcde86681d4 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0827339 Feb 08 18:14:19.943545 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f10451fb-d18d-422f-b49f-b55a92e2a671 req-5c3b706a-6116-4191-a724-d09cf64f5077 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0599091 Feb 08 18:14:19.986635 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92d9817b-cdc0-434f-8022-c81372a64d72 req-88ca527b-163b-403e-88ea-738dbda91adb tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:19.988001 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-92d9817b-cdc0-434f-8022-c81372a64d72 req-88ca527b-163b-403e-88ea-738dbda91adb tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 944 time: 0.1107466 Feb 08 18:14:20.006024 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-fc1a5b66-4611-49f4-98f3-fbba7444ac6c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:20.007659 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-fc1a5b66-4611-49f4-98f3-fbba7444ac6c service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=768f50510c57419e8a49ed0988014174&device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 1128 time: 0.1153393 Feb 08 18:14:20.009272 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:14:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-64ac5b2c-a8f5-45a9-a224-e5a7180f0735 x-openstack-request-id: req-64ac5b2c-a8f5-45a9-a224-e5a7180f0735 {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:14:20.009557 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "276ac338-a990-44da-a077-251beabd094d", "tag": "feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:14:20.009802 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-64ac5b2c-a8f5-45a9-a224-e5a7180f0735 {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:14:20.010200 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '276ac338-a990-44da-a077-251beabd094d', 'tag': 'feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8', 'status': 'completed', 'code': 200} Feb 08 18:14:20.077822 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-bc938112-0a9c-4f04-8ac4-c1cc3638254f service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 HTTP/1.1" status: 200 len: 217 time: 0.0402098 Feb 08 18:14:20.097020 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:20.097921 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-92d9817b-cdc0-434f-8022-c81372a64d72 req-9a04a742-d83c-4bb7-9afc-d5dff8a77f10 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1021142 Feb 08 18:14:20.134162 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-e9b675c0-7ff6-4540-aa1e-928120e4510b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:20.135720 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-e9b675c0-7ff6-4540-aa1e-928120e4510b service neutron] 10.222.0.109 "GET /v2.0/subnets?id=7b1e16de-d9af-4f50-86d7-ee22c9e14b1b HTTP/1.1" status: 200 len: 850 time: 0.0501566 Feb 08 18:14:20.200088 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b92b6c8f-200e-4d94-b11f-ea981085ad99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:20.201622 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-b92b6c8f-200e-4d94-b11f-ea981085ad99 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0547419 Feb 08 18:14:20.279807 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:14:20.304678 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-326a5290-5053-4c0c-a8e6-11ccfca46652 service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0952702 Feb 08 18:14:20.325472 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d9448bc7-f78a-43b6-a4a5-7f474dc4b69d req-ea639137-9ef5-46e9-8760-8c0015538d55 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:20.328090 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d9448bc7-f78a-43b6-a4a5-7f474dc4b69d req-ea639137-9ef5-46e9-8760-8c0015538d55 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 944 time: 0.0634928 Feb 08 18:14:20.336811 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:14:20.337358 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:20.383155 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d9448bc7-f78a-43b6-a4a5-7f474dc4b69d req-f4858394-b45c-4977-ba9b-b4a891bde81b tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0492401 Feb 08 18:14:20.415952 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d3deb73a-10ef-4b9c-a536-30ab5d41bf29 req-1978e6a6-a1fa-4d28-b16b-a45c079691c9 service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1006050 Feb 08 18:14:20.418137 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:14:20.418663 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:20.453788 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:14:20.459069 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:20.512854 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8,revision_number=7']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:14:20.513100 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa7992da-66b9-43db-bc65-c7683adf412c req-61a6a513-0b87-4233-83ab-efef82835d71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:20.515022 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-fa7992da-66b9-43db-bc65-c7683adf412c req-61a6a513-0b87-4233-83ab-efef82835d71 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=768f50510c57419e8a49ed0988014174&device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 1128 time: 0.0463450 Feb 08 18:14:20.654929 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa7992da-66b9-43db-bc65-c7683adf412c req-d5599e86-f835-42b1-865f-3c7052ece96d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:20.656394 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-fa7992da-66b9-43db-bc65-c7683adf412c req-d5599e86-f835-42b1-865f-3c7052ece96d service neutron] 10.222.0.109 "GET /v2.0/networks?id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 HTTP/1.1" status: 200 len: 913 time: 0.1340106 Feb 08 18:14:20.704196 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-fa7992da-66b9-43db-bc65-c7683adf412c req-5e6e077c-b6a6-484e-b4a3-6538926fb01d service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 HTTP/1.1" status: 200 len: 217 time: 0.0375533 Feb 08 18:14:20.710952 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acccf242-0404-4f06-9865-ba998b54cc9d req-5b3cad64-a19b-421c-9e60-a9bdd89abf85 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:20.711102 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-567e07d5-773f-44b8-8b11-f00eb2ff7085 req-3fcfa5b5-2d23-4b2b-bd8b-ac69fb0d0ca2 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:20.712493 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-567e07d5-773f-44b8-8b11-f00eb2ff7085 req-3fcfa5b5-2d23-4b2b-bd8b-ac69fb0d0ca2 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.1118939 Feb 08 18:14:20.712622 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-acccf242-0404-4f06-9865-ba998b54cc9d req-5b3cad64-a19b-421c-9e60-a9bdd89abf85 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=505d3a98-d004-47d4-9a5f-f3b39fa267a3 HTTP/1.1" status: 200 len: 946 time: 0.0618558 Feb 08 18:14:20.774798 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa7992da-66b9-43db-bc65-c7683adf412c req-caf338c8-1a6c-42a7-814b-d46cf17934f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:20.776224 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-fa7992da-66b9-43db-bc65-c7683adf412c req-caf338c8-1a6c-42a7-814b-d46cf17934f7 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=7b1e16de-d9af-4f50-86d7-ee22c9e14b1b HTTP/1.1" status: 200 len: 850 time: 0.0628073 Feb 08 18:14:20.781013 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:14:20.783363 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bcd9e0aa-fc34-4bf1-9d52-ba65c3983fc1" -d '{"events": [{"server_uuid": "75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5", "name": "network-vif-plugged", "status": "completed", "tag": "2f2d1cfd-91ec-450a-bfe2-52d21f9196e8"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:14:20.786004 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-acccf242-0404-4f06-9865-ba998b54cc9d req-a210b117-553f-4f91-bcac-82f302ecda07 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0588069 Feb 08 18:14:20.841265 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-567e07d5-773f-44b8-8b11-f00eb2ff7085 req-40cab68f-48dd-4087-b8f8-5299f4c6d18c tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0971599 Feb 08 18:14:20.849518 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:14:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7429f109-4686-4e56-9a7e-ee5ca4f0efe5 x-openstack-request-id: req-7429f109-4686-4e56-9a7e-ee5ca4f0efe5 {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:14:20.849887 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5", "name": "network-vif-plugged", "status": "completed", "tag": "2f2d1cfd-91ec-450a-bfe2-52d21f9196e8", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:14:20.850184 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-7429f109-4686-4e56-9a7e-ee5ca4f0efe5 {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:14:20.850858 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8', 'code': 200} Feb 08 18:14:20.862565 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa7992da-66b9-43db-bc65-c7683adf412c req-1af42c0c-e62e-4057-9827-39228700c237 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:20.864688 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-fa7992da-66b9-43db-bc65-c7683adf412c req-1af42c0c-e62e-4057-9827-39228700c237 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0696888 Feb 08 18:14:20.967975 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-fa7992da-66b9-43db-bc65-c7683adf412c req-3abafc93-553f-45a4-80d6-f72207cc5b47 service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0887351 Feb 08 18:14:21.277600 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-001f6ef8-7b67-4292-85cd-5a94cecfa979 req-7fd308b5-c8e3-48db-a0ae-afcb942ec056 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:21.280396 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-001f6ef8-7b67-4292-85cd-5a94cecfa979 req-7fd308b5-c8e3-48db-a0ae-afcb942ec056 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0875373 Feb 08 18:14:21.326084 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-fa7992da-66b9-43db-bc65-c7683adf412c req-470f80a9-1c36-4bbb-86c0-e145169c04c2 service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3305609 Feb 08 18:14:21.348067 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-001f6ef8-7b67-4292-85cd-5a94cecfa979 req-f0531187-7e40-49ec-937f-6dc7d93e0cbb tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0610824 Feb 08 18:14:21.570743 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-649eb36b-041a-40e8-83db-bc9b828f5e09 req-60aa9ebf-292d-44f3-af0f-dad3968683d8 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:21.572449 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-649eb36b-041a-40e8-83db-bc9b828f5e09 req-60aa9ebf-292d-44f3-af0f-dad3968683d8 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 944 time: 0.0792739 Feb 08 18:14:21.625073 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-649eb36b-041a-40e8-83db-bc9b828f5e09 req-2ae71072-c927-4211-b845-983151daffbc tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463648 Feb 08 18:14:21.668475 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:21.907249 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e9f8b47-6516-439f-80f5-268abc3b2e28 req-6c061063-b966-4a5f-ae3b-17b741c10d69 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:21.914822 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5e9f8b47-6516-439f-80f5-268abc3b2e28 req-6c061063-b966-4a5f-ae3b-17b741c10d69 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=505d3a98-d004-47d4-9a5f-f3b39fa267a3 HTTP/1.1" status: 200 len: 946 time: 0.0637023 Feb 08 18:14:21.985510 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5e9f8b47-6516-439f-80f5-268abc3b2e28 req-c0ffa168-6dff-4277-a301-8df98d0be01e tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0647988 Feb 08 18:14:22.063828 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea84ac85-3b92-44a8-9ce0-66ed449bc7da req-9569225f-1f40-4d0c-b875-f53d6b5bc3c7 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:22.065347 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ea84ac85-3b92-44a8-9ce0-66ed449bc7da req-9569225f-1f40-4d0c-b875-f53d6b5bc3c7 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.1323602 Feb 08 18:14:22.120667 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ea84ac85-3b92-44a8-9ce0-66ed449bc7da req-d91763fb-abe7-4f0d-a1cd-324415cb8f9b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0466895 Feb 08 18:14:22.492737 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69b0200b-a94f-4a1c-ba12-a32cce1d2b3d req-01a5b00d-44df-4d1c-aab6-7d9a75918922 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:22.495469 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-69b0200b-a94f-4a1c-ba12-a32cce1d2b3d req-01a5b00d-44df-4d1c-aab6-7d9a75918922 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0585055 Feb 08 18:14:22.559047 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-69b0200b-a94f-4a1c-ba12-a32cce1d2b3d req-71be2378-c7e2-40dd-bfd0-33fd1d3b922e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0557494 Feb 08 18:14:22.767760 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f899627-c249-4e4f-8fc3-6ad6bd2e34f0 req-2bc205b7-2581-4b0e-bde4-38002a24d374 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:22.770120 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1f899627-c249-4e4f-8fc3-6ad6bd2e34f0 req-2bc205b7-2581-4b0e-bde4-38002a24d374 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 944 time: 0.0665152 Feb 08 18:14:22.820792 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1f899627-c249-4e4f-8fc3-6ad6bd2e34f0 req-c0060896-3876-4ac7-bff9-67fe97458aed tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457907 Feb 08 18:14:23.250158 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38ddcd57-8614-4e58-846f-63a2f2239e0a req-7e107385-9979-4c52-b7a6-250ed82cedea tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:23.251785 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-38ddcd57-8614-4e58-846f-63a2f2239e0a req-7e107385-9979-4c52-b7a6-250ed82cedea tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0580273 Feb 08 18:14:23.304227 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-38ddcd57-8614-4e58-846f-63a2f2239e0a req-f4f2d96e-004d-4c6c-ab49-ea68a03958d4 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460925 Feb 08 18:14:23.750804 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-176a591e-0a26-472c-8e23-ebceb3002491 req-da156df6-f5fe-4238-b0fa-79285a081abb tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:23.764112 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-176a591e-0a26-472c-8e23-ebceb3002491 req-da156df6-f5fe-4238-b0fa-79285a081abb tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.1174293 Feb 08 18:14:23.818659 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-176a591e-0a26-472c-8e23-ebceb3002491 req-38ac9ca7-1ad1-4bf4-b2a7-0cec25c2a83a tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0487559 Feb 08 18:14:23.956665 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d1435bc-5eef-4549-8b39-cd3ce0cc2343 req-d586abce-20dd-4a8d-8245-412957100be9 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:23.958161 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3d1435bc-5eef-4549-8b39-cd3ce0cc2343 req-d586abce-20dd-4a8d-8245-412957100be9 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 944 time: 0.0576794 Feb 08 18:14:24.023253 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3d1435bc-5eef-4549-8b39-cd3ce0cc2343 req-5e8880ca-3fa2-472d-8772-5fd1ff25c999 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0571415 Feb 08 18:14:24.478546 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bbed01b-5da3-45fc-8624-063d2516b29f req-3594f1e0-eeb0-4492-b606-2a0133af4319 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:24.480323 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5bbed01b-5da3-45fc-8624-063d2516b29f req-3594f1e0-eeb0-4492-b606-2a0133af4319 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0716751 Feb 08 18:14:24.534406 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5bbed01b-5da3-45fc-8624-063d2516b29f req-5d238965-5dd0-47ef-b039-30e4f975f618 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465782 Feb 08 18:14:24.956799 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17973ec9-451b-46e7-b42a-1fbe1eafdcf6 req-f5ac1b6b-136e-4053-ab2a-55deb7580b9c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:24.958296 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-17973ec9-451b-46e7-b42a-1fbe1eafdcf6 req-f5ac1b6b-136e-4053-ab2a-55deb7580b9c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0590143 Feb 08 18:14:25.012684 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-17973ec9-451b-46e7-b42a-1fbe1eafdcf6 req-fd282eb9-681a-4ef5-8bda-6eca1a7411da tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435064 Feb 08 18:14:25.162505 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99a2193b-ece5-43b7-ae12-4e432a4d89b3 req-f4836934-f857-4fae-8848-e891445666e7 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:25.164150 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-99a2193b-ece5-43b7-ae12-4e432a4d89b3 req-f4836934-f857-4fae-8848-e891445666e7 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 944 time: 0.0550745 Feb 08 18:14:25.219588 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-99a2193b-ece5-43b7-ae12-4e432a4d89b3 req-b9770e7d-35b2-4593-9210-febb53e4ce94 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0478275 Feb 08 18:14:25.657740 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24be42d7-9064-4295-aa48-fb2812b44887 req-312c9b08-3a79-43d2-a6db-1f32ccb22361 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:25.659569 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-24be42d7-9064-4295-aa48-fb2812b44887 req-312c9b08-3a79-43d2-a6db-1f32ccb22361 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0535204 Feb 08 18:14:25.712124 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-24be42d7-9064-4295-aa48-fb2812b44887 req-ac450ebd-2c47-4e6b-97ed-822c0b4df677 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469680 Feb 08 18:14:26.141938 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c43dfd66-acd4-41f8-9e48-7c2bb4d82f88 req-f5dc6d81-734f-4c7c-9c93-ddc8f40359d1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:26.143370 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c43dfd66-acd4-41f8-9e48-7c2bb4d82f88 req-f5dc6d81-734f-4c7c-9c93-ddc8f40359d1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0541129 Feb 08 18:14:26.198236 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c43dfd66-acd4-41f8-9e48-7c2bb4d82f88 req-e7752bbe-2ccf-4d30-812f-4e85b46ed018 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447412 Feb 08 18:14:26.347656 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53648152-06c6-440b-986c-ef931665f549 req-2526dea0-0725-468c-b4c9-f505055f7c75 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:26.349176 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-53648152-06c6-440b-986c-ef931665f549 req-2526dea0-0725-468c-b4c9-f505055f7c75 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 944 time: 0.0606384 Feb 08 18:14:26.401718 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-53648152-06c6-440b-986c-ef931665f549 req-3bfc41d3-1d94-4141-b9b6-f0d10f8ae048 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465701 Feb 08 18:14:26.845253 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5affca6-ed41-4587-8c94-0bf933bbf2d5 req-7589d84d-fdf5-4332-93e8-b336e796d26a tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:26.846939 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a5affca6-ed41-4587-8c94-0bf933bbf2d5 req-7589d84d-fdf5-4332-93e8-b336e796d26a tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0619733 Feb 08 18:14:26.907160 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a5affca6-ed41-4587-8c94-0bf933bbf2d5 req-5b537f93-29a5-4e9f-b8de-c8e68d1a213f tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0539598 Feb 08 18:14:27.333216 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b25d757-7695-43ee-91eb-2bf97010be30 req-640a1cce-14fc-4b30-b4e9-c290f3997ead tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:27.334805 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1b25d757-7695-43ee-91eb-2bf97010be30 req-640a1cce-14fc-4b30-b4e9-c290f3997ead tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0576203 Feb 08 18:14:27.386643 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1b25d757-7695-43ee-91eb-2bf97010be30 req-83747259-8f89-407a-9625-027e0011ee0b tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452249 Feb 08 18:14:27.531054 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c42ec418-b1ef-4aa3-a3d1-36111e49a70d req-f31d058c-1833-4dee-97c7-8faa349bd62f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:27.532869 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c42ec418-b1ef-4aa3-a3d1-36111e49a70d req-f31d058c-1833-4dee-97c7-8faa349bd62f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 944 time: 0.0579796 Feb 08 18:14:27.591389 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c42ec418-b1ef-4aa3-a3d1-36111e49a70d req-6204e688-315d-4441-a85e-d6b1a4653851 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0513220 Feb 08 18:14:28.054913 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fa38ffb-8911-4428-b145-5f0f9bb4e603 req-6e035afe-2719-4ae0-9607-ea897ccd4035 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:28.059761 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6fa38ffb-8911-4428-b145-5f0f9bb4e603 req-6e035afe-2719-4ae0-9607-ea897ccd4035 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0693142 Feb 08 18:14:28.117266 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6fa38ffb-8911-4428-b145-5f0f9bb4e603 req-eb725362-01ec-46aa-93d8-d13eff0eb62c tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0526247 Feb 08 18:14:28.517728 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80f3bd49-892a-4df2-bc9c-8f81c84b44d7 req-f2363aca-f9be-4a26-9d65-308bf981f82c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:28.519451 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-80f3bd49-892a-4df2-bc9c-8f81c84b44d7 req-f2363aca-f9be-4a26-9d65-308bf981f82c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0576229 Feb 08 18:14:28.579352 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-80f3bd49-892a-4df2-bc9c-8f81c84b44d7 req-456f2d57-5b52-4d8a-b770-1f75298ec4b1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451851 Feb 08 18:14:28.715092 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11295f51-d365-4815-9d3d-85a27d8e1330 req-5b49ab25-9497-48fc-b696-32ac42fe64b6 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:28.716487 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-11295f51-d365-4815-9d3d-85a27d8e1330 req-5b49ab25-9497-48fc-b696-32ac42fe64b6 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 944 time: 0.0549932 Feb 08 18:14:28.779378 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-11295f51-d365-4815-9d3d-85a27d8e1330 req-68a56f83-497e-446c-b121-ef265c76af4d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0569639 Feb 08 18:14:29.252196 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6b4a6f0-d99b-4f33-8f22-612055bfbda4 req-c1e0a975-6c89-40d8-a6a2-20ecc3bdebdc tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:29.253685 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a6b4a6f0-d99b-4f33-8f22-612055bfbda4 req-c1e0a975-6c89-40d8-a6a2-20ecc3bdebdc tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0623002 Feb 08 18:14:29.301411 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a6b4a6f0-d99b-4f33-8f22-612055bfbda4 req-df26c899-a6b8-4c3d-9a69-1acd821ede8b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420058 Feb 08 18:14:29.707439 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d0edc4c-a504-490f-a8f2-cba433e78fce req-4212db2d-9479-4729-8d5a-d9b195e0afde tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:29.708932 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0d0edc4c-a504-490f-a8f2-cba433e78fce req-4212db2d-9479-4729-8d5a-d9b195e0afde tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0580931 Feb 08 18:14:29.756338 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0d0edc4c-a504-490f-a8f2-cba433e78fce req-bb170fd7-ef62-48e5-8c80-e72fe220dbe3 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416942 Feb 08 18:14:29.919215 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a3cbcb8-70d1-4c6b-925c-ef740cb9fabe req-ecfd4d59-50cf-4960-83cd-712c6fa45a40 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:29.920646 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4a3cbcb8-70d1-4c6b-925c-ef740cb9fabe req-ecfd4d59-50cf-4960-83cd-712c6fa45a40 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 944 time: 0.0674050 Feb 08 18:14:29.969853 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4a3cbcb8-70d1-4c6b-925c-ef740cb9fabe req-fead473f-86af-4edc-b86c-32cbeb4fb76d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436113 Feb 08 18:14:30.301925 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f4f9dbe-9919-46e6-b755-c4e698310ef6 req-8a2f14bf-5b00-4ae3-9f23-bd7728609c4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:30.303801 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1f4f9dbe-9919-46e6-b755-c4e698310ef6 req-8a2f14bf-5b00-4ae3-9f23-bd7728609c4e service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=357dab3d3db74ef9a8ee50fdd8a8bdcd&device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 1129 time: 0.0579677 Feb 08 18:14:30.332745 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:14:30.424494 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f4f9dbe-9919-46e6-b755-c4e698310ef6 req-a734ee80-e57e-4ca2-b697-68914cd8d01c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:30.426078 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1f4f9dbe-9919-46e6-b755-c4e698310ef6 req-a734ee80-e57e-4ca2-b697-68914cd8d01c service neutron] 10.222.0.109 "GET /v2.0/networks?id=7a854399-3ce6-42bd-bfc4-061132ecb9c2 HTTP/1.1" status: 200 len: 918 time: 0.1152673 Feb 08 18:14:30.434520 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8,segment=NetworkSegment(fc5ec9ee-df90-46f3-bddf-aef0221d9066),segment_id=fc5ec9ee-df90-46f3-bddf-aef0221d9066)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:14:30.446024 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': 'feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'port_id': 'feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8', 'mac_address': 'fa:16:3e:66:34:40', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1066, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:14:30.483455 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:14:30.483838 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:30.497130 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:14:30.501086 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b191991-4379-4e47-ad8e-c4ea52da18fe req-2c1805ce-5538-4b6d-a92e-50fc4a8465a3 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:30.502577 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5b191991-4379-4e47-ad8e-c4ea52da18fe req-2c1805ce-5538-4b6d-a92e-50fc4a8465a3 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.1226463 Feb 08 18:14:30.516818 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8,segment=NetworkSegment(fc5ec9ee-df90-46f3-bddf-aef0221d9066),segment_id=fc5ec9ee-df90-46f3-bddf-aef0221d9066)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:14:30.522072 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:30.546043 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1f4f9dbe-9919-46e6-b755-c4e698310ef6 req-fbe9c234-3f7b-4c43-b784-7393c9e81f20 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 HTTP/1.1" status: 200 len: 1001 time: 0.1132588 Feb 08 18:14:30.573474 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:14:30.581168 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:30.581533 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:30.581981 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:30.582313 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:30.582892 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:30.583220 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:30.583541 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:30.583862 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:30.584179 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:30.584495 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:30.584807 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:30.585121 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:30.585410 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:14:30.608293 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5b191991-4379-4e47-ad8e-c4ea52da18fe req-e85c8731-0a6f-40c4-aebd-2e344395315a tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0964208 Feb 08 18:14:30.618065 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f4f9dbe-9919-46e6-b755-c4e698310ef6 req-f2e9f8dd-b76e-4da2-aea1-a138bf3f0d13 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:30.619693 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1f4f9dbe-9919-46e6-b755-c4e698310ef6 req-f2e9f8dd-b76e-4da2-aea1-a138bf3f0d13 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=73de7865-d87d-4a2a-a702-160c400f145f HTTP/1.1" status: 200 len: 855 time: 0.0602548 Feb 08 18:14:30.675763 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f4f9dbe-9919-46e6-b755-c4e698310ef6 req-f1169fae-40ae-4250-b125-158898b1d6da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:30.678315 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1f4f9dbe-9919-46e6-b755-c4e698310ef6 req-f1169fae-40ae-4250-b125-158898b1d6da service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=7a854399-3ce6-42bd-bfc4-061132ecb9c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0458593 Feb 08 18:14:30.782845 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1f4f9dbe-9919-46e6-b755-c4e698310ef6 req-d55aa6fd-d5ef-4046-be47-35aa7af9abe5 service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0880275 Feb 08 18:14:30.873711 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1f4f9dbe-9919-46e6-b755-c4e698310ef6 req-4f6ad683-d9fa-4149-a4d7-782056a2a448 service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0839345 Feb 08 18:14:30.876501 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:14:30.886962 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2732df83-708b-4f61-b5f2-b1b305304218 req-6fa83d8d-c3fb-4c9b-8d65-34350819236f tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:30.888759 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-2732df83-708b-4f61-b5f2-b1b305304218 req-6fa83d8d-c3fb-4c9b-8d65-34350819236f tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0539765 Feb 08 18:14:30.937414 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-2732df83-708b-4f61-b5f2-b1b305304218 req-75d21bd2-be2f-4b13-9984-eb7f9cca186f tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428107 Feb 08 18:14:30.979717 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:14:31.098333 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7fe2ce1-e56e-43cb-921d-5b748e57d9cc req-188c2564-86ba-4c4e-9f05-910dd117b118 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:31.099879 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f7fe2ce1-e56e-43cb-921d-5b748e57d9cc req-188c2564-86ba-4c4e-9f05-910dd117b118 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 945 time: 0.0530465 Feb 08 18:14:31.147860 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f7fe2ce1-e56e-43cb-921d-5b748e57d9cc req-6e4c9360-c13a-408f-9674-544cb3645b88 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420470 Feb 08 18:14:31.733009 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16868df3-663a-45d8-8111-ae50d45215a0 req-941dc7b7-21ba-4b3f-94a3-2665f117d603 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:31.734492 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-16868df3-663a-45d8-8111-ae50d45215a0 req-941dc7b7-21ba-4b3f-94a3-2665f117d603 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0580852 Feb 08 18:14:31.781428 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-16868df3-663a-45d8-8111-ae50d45215a0 req-e97a1a2e-8e18-4cdf-851c-233d1f727119 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413713 Feb 08 18:14:32.066650 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77a5a26c-e5c6-4c37-9de6-71dcb0dffeba req-11308181-d3a5-4285-a744-2cd091990fd9 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:32.068138 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-77a5a26c-e5c6-4c37-9de6-71dcb0dffeba req-11308181-d3a5-4285-a744-2cd091990fd9 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 945 time: 0.0525506 Feb 08 18:14:32.118439 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-77a5a26c-e5c6-4c37-9de6-71dcb0dffeba req-10150c44-91a7-4f7c-8d04-fd80ca90182d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443451 Feb 08 18:14:32.267970 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e88cda8b-c791-4c2d-a2a4-4252e370a73f req-241ae912-0bb1-4cfc-8b55-98398b4408b6 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:32.269345 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e88cda8b-c791-4c2d-a2a4-4252e370a73f req-241ae912-0bb1-4cfc-8b55-98398b4408b6 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 945 time: 0.0548737 Feb 08 18:14:32.320945 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e88cda8b-c791-4c2d-a2a4-4252e370a73f req-890c89cf-de5d-4477-adff-40609391af91 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443707 Feb 08 18:14:32.341441 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:14:32.395200 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning for port feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 completed by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Feb 08 18:14:32.399195 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:14:32.399574 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:32.479061 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:14:32.479666 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:32.504882 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '276ac338-a990-44da-a077-251beabd094d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:14:32.507132 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b3268ff3-6704-4a5c-9bfd-c036cc2c3e76" -d '{"events": [{"server_uuid": "276ac338-a990-44da-a077-251beabd094d", "name": "network-vif-plugged", "status": "completed", "tag": "feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:14:32.519449 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8,segment=NetworkSegment(fc5ec9ee-df90-46f3-bddf-aef0221d9066),segment_id=fc5ec9ee-df90-46f3-bddf-aef0221d9066)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:14:32.524406 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:32.525222 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:14:32.567041 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:14:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4222b6df-5c16-4956-b949-f3546d47c871 x-openstack-request-id: req-4222b6df-5c16-4956-b949-f3546d47c871 {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:14:32.567330 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "276ac338-a990-44da-a077-251beabd094d", "name": "network-vif-plugged", "status": "completed", "tag": "feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:14:32.567582 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-4222b6df-5c16-4956-b949-f3546d47c871 {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:14:32.567965 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '276ac338-a990-44da-a077-251beabd094d', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8', 'code': 200} Feb 08 18:14:32.604054 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:14:32.644992 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 is: ACTIVE; New status is: DOWN {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:14:32.645390 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:32.686479 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:14:32.692654 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:32.759064 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8,revision_number=8']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:14:32.851153 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c67ab767-7e92-40f5-8f03-0a2a69189b9f req-4ebbd23f-4cba-47c5-8134-c3906efa87fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:32.852743 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c67ab767-7e92-40f5-8f03-0a2a69189b9f req-4ebbd23f-4cba-47c5-8134-c3906efa87fa service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 1130 time: 0.0492592 Feb 08 18:14:32.930749 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c67ab767-7e92-40f5-8f03-0a2a69189b9f req-b8542e04-554b-4673-9e0f-55d492c8b6ff service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0713129 Feb 08 18:14:32.940985 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-432bf7b4-5ea2-4f27-b34d-000e70bc1f1b req-cceec80f-f6a4-4ed8-95a8-cc2c8e6b524d tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:32.942998 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-432bf7b4-5ea2-4f27-b34d-000e70bc1f1b req-cceec80f-f6a4-4ed8-95a8-cc2c8e6b524d tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0847993 Feb 08 18:14:32.951111 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-0091de37-90d6-43ea-99e4-99410f05b982 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:32.952605 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-0091de37-90d6-43ea-99e4-99410f05b982 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/networks?id=622fcad3-2fd8-49df-8f66-feb243e2b24d HTTP/1.1" status: 200 len: 815 time: 0.1017888 Feb 08 18:14:32.967845 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-28f14499-1e0c-4fac-8c99-ff20b2a6a6a2 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/quotas/602d106ac7104b10bebcfc0421ea5edc HTTP/1.1" status: 200 len: 375 time: 0.0096176 Feb 08 18:14:32.991319 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-432bf7b4-5ea2-4f27-b34d-000e70bc1f1b req-1a0f079f-32c7-430e-8b32-1e2a65c5c24f tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425532 Feb 08 18:14:33.026900 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-544555e1-12f8-48ef-8565-32b9e5d3d19b tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?tenant_id=602d106ac7104b10bebcfc0421ea5edc&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0537195 Feb 08 18:14:33.118091 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-c0481a68-1007-4c77-b261-0fb84365deb8 service neutron] 10.222.0.118 "GET /v2.0/networks/622fcad3-2fd8-49df-8f66-feb243e2b24d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0845292 Feb 08 18:14:33.207578 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-24209654-ee05-494b-b347-88583279e634 service neutron] 10.222.0.118 "GET /v2.0/networks/622fcad3-2fd8-49df-8f66-feb243e2b24d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0836120 Feb 08 18:14:33.247596 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a5be21b-0e50-4321-af23-66ef9c249716 req-dd6dc89c-0733-4c2e-ac43-dc7ec6fd57c9 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:33.249423 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1a5be21b-0e50-4321-af23-66ef9c249716 req-dd6dc89c-0733-4c2e-ac43-dc7ec6fd57c9 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.0566356 Feb 08 18:14:33.305640 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1a5be21b-0e50-4321-af23-66ef9c249716 req-8a2cc3ce-7e56-4f95-a13c-3f6f0cad88fc tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0504975 Feb 08 18:14:33.393842 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-fb71dbb9-0ddf-4326-bfd2-b8c4f71eabf6 req-5ddece0e-858b-486e-ac37-d32c2a85768a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 210 time: 0.0485148 Feb 08 18:14:33.449767 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5b8d142-9430-43d2-9254-f991a4f3887e req-764d5e91-7bd2-456f-957e-72100730d96d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:33.451300 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b5b8d142-9430-43d2-9254-f991a4f3887e req-764d5e91-7bd2-456f-957e-72100730d96d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 946 time: 0.0538037 Feb 08 18:14:33.502330 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b5b8d142-9430-43d2-9254-f991a4f3887e req-b9107f74-6a86-47d1-aace-617c0b1d6bf5 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452547 Feb 08 18:14:34.117379 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89bf5a0f-da6d-43ae-950c-26eb8419e6f4 req-f21d9ed7-0915-404e-881f-9c12a77214d6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:34.118749 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-89bf5a0f-da6d-43ae-950c-26eb8419e6f4 req-f21d9ed7-0915-404e-881f-9c12a77214d6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0550089 Feb 08 18:14:34.166449 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-89bf5a0f-da6d-43ae-950c-26eb8419e6f4 req-2851ff85-3311-4a8f-97dd-39defff437b7 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419054 Feb 08 18:14:34.476455 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86e20cee-e1d1-408f-98d2-2cd16e5ddfa7 req-b7d4ffe0-2335-4cd2-a9d8-c6ca00a1941a tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:34.478110 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-86e20cee-e1d1-408f-98d2-2cd16e5ddfa7 req-b7d4ffe0-2335-4cd2-a9d8-c6ca00a1941a tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.0586560 Feb 08 18:14:34.507988 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1c92cbb3-55d7-4239-80b4-f4c16a3b4042 req-0c883acc-c5b8-472e-9b81-eded2fd3b036 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 210 time: 0.0302198 Feb 08 18:14:34.569343 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:14:34.571665 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-88ff6a92-81fc-4588-8d92-59cd2fe2aa42" -d '{"events": [{"server_uuid": "75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5", "name": "network-vif-unplugged", "status": "completed", "tag": "2f2d1cfd-91ec-450a-bfe2-52d21f9196e8"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:14:34.591982 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-86e20cee-e1d1-408f-98d2-2cd16e5ddfa7 req-a11f050c-4071-4cf7-896d-e5d7b25ba890 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1073909 Feb 08 18:14:34.626633 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb7ccda8-07b5-4f9c-aeb6-204cbae24049 req-49ac89fb-d01b-4017-94fd-4a2724379e14 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:34.634379 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-eb7ccda8-07b5-4f9c-aeb6-204cbae24049 req-49ac89fb-d01b-4017-94fd-4a2724379e14 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 946 time: 0.0617137 Feb 08 18:14:34.654287 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-568ca6b9-0a09-42f9-829d-1e3af95ce0c2 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:34.655779 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-568ca6b9-0a09-42f9-829d-1e3af95ce0c2 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.109 "GET /v2.0/networks?id=622fcad3-2fd8-49df-8f66-feb243e2b24d HTTP/1.1" status: 200 len: 815 time: 0.1630433 Feb 08 18:14:34.660123 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 08 Feb 2022 18:14:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2b41637c-c822-4250-ad80-4ebba5acea24 x-openstack-request-id: req-2b41637c-c822-4250-ad80-4ebba5acea24 {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:14:34.660430 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5", "name": "network-vif-unplugged", "status": "failed", "tag": "2f2d1cfd-91ec-450a-bfe2-52d21f9196e8", "code": 422}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:14:34.660688 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-2b41637c-c822-4250-ad80-4ebba5acea24 {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:14:34.661678 dv-cinder-773985-21-iscsi neutron-server[102561]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8', 'code': 422} returned with failed status Feb 08 18:14:34.671659 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-087874d6-a63d-4343-b606-828a98a0231a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Request body: {'port': {'device_id': '963f7229-2841-485f-98f9-64722824a6df', 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d', 'admin_state_up': True, 'tenant_id': '602d106ac7104b10bebcfc0421ea5edc'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:14:34.694450 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-eb7ccda8-07b5-4f9c-aeb6-204cbae24049 req-0e741763-5cc4-4f18-bf64-087a3372c973 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0589938 Feb 08 18:14:34.793524 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-087874d6-a63d-4343-b606-828a98a0231a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Made reservation on behalf of 602d106ac7104b10bebcfc0421ea5edc for: {'port': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:14:34.797148 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-087874d6-a63d-4343-b606-828a98a0231a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:34.821068 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34cf7e44-3de8-4cdc-9de4-898886a36f90 req-27f97a90-69f5-42fa-a87f-097c25675ccd tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:34.822661 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-34cf7e44-3de8-4cdc-9de4-898886a36f90 req-27f97a90-69f5-42fa-a87f-097c25675ccd tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 946 time: 0.0585659 Feb 08 18:14:34.879506 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-34cf7e44-3de8-4cdc-9de4-898886a36f90 req-925b9fbe-1088-4ca8-aec9-a70d8e384c78 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0498910 Feb 08 18:14:34.897226 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 39310) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:14:34.936867 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-087874d6-a63d-4343-b606-828a98a0231a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Allocated IP 172.20.0.5 (622fcad3-2fd8-49df-8f66-feb243e2b24d/080b9f96-e4e1-410a-a6ed-01cf523843d5/ea47f272-34ce-4df1-b42c-009ad5f91a31) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:14:35.094117 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-087874d6-a63d-4343-b606-828a98a0231a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks [] for port (ea47f272-34ce-4df1-b42c-009ad5f91a31), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:35.121539 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8dd431ee-d03f-495d-a3c5-f7cbc315bc6c tempest-TestVolumeBootPattern-667580451 tempest-TestVolumeBootPattern-667580451-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:35.123125 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-8dd431ee-d03f-495d-a3c5-f7cbc315bc6c tempest-TestVolumeBootPattern-667580451 tempest-TestVolumeBootPattern-667580451-project-admin] 10.222.0.118 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 1125 time: 0.2248461 Feb 08 18:14:35.126164 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 39320) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:14:35.131287 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-c0d25e7f-8871-44ba-8135-63b1c98e6e7f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Request body: {'floatingip': {'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'port_id': 'feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'fixed_ip_address': '172.20.0.12'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:14:35.135584 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-087874d6-a63d-4343-b606-828a98a0231a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (ea47f272-34ce-4df1-b42c-009ad5f91a31), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:35.143416 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [req-d7b68241-65d7-497d-abf5-6dc6d2f2f2c6 req-e6709082-0e4a-481f-b188-866f108b3f1a service neutron] http://10.222.0.118:9696/v2.0/extensions returned with HTTP 200 {{(pid=102560) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 08 18:14:35.144379 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d7b68241-65d7-497d-abf5-6dc6d2f2f2c6 req-e6709082-0e4a-481f-b188-866f108b3f1a service neutron] 10.222.0.118 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0083423 Feb 08 18:14:35.155049 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['5676d44a-8ef0-472a-9703-1a68bebb5ad4', '58368d01-b8e8-4efd-b4a1-c88b7cdc4771', '0e17ac77-e9a3-4c18-9145-3f139aa468e9'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:14:35.168426 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c0d25e7f-8871-44ba-8135-63b1c98e6e7f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for floatingip (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:35.175195 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-087874d6-a63d-4343-b606-828a98a0231a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Network 622fcad3-2fd8-49df-8f66-feb243e2b24d is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:14:35.178790 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-087874d6-a63d-4343-b606-828a98a0231a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:14:35.184728 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-087874d6-a63d-4343-b606-828a98a0231a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:14:35.190036 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-087874d6-a63d-4343-b606-828a98a0231a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:35.190691 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-087874d6-a63d-4343-b606-828a98a0231a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:35.206423 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-087874d6-a63d-4343-b606-828a98a0231a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Pushing event updated for resources: {'Port': ['ID=ea47f272-34ce-4df1-b42c-009ad5f91a31,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:14:35.221822 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-087874d6-a63d-4343-b606-828a98a0231a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.109 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5560887 Feb 08 18:14:35.242405 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] Request body: {'port': {'device_id': '963f7229-2841-485f-98f9-64722824a6df', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77398'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:14:35.319710 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c0d25e7f-8871-44ba-8135-63b1c98e6e7f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:35.350159 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (ea47f272-34ce-4df1-b42c-009ad5f91a31), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:35.425679 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72eb1a53-1b4b-458c-a50e-337cb014b23c req-9e8e2a89-c1da-48d2-83fc-fe3f6ad0c71a tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:35.433231 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-72eb1a53-1b4b-458c-a50e-337cb014b23c req-9e8e2a89-c1da-48d2-83fc-fe3f6ad0c71a tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.1877422 Feb 08 18:14:35.438829 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb37a09a-33c5-471f-a264-c4ed3b21a14d req-9121ab57-2838-47e4-8a4d-1a24c7e3c8db tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:35.446952 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-bb37a09a-33c5-471f-a264-c4ed3b21a14d req-9121ab57-2838-47e4-8a4d-1a24c7e3c8db tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.1246150 Feb 08 18:14:35.565660 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-72eb1a53-1b4b-458c-a50e-337cb014b23c req-a5579446-b9fc-4d38-b938-67135b88a1a4 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1314681 Feb 08 18:14:35.570888 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-bb37a09a-33c5-471f-a264-c4ed3b21a14d req-6daa15fd-350c-4be5-b3ef-b7ab915b64d9 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1016304 Feb 08 18:14:35.576474 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_common [None req-c0d25e7f-8871-44ba-8135-63b1c98e6e7f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Allocated IP 172.27.1.5 (77055816-7c88-403d-8f8a-9be2c1faa10d/18547c52-7b23-42cd-bb53-214663ed102b/f67d5f70-99da-48d9-9034-aeeb1285d87d) {{(pid=102560) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:14:35.710551 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c0d25e7f-8871-44ba-8135-63b1c98e6e7f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for port (f67d5f70-99da-48d9-9034-aeeb1285d87d), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:35.722544 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 39346) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:14:35.735792 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-223b17e1-f33f-40be-b5ab-367dfb4f679a req-47598076-9f5e-4a94-ace2-3a6b04913454 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:35.737401 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-223b17e1-f33f-40be-b5ab-367dfb4f679a req-47598076-9f5e-4a94-ace2-3a6b04913454 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 931 time: 0.0933447 Feb 08 18:14:35.751835 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c0d25e7f-8871-44ba-8135-63b1c98e6e7f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (f67d5f70-99da-48d9-9034-aeeb1285d87d), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:35.782147 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ea47f272-34ce-4df1-b42c-009ad5f91a31 {{(pid=102559) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:14:35.793008 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] Publish callbacks [] for port (ea47f272-34ce-4df1-b42c-009ad5f91a31), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:35.809389 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0d25e7f-8871-44ba-8135-63b1c98e6e7f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Network 77055816-7c88-403d-8f8a-9be2c1faa10d is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:14:35.814020 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-c0d25e7f-8871-44ba-8135-63b1c98e6e7f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:14:35.820475 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c0d25e7f-8871-44ba-8135-63b1c98e6e7f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Received port after_create {{(pid=102560) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:14:35.820994 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.provisioning_blocks [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] Transition to ACTIVE for port object ea47f272-34ce-4df1-b42c-009ad5f91a31 will not be triggered until provisioned by entity L2. {{(pid=102559) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Feb 08 18:14:35.825145 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-223b17e1-f33f-40be-b5ab-367dfb4f679a req-5c0bf700-3465-4230-9683-5cfe038e3d8f tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0694087 Feb 08 18:14:35.826208 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (ea47f272-34ce-4df1-b42c-009ad5f91a31), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:35.858241 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0d25e7f-8871-44ba-8135-63b1c98e6e7f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Pushing event updated for resources: {'Port': ['ID=f67d5f70-99da-48d9-9034-aeeb1285d87d,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:14:35.876408 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-17894955-f99b-45d0-a197-89a328af7ab4 req-6b301ed6-3914-4a39-b09c-0e8e3fb1fca9 service neutron] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1527286 Feb 08 18:14:35.877948 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] Pushing event updated for resources: {'Port': ['ID=ea47f272-34ce-4df1-b42c-009ad5f91a31,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:14:35.903854 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [req-17894955-f99b-45d0-a197-89a328af7ab4 req-4f7ca03c-e6ff-4cdf-a15e-21e99b45fa86 service neutron] http://10.222.0.118:9696/v2.0/extensions returned with HTTP 200 {{(pid=102560) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 08 18:14:35.904823 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-17894955-f99b-45d0-a197-89a328af7ab4 req-4f7ca03c-e6ff-4cdf-a15e-21e99b45fa86 service neutron] 10.222.0.118 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0069096 Feb 08 18:14:35.908900 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] Attempting to bind port ea47f272-34ce-4df1-b42c-009ad5f91a31 on host hv-cinder-77398 for vnic_type normal with profile {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:14:35.909150 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] Attempting to bind port ea47f272-34ce-4df1-b42c-009ad5f91a31 by drivers openvswitch,hyperv on host hv-cinder-77398 at level 0 using segments [{'id': 'acdb31ea-e529-495f-b01f-8c3d7b96781f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d'}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:14:35.909496 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] Attempting to bind port ea47f272-34ce-4df1-b42c-009ad5f91a31 on network 622fcad3-2fd8-49df-8f66-feb243e2b24d {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:14:35.914257 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] Port ea47f272-34ce-4df1-b42c-009ad5f91a31 on network 622fcad3-2fd8-49df-8f66-feb243e2b24d not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77398 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Feb 08 18:14:35.914579 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] Attempting to bind port ea47f272-34ce-4df1-b42c-009ad5f91a31 on network 622fcad3-2fd8-49df-8f66-feb243e2b24d {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:14:35.920371 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] Checking agent: {'id': '045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77398', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'started_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 14, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:14:35.920840 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] Checking segment: {'id': 'acdb31ea-e529-495f-b01f-8c3d7b96781f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102559) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:14:35.921375 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] Bound using segment: {'id': 'acdb31ea-e529-495f-b01f-8c3d7b96781f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d'} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:14:35.921974 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] Bound port: ea47f272-34ce-4df1-b42c-009ad5f91a31, host: hv-cinder-77398, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'acdb31ea-e529-495f-b01f-8c3d7b96781f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d'}}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:14:35.922478 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (ea47f272-34ce-4df1-b42c-009ad5f91a31), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:36.001090 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] For port ea47f272-34ce-4df1-b42c-009ad5f91a31, host hv-cinder-77398, cleared binding levels {{(pid=102559) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:14:36.006886 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] For port ea47f272-34ce-4df1-b42c-009ad5f91a31, host hv-cinder-77398, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=ea47f272-34ce-4df1-b42c-009ad5f91a31,segment=NetworkSegment(acdb31ea-e529-495f-b01f-8c3d7b96781f),segment_id=acdb31ea-e529-495f-b01f-8c3d7b96781f)] {{(pid=102559) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:14:36.016370 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (ea47f272-34ce-4df1-b42c-009ad5f91a31), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:36.056707 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:36.057384 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:36.058792 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] 10.222.0.109 "PUT /v2.0/ports/ea47f272-34ce-4df1-b42c-009ad5f91a31 HTTP/1.1" status: 200 len: 1093 time: 0.8264265 Feb 08 18:14:36.059279 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '963f7229-2841-485f-98f9-64722824a6df', 'tag': 'ea47f272-34ce-4df1-b42c-009ad5f91a31'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:14:36.061545 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-736f6107-7a1d-4d52-b53a-6ac8b11b9129" -d '{"events": [{"name": "network-changed", "server_uuid": "963f7229-2841-485f-98f9-64722824a6df", "tag": "ea47f272-34ce-4df1-b42c-009ad5f91a31"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:14:36.101973 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da5f85c7-7ef0-4da2-9b1e-1ebece412166 service neutron] Pushing event updated for resources: {'Port': ['ID=ea47f272-34ce-4df1-b42c-009ad5f91a31,revision_number=3']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:14:36.137079 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:14:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f652d837-e8b1-45b1-83df-d868011dad97 x-openstack-request-id: req-f652d837-e8b1-45b1-83df-d868011dad97 {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:14:36.137362 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "963f7229-2841-485f-98f9-64722824a6df", "tag": "ea47f272-34ce-4df1-b42c-009ad5f91a31", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:14:36.137610 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-f652d837-e8b1-45b1-83df-d868011dad97 {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:14:36.138116 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '963f7229-2841-485f-98f9-64722824a6df', 'tag': 'ea47f272-34ce-4df1-b42c-009ad5f91a31', 'status': 'completed', 'code': 200} Feb 08 18:14:36.172127 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-cc23d376-c3e3-4682-b151-0478ee968ea9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:36.173754 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-cc23d376-c3e3-4682-b151-0478ee968ea9 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=602d106ac7104b10bebcfc0421ea5edc&device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 1127 time: 0.0471032 Feb 08 18:14:36.220133 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-3f4a5407-4b19-401a-b623-fd2b181813a5 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ea47f272-34ce-4df1-b42c-009ad5f91a31 HTTP/1.1" status: 200 len: 217 time: 0.0371521 Feb 08 18:14:36.277300 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-b81bd724-c3bc-42e1-b541-fbf144fccc4f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:36.278865 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-b81bd724-c3bc-42e1-b541-fbf144fccc4f service neutron] 10.222.0.109 "GET /v2.0/subnets?id=080b9f96-e4e1-410a-a6ed-01cf523843d5 HTTP/1.1" status: 200 len: 855 time: 0.0469661 Feb 08 18:14:36.320447 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-34206237-0f3a-4e7f-8091-8e9af214ecbc service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=622fcad3-2fd8-49df-8f66-feb243e2b24d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0282786 Feb 08 18:14:36.430665 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-632b96a4-29b7-4e3f-8235-94e998635785 service neutron] 10.222.0.109 "GET /v2.0/networks/622fcad3-2fd8-49df-8f66-feb243e2b24d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0998621 Feb 08 18:14:36.522016 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9fbedffd-71d5-4985-9cf6-947cd18bcf11 req-c0a2e5d0-e587-4a33-9d9c-478531bc8867 service neutron] 10.222.0.109 "GET /v2.0/networks/622fcad3-2fd8-49df-8f66-feb243e2b24d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0838296 Feb 08 18:14:36.546424 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c0d25e7f-8871-44ba-8135-63b1c98e6e7f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for floatingip (00651317-6b63-457e-ae80-8fd5622d070a), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:36.618894 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-736f6107-7a1d-4d52-b53a-6ac8b11b9129 req-0f84763e-8c7b-475a-8310-ea478116faec service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:36.620849 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-736f6107-7a1d-4d52-b53a-6ac8b11b9129 req-0f84763e-8c7b-475a-8310-ea478116faec service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=602d106ac7104b10bebcfc0421ea5edc&device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 1127 time: 0.0520589 Feb 08 18:14:36.623144 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c0d25e7f-8871-44ba-8135-63b1c98e6e7f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (f67d5f70-99da-48d9-9034-aeeb1285d87d), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:36.753596 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eaa4868-ec40-4443-a3c0-3e2f424411e8 req-24086c8f-12d0-4e4f-8ec2-2302a174dbb2 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:36.754965 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0eaa4868-ec40-4443-a3c0-3e2f424411e8 req-24086c8f-12d0-4e4f-8ec2-2302a174dbb2 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.1030471 Feb 08 18:14:36.756307 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-736f6107-7a1d-4d52-b53a-6ac8b11b9129 req-ef28ac1e-e14d-4e0a-a903-f60ab585b4c7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:36.757618 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-736f6107-7a1d-4d52-b53a-6ac8b11b9129 req-ef28ac1e-e14d-4e0a-a903-f60ab585b4c7 service neutron] 10.222.0.109 "GET /v2.0/networks?id=622fcad3-2fd8-49df-8f66-feb243e2b24d HTTP/1.1" status: 200 len: 917 time: 0.1299222 Feb 08 18:14:36.761475 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e155396e-ff9a-4cda-9035-284db9acf7ac req-e62c2f79-49e0-4b86-a514-2a4689d54b14 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:36.763181 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e155396e-ff9a-4cda-9035-284db9acf7ac req-e62c2f79-49e0-4b86-a514-2a4689d54b14 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.1146750 Feb 08 18:14:36.811046 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-736f6107-7a1d-4d52-b53a-6ac8b11b9129 req-fb2b9f79-d66c-4d1a-92b1-4dd79b99385a service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=ea47f272-34ce-4df1-b42c-009ad5f91a31 HTTP/1.1" status: 200 len: 217 time: 0.0445876 Feb 08 18:14:36.842705 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e155396e-ff9a-4cda-9035-284db9acf7ac req-54b5e3a9-5727-404c-8699-c6334397d593 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0723121 Feb 08 18:14:36.852238 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c0d25e7f-8871-44ba-8135-63b1c98e6e7f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for port (f67d5f70-99da-48d9-9034-aeeb1285d87d), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:36.857694 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c0d25e7f-8871-44ba-8135-63b1c98e6e7f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-64531588'] for port (f67d5f70-99da-48d9-9034-aeeb1285d87d), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:36.861727 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0eaa4868-ec40-4443-a3c0-3e2f424411e8 req-4347d736-5c0f-4b0c-bfc1-fbe17ac1acb6 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1010294 Feb 08 18:14:36.880311 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-736f6107-7a1d-4d52-b53a-6ac8b11b9129 req-87579976-9467-4853-ba88-04a03a8efd21 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:36.881812 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-736f6107-7a1d-4d52-b53a-6ac8b11b9129 req-87579976-9467-4853-ba88-04a03a8efd21 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=080b9f96-e4e1-410a-a6ed-01cf523843d5 HTTP/1.1" status: 200 len: 855 time: 0.0594842 Feb 08 18:14:36.917251 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-736f6107-7a1d-4d52-b53a-6ac8b11b9129 req-dabe025a-dd13-4850-b63a-17bc8a3839fe service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=622fcad3-2fd8-49df-8f66-feb243e2b24d&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0269749 Feb 08 18:14:36.976825 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0d25e7f-8871-44ba-8135-63b1c98e6e7f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Pushing event updated for resources: {'Port': ['ID=f67d5f70-99da-48d9-9034-aeeb1285d87d,revision_number=2']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:14:36.984040 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c0d25e7f-8871-44ba-8135-63b1c98e6e7f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-560746'] for floatingip (00651317-6b63-457e-ae80-8fd5622d070a), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:37.021369 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-736f6107-7a1d-4d52-b53a-6ac8b11b9129 req-a9636aa2-d065-4c57-aaef-b8b7b5f07c55 service neutron] 10.222.0.109 "GET /v2.0/networks/622fcad3-2fd8-49df-8f66-feb243e2b24d?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0960355 Feb 08 18:14:37.074229 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-206655a6-81ae-4bbe-b700-bcf52e903cb2 req-80504477-964d-4826-946f-ce2a6b67e34a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:37.075761 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-206655a6-81ae-4bbe-b700-bcf52e903cb2 req-80504477-964d-4826-946f-ce2a6b67e34a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 943 time: 0.1501043 Feb 08 18:14:37.116243 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-736f6107-7a1d-4d52-b53a-6ac8b11b9129 req-848d51d0-ec48-4993-8e45-3cc28b7f6c61 service neutron] 10.222.0.109 "GET /v2.0/networks/622fcad3-2fd8-49df-8f66-feb243e2b24d?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0885978 Feb 08 18:14:37.126355 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.l3_db [None req-c0d25e7f-8871-44ba-8135-63b1c98e6e7f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Floating IP 00651317-6b63-457e-ae80-8fd5622d070a associated. External IP: 172.27.1.5, port: feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8. Feb 08 18:14:37.170667 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-206655a6-81ae-4bbe-b700-bcf52e903cb2 req-e7695a4e-d6ac-4527-8032-6f9046f90a82 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0878041 Feb 08 18:14:37.343439 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c0d25e7f-8871-44ba-8135-63b1c98e6e7f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Router 72b4fd56-6775-4076-9195-fe85693f53aa has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:14:37.450591 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c0d25e7f-8871-44ba-8135-63b1c98e6e7f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:14:37.461495 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acaee055-d4b9-4e49-9314-bc82942e747c None None] Sync routers for ids ['72b4fd56-6775-4076-9195-fe85693f53aa'] in dv-cinder-773985-21-iscsi {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:14:37.469398 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c0d25e7f-8871-44ba-8135-63b1c98e6e7f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for floatingip (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:37.472134 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acaee055-d4b9-4e49-9314-bc82942e747c None None] Routers {'72b4fd56-6775-4076-9195-fe85693f53aa'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:14:37.472717 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-acaee055-d4b9-4e49-9314-bc82942e747c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:14:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['72b4fd56-6775-4076-9195-fe85693f53aa'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:14:37.499459 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-c0d25e7f-8871-44ba-8135-63b1c98e6e7f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.3715699 Feb 08 18:14:37.500050 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '276ac338-a990-44da-a077-251beabd094d', 'tag': 'feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:14:37.502314 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-115ad3b3-7e90-4fa5-b118-7eeb56ccc559" -d '{"events": [{"name": "network-changed", "server_uuid": "276ac338-a990-44da-a077-251beabd094d", "tag": "feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:14:37.546197 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:14:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-91b1f87f-c0e4-4f3f-b1c7-e6236738d3c2 x-openstack-request-id: req-91b1f87f-c0e4-4f3f-b1c7-e6236738d3c2 {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:14:37.546490 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "276ac338-a990-44da-a077-251beabd094d", "tag": "feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:14:37.547096 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-91b1f87f-c0e4-4f3f-b1c7-e6236738d3c2 {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:14:37.547203 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '276ac338-a990-44da-a077-251beabd094d', 'tag': 'feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8', 'status': 'completed', 'code': 200} Feb 08 18:14:37.640520 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-115ad3b3-7e90-4fa5-b118-7eeb56ccc559 req-a3bc89b5-9519-4203-9424-8b620ed92428 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:37.642084 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-115ad3b3-7e90-4fa5-b118-7eeb56ccc559 req-a3bc89b5-9519-4203-9424-8b620ed92428 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=768f50510c57419e8a49ed0988014174&device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 1130 time: 0.0511537 Feb 08 18:14:37.664096 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-acaee055-d4b9-4e49-9314-bc82942e747c None None] Set router 72b4fd56-6775-4076-9195-fe85693f53aa gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:14:37.735785 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-115ad3b3-7e90-4fa5-b118-7eeb56ccc559 req-fba937a7-67de-4bae-9929-82ca444bc668 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:37.737261 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-115ad3b3-7e90-4fa5-b118-7eeb56ccc559 req-fba937a7-67de-4bae-9929-82ca444bc668 service neutron] 10.222.0.109 "GET /v2.0/networks?id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 HTTP/1.1" status: 200 len: 913 time: 0.0884209 Feb 08 18:14:37.863432 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-115ad3b3-7e90-4fa5-b118-7eeb56ccc559 req-1ecc2371-fb3d-4b0c-8372-c196f597db4e service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 HTTP/1.1" status: 200 len: 998 time: 0.1146185 Feb 08 18:14:37.886610 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-acaee055-d4b9-4e49-9314-bc82942e747c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 4, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '00651317-6b63-457e-ae80-8fd5622d070a', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'floating_ip_address': '172.27.1.5', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'port_id': 'feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 402, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'mac_address': 'fa:16:3e:66:34:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '276ac338-a990-44da-a077-251beabd094d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:14:36Z', 'updated_at': '2022-02-08T18:14:36Z', 'revision_number': 0, 'project_id': '768f50510c57419e8a49ed0988014174', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '13fcfd03-fc49-4bba-8574-ec74e795e2bd', 'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'mac_address': 'fa:16:3e:4b:7b:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:44Z', 'updated_at': '2022-02-08T18:13:51Z', 'revision_number': 5, 'project_id': '768f50510c57419e8a49ed0988014174', 'subnets': [{'id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:14:37.886962 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17894955-f99b-45d0-a197-89a328af7ab4 req-c759869a-8826-4ffd-ad98-0ce1f9d46d75 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:37.889783 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-17894955-f99b-45d0-a197-89a328af7ab4 req-c759869a-8826-4ffd-ad98-0ce1f9d46d75 service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5&tenant_id=357dab3d3db74ef9a8ee50fdd8a8bdcd HTTP/1.1" status: 200 len: 1127 time: 0.0999289 Feb 08 18:14:37.918504 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acaee055-d4b9-4e49-9314-bc82942e747c None None] Checking router: 72b4fd56-6775-4076-9195-fe85693f53aa for host: dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:14:37.927668 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acaee055-d4b9-4e49-9314-bc82942e747c None None] Routers {'72b4fd56-6775-4076-9195-fe85693f53aa'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:14:37.928486 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-acaee055-d4b9-4e49-9314-bc82942e747c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:14:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['72b4fd56-6775-4076-9195-fe85693f53aa'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:14:37.948594 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-115ad3b3-7e90-4fa5-b118-7eeb56ccc559 req-eb1a3a7d-fa13-4fe2-af4a-e32c8796f735 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:37.950181 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-115ad3b3-7e90-4fa5-b118-7eeb56ccc559 req-eb1a3a7d-fa13-4fe2-af4a-e32c8796f735 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=7b1e16de-d9af-4f50-86d7-ee22c9e14b1b HTTP/1.1" status: 200 len: 850 time: 0.0789359 Feb 08 18:14:37.985052 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c977fbf-a1d9-4467-8871-ddf1dff81b5f req-1dd36604-7e83-4bc5-97a3-fd17383bc248 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:37.986534 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-3c977fbf-a1d9-4467-8871-ddf1dff81b5f req-1dd36604-7e83-4bc5-97a3-fd17383bc248 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0528064 Feb 08 18:14:38.041817 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-acaee055-d4b9-4e49-9314-bc82942e747c None None] Set router 72b4fd56-6775-4076-9195-fe85693f53aa gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:14:38.047339 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-3c977fbf-a1d9-4467-8871-ddf1dff81b5f req-b4673c2d-a003-4987-a1cd-660b8dd0b5c5 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0542774 Feb 08 18:14:38.061922 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-819d5d09-3597-4b57-a005-407f039b0281 req-ea1f6ee7-d7fb-4f6d-9cad-dd7d85c69417 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:38.063426 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-819d5d09-3597-4b57-a005-407f039b0281 req-ea1f6ee7-d7fb-4f6d-9cad-dd7d85c69417 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.1110911 Feb 08 18:14:38.070048 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17894955-f99b-45d0-a197-89a328af7ab4 req-02af51f3-7663-456e-a9eb-05f57fd613e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:38.071468 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-17894955-f99b-45d0-a197-89a328af7ab4 req-02af51f3-7663-456e-a9eb-05f57fd613e4 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=357dab3d3db74ef9a8ee50fdd8a8bdcd&device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 1127 time: 0.1433260 Feb 08 18:14:38.074338 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-115ad3b3-7e90-4fa5-b118-7eeb56ccc559 req-c59bd5f7-436d-4b73-86b3-13491511dce3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:38.075685 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-115ad3b3-7e90-4fa5-b118-7eeb56ccc559 req-c59bd5f7-436d-4b73-86b3-13491511dce3 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.1121733 Feb 08 18:14:38.269165 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-acaee055-d4b9-4e49-9314-bc82942e747c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 4, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '00651317-6b63-457e-ae80-8fd5622d070a', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'floating_ip_address': '172.27.1.5', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'port_id': 'feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 402, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'mac_address': 'fa:16:3e:66:34:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '276ac338-a990-44da-a077-251beabd094d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:14:36Z', 'updated_at': '2022-02-08T18:14:36Z', 'revision_number': 0, 'project_id': '768f50510c57419e8a49ed0988014174', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '13fcfd03-fc49-4bba-8574-ec74e795e2bd', 'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'mac_address': 'fa:16:3e:4b:7b:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:44Z', 'updated_at': '2022-02-08T18:13:51Z', 'revision_number': 5, 'project_id': '768f50510c57419e8a49ed0988014174', 'subnets': [{'id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:14:38.298902 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-797908de-9ad1-469c-a924-f03a5fc4bb33 req-7adf29c6-a871-4d78-99a8-79cb54e03eb9 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:38.300616 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-797908de-9ad1-469c-a924-f03a5fc4bb33 req-7adf29c6-a871-4d78-99a8-79cb54e03eb9 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 943 time: 0.0594611 Feb 08 18:14:38.300875 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-acaee055-d4b9-4e49-9314-bc82942e747c None None] The sync data for ids ['72b4fd56-6775-4076-9195-fe85693f53aa'] in dv-cinder-773985-21-iscsi is: [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 4, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '00651317-6b63-457e-ae80-8fd5622d070a', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'floating_ip_address': '172.27.1.5', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'port_id': 'feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 402, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'mac_address': 'fa:16:3e:66:34:40', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '276ac338-a990-44da-a077-251beabd094d', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:14:36Z', 'updated_at': '2022-02-08T18:14:36Z', 'revision_number': 0, 'project_id': '768f50510c57419e8a49ed0988014174', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '13fcfd03-fc49-4bba-8574-ec74e795e2bd', 'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'mac_address': 'fa:16:3e:4b:7b:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:44Z', 'updated_at': '2022-02-08T18:13:51Z', 'revision_number': 5, 'project_id': '768f50510c57419e8a49ed0988014174', 'subnets': [{'id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:14:38.353997 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-797908de-9ad1-469c-a924-f03a5fc4bb33 req-a3760f08-5999-4965-ab08-2011db10a875 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465677 Feb 08 18:14:38.372737 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:14:38.437327 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-819d5d09-3597-4b57-a005-407f039b0281 req-fd071c23-74bb-4099-8a3c-087c679c2149 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3647735 Feb 08 18:14:38.453500 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 is: DOWN; New status is: DOWN {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:14:38.477823 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17894955-f99b-45d0-a197-89a328af7ab4 req-33658819-959a-4926-9117-6e8a28c11162 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:38.479364 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-17894955-f99b-45d0-a197-89a328af7ab4 req-33658819-959a-4926-9117-6e8a28c11162 service neutron] 10.222.0.109 "GET /v2.0/networks?id=7a854399-3ce6-42bd-bfc4-061132ecb9c2 HTTP/1.1" status: 200 len: 918 time: 0.3916876 Feb 08 18:14:38.492879 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-115ad3b3-7e90-4fa5-b118-7eeb56ccc559 req-22aa98f9-9d87-4b0e-af3d-0af55be03456 service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3967397 Feb 08 18:14:38.527982 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-df1f8f8e-6dad-4010-860c-263b8459af94 None None] New status for floating IP 00651317-6b63-457e-ae80-8fd5622d070a: ACTIVE {{(pid=102561) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Feb 08 18:14:38.601620 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-17894955-f99b-45d0-a197-89a328af7ab4 req-01a0dc7a-7801-425e-a22b-12e7c1d6f6c0 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 HTTP/1.1" status: 200 len: 999 time: 0.1077476 Feb 08 18:14:38.657617 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-115ad3b3-7e90-4fa5-b118-7eeb56ccc559 req-775435d8-c965-4771-b182-a487e3de6eb6 service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1280131 Feb 08 18:14:38.669561 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17894955-f99b-45d0-a197-89a328af7ab4 req-4bb1b988-6316-4093-9a98-3f94583c0301 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:38.671006 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-17894955-f99b-45d0-a197-89a328af7ab4 req-4bb1b988-6316-4093-9a98-3f94583c0301 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=73de7865-d87d-4a2a-a702-160c400f145f HTTP/1.1" status: 200 len: 855 time: 0.0568972 Feb 08 18:14:38.721977 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17894955-f99b-45d0-a197-89a328af7ab4 req-aa4f48b4-cb20-402f-99d5-0f0a8ae8b058 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:38.723499 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-17894955-f99b-45d0-a197-89a328af7ab4 req-aa4f48b4-cb20-402f-99d5-0f0a8ae8b058 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=7a854399-3ce6-42bd-bfc4-061132ecb9c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0452702 Feb 08 18:14:38.837437 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-17894955-f99b-45d0-a197-89a328af7ab4 req-8de20a76-1f07-4e51-b776-a9a828ed96bb service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1041613 Feb 08 18:14:38.944197 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-17894955-f99b-45d0-a197-89a328af7ab4 req-e3dc9816-0a73-4b78-9388-5a70090a6384 service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0949063 Feb 08 18:14:39.180702 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43bda5b8-f1de-4018-ad0f-5f5a5b378af6 req-7bf5c21f-0a68-4941-8b8b-e2fd0e29f6da tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:39.182330 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-43bda5b8-f1de-4018-ad0f-5f5a5b378af6 req-7bf5c21f-0a68-4941-8b8b-e2fd0e29f6da tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0657184 Feb 08 18:14:39.230960 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-43bda5b8-f1de-4018-ad0f-5f5a5b378af6 req-77666bfe-da63-4aad-917f-102c47a5bcd7 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423019 Feb 08 18:14:39.517578 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5800d36c-56a0-4275-910c-a4dcd7880fa8 req-538f3311-2de7-4f5d-b4b8-cd4c50e8aeda tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:39.527371 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5800d36c-56a0-4275-910c-a4dcd7880fa8 req-538f3311-2de7-4f5d-b4b8-cd4c50e8aeda tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 943 time: 0.0798495 Feb 08 18:14:39.593667 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-168437cc-e7c5-4a48-945b-c59c5123d082 req-90315f86-8412-481a-80d7-5c0bde02a260 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:39.595093 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5800d36c-56a0-4275-910c-a4dcd7880fa8 req-a5d4fd51-5de7-426a-ae4f-29b84d77259a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0665994 Feb 08 18:14:39.600586 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-168437cc-e7c5-4a48-945b-c59c5123d082 req-90315f86-8412-481a-80d7-5c0bde02a260 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.0750198 Feb 08 18:14:39.655254 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-168437cc-e7c5-4a48-945b-c59c5123d082 req-582f2ea3-3403-4ef7-97a3-95ada285bbf8 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0537837 Feb 08 18:14:40.354039 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7c62991-36f3-4797-9676-97d4f47c9504 req-37c8abf3-a92a-4d36-8b5c-23641f70d478 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:40.355710 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c7c62991-36f3-4797-9676-97d4f47c9504 req-37c8abf3-a92a-4d36-8b5c-23641f70d478 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0545206 Feb 08 18:14:40.386180 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device ea47f272-34ce-4df1-b42c-009ad5f91a31 details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:14:40.417931 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c7c62991-36f3-4797-9676-97d4f47c9504 req-4453c35c-4a52-4bc9-84bd-9ffb72cdddef tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0562701 Feb 08 18:14:40.623135 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port ea47f272-34ce-4df1-b42c-009ad5f91a31, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=ea47f272-34ce-4df1-b42c-009ad5f91a31,segment=NetworkSegment(acdb31ea-e529-495f-b01f-8c3d7b96781f),segment_id=acdb31ea-e529-495f-b01f-8c3d7b96781f)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:14:40.635683 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': 'ea47f272-34ce-4df1-b42c-009ad5f91a31', 'network_id': '622fcad3-2fd8-49df-8f66-feb243e2b24d', 'port_id': 'ea47f272-34ce-4df1-b42c-009ad5f91a31', 'mac_address': 'fa:16:3e:bb:c9:05', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1074, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '080b9f96-e4e1-410a-a6ed-01cf523843d5', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:14:40.674523 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port ea47f272-34ce-4df1-b42c-009ad5f91a31 is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:14:40.674971 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (ea47f272-34ce-4df1-b42c-009ad5f91a31), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:40.688514 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ea47f272-34ce-4df1-b42c-009ad5f91a31 {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:14:40.716713 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port ea47f272-34ce-4df1-b42c-009ad5f91a31, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=ea47f272-34ce-4df1-b42c-009ad5f91a31,segment=NetworkSegment(acdb31ea-e529-495f-b01f-8c3d7b96781f),segment_id=acdb31ea-e529-495f-b01f-8c3d7b96781f)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:14:40.721699 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (ea47f272-34ce-4df1-b42c-009ad5f91a31), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:40.732327 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81e1b1d0-e93a-4ede-b94b-459aba454191 req-df43e792-bdb5-46aa-87f6-54c217285cb1 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:40.739684 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-81e1b1d0-e93a-4ede-b94b-459aba454191 req-df43e792-bdb5-46aa-87f6-54c217285cb1 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 943 time: 0.0653377 Feb 08 18:14:40.783922 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-81e1b1d0-e93a-4ede-b94b-459aba454191 req-7023b3ba-588c-4fae-9875-e6c4a6b82902 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431631 Feb 08 18:14:40.786283 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=ea47f272-34ce-4df1-b42c-009ad5f91a31,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:14:40.809169 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c460a5e-325d-4c19-9f48-538f459a134b req-886270f8-30e1-498c-a234-2ad5c2be2c16 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:40.810676 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3c460a5e-325d-4c19-9f48-538f459a134b req-886270f8-30e1-498c-a234-2ad5c2be2c16 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.0542896 Feb 08 18:14:40.863361 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3c460a5e-325d-4c19-9f48-538f459a134b req-20de3662-564d-4aa7-beb0-7518db566ff9 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468817 Feb 08 18:14:41.116485 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['ea47f272-34ce-4df1-b42c-009ad5f91a31'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:14:41.540064 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af25ec28-9a03-4f9d-837e-86d2cd0f4149 req-eb758d89-b5d8-4b41-ac3f-e67ca43a08eb tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:41.541699 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-af25ec28-9a03-4f9d-837e-86d2cd0f4149 req-eb758d89-b5d8-4b41-ac3f-e67ca43a08eb tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0540624 Feb 08 18:14:41.599304 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-af25ec28-9a03-4f9d-837e-86d2cd0f4149 req-e1ae69ab-8df8-4588-99d7-53ef7dd37439 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504754 Feb 08 18:14:41.911474 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7451e081-8d69-4372-834a-ace4f0c7abbb req-e200b473-aa09-4c4d-a539-75cb34577f7a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:41.912941 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7451e081-8d69-4372-834a-ace4f0c7abbb req-e200b473-aa09-4c4d-a539-75cb34577f7a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 944 time: 0.0558286 Feb 08 18:14:41.969153 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7451e081-8d69-4372-834a-ace4f0c7abbb req-a430afb8-d34a-48b6-9f37-cc4e12ca54b6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502307 Feb 08 18:14:42.008464 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f19e9e88-7c52-4aef-9a9e-f3462e508fb2 req-c6acd290-9bfa-49b7-b3e2-c2a321a5357a tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:42.009994 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f19e9e88-7c52-4aef-9a9e-f3462e508fb2 req-c6acd290-9bfa-49b7-b3e2-c2a321a5357a tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.0578136 Feb 08 18:14:42.062086 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f19e9e88-7c52-4aef-9a9e-f3462e508fb2 req-825b2f5c-e158-47aa-9b58-32852d476b7a tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456033 Feb 08 18:14:42.407058 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device ea47f272-34ce-4df1-b42c-009ad5f91a31 up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:14:42.464144 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning for port ea47f272-34ce-4df1-b42c-009ad5f91a31 completed by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Feb 08 18:14:42.469844 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port ea47f272-34ce-4df1-b42c-009ad5f91a31 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:14:42.470262 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (ea47f272-34ce-4df1-b42c-009ad5f91a31), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:42.556652 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port ea47f272-34ce-4df1-b42c-009ad5f91a31 is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:14:42.557108 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (ea47f272-34ce-4df1-b42c-009ad5f91a31), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:42.582645 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '963f7229-2841-485f-98f9-64722824a6df', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ea47f272-34ce-4df1-b42c-009ad5f91a31'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:14:42.584955 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6d73741b-bbff-4688-bee5-0cb73c4dfefa" -d '{"events": [{"server_uuid": "963f7229-2841-485f-98f9-64722824a6df", "name": "network-vif-plugged", "status": "completed", "tag": "ea47f272-34ce-4df1-b42c-009ad5f91a31"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:14:42.609899 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port ea47f272-34ce-4df1-b42c-009ad5f91a31, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=ea47f272-34ce-4df1-b42c-009ad5f91a31,segment=NetworkSegment(acdb31ea-e529-495f-b01f-8c3d7b96781f),segment_id=acdb31ea-e529-495f-b01f-8c3d7b96781f)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:14:42.614984 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (ea47f272-34ce-4df1-b42c-009ad5f91a31), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:42.648942 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:14:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3dc7563f-93b9-4646-914a-e38b3938b348 x-openstack-request-id: req-3dc7563f-93b9-4646-914a-e38b3938b348 {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:14:42.649239 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "963f7229-2841-485f-98f9-64722824a6df", "name": "network-vif-plugged", "status": "completed", "tag": "ea47f272-34ce-4df1-b42c-009ad5f91a31", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:14:42.649487 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-3dc7563f-93b9-4646-914a-e38b3938b348 {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:14:42.649882 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '963f7229-2841-485f-98f9-64722824a6df', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ea47f272-34ce-4df1-b42c-009ad5f91a31', 'code': 200} Feb 08 18:14:42.679902 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=ea47f272-34ce-4df1-b42c-009ad5f91a31,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:14:42.743272 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dee448d7-c339-47de-af60-4629b6485d66 req-1f05c8e6-a401-4750-8fbc-4031fa8a3fdb tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:42.744863 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-dee448d7-c339-47de-af60-4629b6485d66 req-1f05c8e6-a401-4750-8fbc-4031fa8a3fdb tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0553093 Feb 08 18:14:42.791677 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-dee448d7-c339-47de-af60-4629b6485d66 req-d45f6d71-77bf-4fae-8a5f-bf0c38f4cd8d tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409904 Feb 08 18:14:43.095934 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5722999-8533-4444-98d2-ddb1dfdcc7a2 req-fe7f1df3-9c32-47d7-8812-54f2aa4431ce tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:43.097770 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a5722999-8533-4444-98d2-ddb1dfdcc7a2 req-fe7f1df3-9c32-47d7-8812-54f2aa4431ce tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 945 time: 0.0556862 Feb 08 18:14:43.156441 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a5722999-8533-4444-98d2-ddb1dfdcc7a2 req-76d425d9-7fd0-41f3-bf06-01a70ec82ef7 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0509739 Feb 08 18:14:43.208002 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd77c6f8-3159-4ccc-8428-bae4da640cb3 req-411e3187-0b74-4ee2-b980-d2f900eb0548 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:43.209516 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-fd77c6f8-3159-4ccc-8428-bae4da640cb3 req-411e3187-0b74-4ee2-b980-d2f900eb0548 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.0622470 Feb 08 18:14:43.266070 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-fd77c6f8-3159-4ccc-8428-bae4da640cb3 req-a3aadb0a-68cd-405d-93a1-b12b4245b07d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0506341 Feb 08 18:14:43.916042 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d866abe7-81f2-40f8-b6fe-ec5e1ca2532d req-71a2067f-4c92-425a-8dc2-681fcdef9a41 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:43.917614 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d866abe7-81f2-40f8-b6fe-ec5e1ca2532d req-71a2067f-4c92-425a-8dc2-681fcdef9a41 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0560932 Feb 08 18:14:43.966446 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d866abe7-81f2-40f8-b6fe-ec5e1ca2532d req-29860410-97eb-44f1-825e-a6b74328762d tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430074 Feb 08 18:14:44.284366 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba3d96b7-bb7e-4d61-8cd6-048b40c55461 req-e0c243ba-71fa-4397-ae9a-5b0dc47c6767 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:44.286147 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ba3d96b7-bb7e-4d61-8cd6-048b40c55461 req-e0c243ba-71fa-4397-ae9a-5b0dc47c6767 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 945 time: 0.0564640 Feb 08 18:14:44.343864 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ba3d96b7-bb7e-4d61-8cd6-048b40c55461 req-1e641dd8-ff3f-4971-a2cc-fb8b37340d33 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0520751 Feb 08 18:14:44.398969 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee49f53a-4ba7-4140-8c3a-bb1b6f91844a req-566ae85b-853a-4167-b7d6-398764052e6e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:44.400503 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ee49f53a-4ba7-4140-8c3a-bb1b6f91844a req-566ae85b-853a-4167-b7d6-398764052e6e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.0580258 Feb 08 18:14:44.448680 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ee49f53a-4ba7-4140-8c3a-bb1b6f91844a req-29ff7d43-7bd8-400b-8861-940c53fed5d1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423751 Feb 08 18:14:45.091775 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61d1ce9a-7ff5-46ee-90bd-ccad343c6090 req-5f30f30c-790b-4e75-9f63-11849991ad1f tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:45.093197 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-61d1ce9a-7ff5-46ee-90bd-ccad343c6090 req-5f30f30c-790b-4e75-9f63-11849991ad1f tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0541863 Feb 08 18:14:45.150227 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-61d1ce9a-7ff5-46ee-90bd-ccad343c6090 req-95e08e36-535f-4daa-9f6c-1865ee56292a tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0511076 Feb 08 18:14:45.370694 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-9d23f359-eab6-4dae-a17a-e05791e978a2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:45.475798 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c979ff31-b0e4-4c40-b28d-361f3311f2d5 req-934f86da-5a56-46c4-b114-8bcafc321b35 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:45.477351 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c979ff31-b0e4-4c40-b28d-361f3311f2d5 req-934f86da-5a56-46c4-b114-8bcafc321b35 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 945 time: 0.0611444 Feb 08 18:14:45.524313 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c979ff31-b0e4-4c40-b28d-361f3311f2d5 req-b66cab0b-57ae-4bbc-815f-a9a5092ce0f9 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410089 Feb 08 18:14:45.583768 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-039ecc41-0c93-442a-9f81-d949dc3deb5b req-047904e1-4756-423f-aae3-1b68a7898f33 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:45.585264 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-039ecc41-0c93-442a-9f81-d949dc3deb5b req-047904e1-4756-423f-aae3-1b68a7898f33 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.0590634 Feb 08 18:14:45.633800 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-039ecc41-0c93-442a-9f81-d949dc3deb5b req-f0853733-ec4e-412b-aaf3-18d0cd88e30a tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427701 Feb 08 18:14:46.275283 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cae18e92-ac32-4d41-8a3c-7933a30d634a req-f85ca26a-6f25-468a-8405-3bbf446c57f5 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:46.276767 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-cae18e92-ac32-4d41-8a3c-7933a30d634a req-f85ca26a-6f25-468a-8405-3bbf446c57f5 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0538137 Feb 08 18:14:46.325188 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-cae18e92-ac32-4d41-8a3c-7933a30d634a req-5ba45901-77c4-441b-bbdc-e5ced4a282f9 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425425 Feb 08 18:14:46.650395 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70e1cec8-ce3b-4d8d-8648-571f97fa7db2 req-f19791b0-2719-42ee-8c7e-aeca2986426a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:46.651953 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-70e1cec8-ce3b-4d8d-8648-571f97fa7db2 req-f19791b0-2719-42ee-8c7e-aeca2986426a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 945 time: 0.0550444 Feb 08 18:14:46.713373 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-70e1cec8-ce3b-4d8d-8648-571f97fa7db2 req-be2f72e9-e86a-41c6-82e6-4eb842be7ad5 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0555797 Feb 08 18:14:46.772625 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5a7906b-f111-4c3c-89da-d3c10c0b4ec0 req-9e69a949-cb23-48ee-8dce-0e8521ee80aa tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:46.774391 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b5a7906b-f111-4c3c-89da-d3c10c0b4ec0 req-9e69a949-cb23-48ee-8dce-0e8521ee80aa tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.0523469 Feb 08 18:14:46.830399 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b5a7906b-f111-4c3c-89da-d3c10c0b4ec0 req-214ca30a-8a42-4f1b-bf74-9083e7738344 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493338 Feb 08 18:14:47.469064 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb57e4da-2e8e-4150-966d-1eb185b80dd6 req-957d3d34-603a-439b-8e3c-03207be64a12 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:47.470567 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-cb57e4da-2e8e-4150-966d-1eb185b80dd6 req-957d3d34-603a-439b-8e3c-03207be64a12 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0633953 Feb 08 18:14:47.520087 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-cb57e4da-2e8e-4150-966d-1eb185b80dd6 req-39528c7b-5bed-4768-88a7-eb67359d6a4a tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0429747 Feb 08 18:14:47.816157 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-4031f1e6-0bcb-45d0-817b-035b8fa6e76c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:47.852595 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-077c97d4-e293-4458-ad00-d7f59f2d1b7f req-b05e54a5-ee95-452a-9498-f06a74dfa274 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:47.854426 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-077c97d4-e293-4458-ad00-d7f59f2d1b7f req-b05e54a5-ee95-452a-9498-f06a74dfa274 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 945 time: 0.0693989 Feb 08 18:14:47.905036 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-077c97d4-e293-4458-ad00-d7f59f2d1b7f req-ce93e816-d34c-4730-a57d-3cd7d9946ff1 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442624 Feb 08 18:14:47.959786 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4eb7c424-09f0-4866-80f7-7bc92ad8cef7 req-d70beb1e-3e84-49df-9fd3-857236bfa0c7 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:47.960426 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:47.962206 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4eb7c424-09f0-4866-80f7-7bc92ad8cef7 req-d70beb1e-3e84-49df-9fd3-857236bfa0c7 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.0575378 Feb 08 18:14:48.009805 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4eb7c424-09f0-4866-80f7-7bc92ad8cef7 req-77da2536-5641-4371-a036-3afd21e16386 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412571 Feb 08 18:14:48.487827 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:48.651720 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62a38701-25f4-4d5c-a64b-4cb5f248d904 req-984c9195-21dc-46ff-b5c0-884e073e8edc tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:48.653239 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-62a38701-25f4-4d5c-a64b-4cb5f248d904 req-984c9195-21dc-46ff-b5c0-884e073e8edc tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0599024 Feb 08 18:14:48.702815 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-62a38701-25f4-4d5c-a64b-4cb5f248d904 req-17a0fc8d-e469-4e0a-97a8-579402a98721 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0432179 Feb 08 18:14:49.024765 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85a727e3-aa5e-404c-b181-3f6719651ee2 req-6783b2f3-f484-4cc9-bc94-d15e667fcd9c tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:49.026460 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-85a727e3-aa5e-404c-b181-3f6719651ee2 req-6783b2f3-f484-4cc9-bc94-d15e667fcd9c tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 945 time: 0.0535579 Feb 08 18:14:49.078515 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-85a727e3-aa5e-404c-b181-3f6719651ee2 req-11443de0-46c3-4709-8578-6327efd50cf3 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459023 Feb 08 18:14:49.142241 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4d38ad1-2526-4e14-9a83-b6c34f207b10 req-c12c603c-2315-4948-b298-d396c520d4ac tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:49.143777 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e4d38ad1-2526-4e14-9a83-b6c34f207b10 req-c12c603c-2315-4948-b298-d396c520d4ac tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.0570519 Feb 08 18:14:49.194840 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e4d38ad1-2526-4e14-9a83-b6c34f207b10 req-576c55ab-05b6-4edf-9f20-570e9b4a708c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0402660 Feb 08 18:14:49.828721 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc3faba4-daca-49fe-82f3-27a4c9636640 req-6b32eb5e-64cb-4485-9eec-f35526685538 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:49.830123 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-fc3faba4-daca-49fe-82f3-27a4c9636640 req-6b32eb5e-64cb-4485-9eec-f35526685538 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0538266 Feb 08 18:14:49.877279 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-fc3faba4-daca-49fe-82f3-27a4c9636640 req-6326647f-369d-4eb1-87e5-695ad8c6f33d tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414929 Feb 08 18:14:50.092747 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:50.207240 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02356813-b2a7-49d1-a94a-56ce10eb4c47 req-ba11a9e9-38a6-45ec-b7eb-ce8db1581253 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:50.208764 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-02356813-b2a7-49d1-a94a-56ce10eb4c47 req-ba11a9e9-38a6-45ec-b7eb-ce8db1581253 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 945 time: 0.0567808 Feb 08 18:14:50.256159 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-02356813-b2a7-49d1-a94a-56ce10eb4c47 req-495c5955-448a-44ac-89fa-a74e5796b540 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0417390 Feb 08 18:14:50.319640 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c021b1e2-7473-4289-b7e4-9b069de515de req-06daca5f-754d-4d3c-a5d2-640a9671eacb tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:50.321129 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c021b1e2-7473-4289-b7e4-9b069de515de req-06daca5f-754d-4d3c-a5d2-640a9671eacb tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.0539145 Feb 08 18:14:50.367861 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c021b1e2-7473-4289-b7e4-9b069de515de req-27f11f96-b545-463f-8bb4-87063c1ad45f tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0407965 Feb 08 18:14:51.002758 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4af654d0-013a-494a-9a51-f917d9192522 req-a86d1743-b344-46ba-b3af-3915d5c022ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:51.004276 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-4af654d0-013a-494a-9a51-f917d9192522 req-a86d1743-b344-46ba-b3af-3915d5c022ba service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 1129 time: 0.0804865 Feb 08 18:14:51.011762 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9707f6bd-14be-4262-b2f4-d197c514c33c req-3e94b06b-a0da-43de-aba3-c7adb0db99c0 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:51.013105 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9707f6bd-14be-4262-b2f4-d197c514c33c req-3e94b06b-a0da-43de-aba3-c7adb0db99c0 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0646265 Feb 08 18:14:51.078549 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-4af654d0-013a-494a-9a51-f917d9192522 req-7a363246-ddfc-4ddd-9d9c-5607ded66b00 service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0644937 Feb 08 18:14:51.082739 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9707f6bd-14be-4262-b2f4-d197c514c33c req-50f6fb3b-3dec-419b-8402-7172e96e4c24 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0637095 Feb 08 18:14:51.391899 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f641e77-75a7-40e9-87b7-1ad22d5800e3 req-56b468ef-5864-4b82-9e7f-b39a7f8f191d tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:51.393272 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0f641e77-75a7-40e9-87b7-1ad22d5800e3 req-56b468ef-5864-4b82-9e7f-b39a7f8f191d tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 945 time: 0.0689967 Feb 08 18:14:51.441412 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0f641e77-75a7-40e9-87b7-1ad22d5800e3 req-4dd54866-bbc2-4935-a895-d9675d6db996 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419977 Feb 08 18:14:51.494748 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-204eed55-cb4b-4ec4-b556-ce96a8daea8a req-a6c0559a-7a73-46e6-9f44-cf9cf1a3959b tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:51.496236 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-204eed55-cb4b-4ec4-b556-ce96a8daea8a req-a6c0559a-7a73-46e6-9f44-cf9cf1a3959b tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.0527918 Feb 08 18:14:51.546420 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-204eed55-cb4b-4ec4-b556-ce96a8daea8a req-a9c35344-3a41-4283-9eca-339abb5c5997 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421724 Feb 08 18:14:51.671173 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:14:52.219863 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f0c7a52-cb35-4774-8c8d-b2eb24037bfd req-afd2ec08-07e0-47df-b39d-ca0fa23a059d tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:52.221334 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-9f0c7a52-cb35-4774-8c8d-b2eb24037bfd req-afd2ec08-07e0-47df-b39d-ca0fa23a059d tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0570972 Feb 08 18:14:52.267848 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-9f0c7a52-cb35-4774-8c8d-b2eb24037bfd req-f14ad139-5d3d-4289-a383-554215ae8829 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407834 Feb 08 18:14:52.574287 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-751968c0-3b13-4b62-9ad7-9336bcebdfae req-e889ff9d-8e72-46ac-849e-c33fdd532653 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:52.575838 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-751968c0-3b13-4b62-9ad7-9336bcebdfae req-e889ff9d-8e72-46ac-849e-c33fdd532653 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 945 time: 0.0579588 Feb 08 18:14:52.622150 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-751968c0-3b13-4b62-9ad7-9336bcebdfae req-b6fcfe66-2240-4270-a89b-25df5ab81326 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407882 Feb 08 18:14:52.668754 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ba62ba8-fef6-4f02-bb99-ca09b0ce9514 req-d59067ef-c800-45ba-8f51-c192d5b76906 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:52.670256 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5ba62ba8-fef6-4f02-bb99-ca09b0ce9514 req-d59067ef-c800-45ba-8f51-c192d5b76906 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.0515425 Feb 08 18:14:52.726052 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5ba62ba8-fef6-4f02-bb99-ca09b0ce9514 req-e73b97b0-5296-4ab2-8637-75451efd66df tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0497801 Feb 08 18:14:52.974233 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4379d9b-3adf-4523-99c2-54ed70fb5366 req-e177851c-db0a-492a-a0a2-5a107ec5571a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:52.976650 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d4379d9b-3adf-4523-99c2-54ed70fb5366 req-e177851c-db0a-492a-a0a2-5a107ec5571a service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 1130 time: 0.0586450 Feb 08 18:14:53.025664 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d4379d9b-3adf-4523-99c2-54ed70fb5366 req-9c6dcad0-544a-47be-9c3f-1d09ac1ce4db service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0381100 Feb 08 18:14:53.401860 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1362101b-9ed4-475f-b931-1776fd3b9b14 req-3f1d29dd-1ea2-4ece-9fc1-5fc3035ce284 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:53.403371 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1362101b-9ed4-475f-b931-1776fd3b9b14 req-3f1d29dd-1ea2-4ece-9fc1-5fc3035ce284 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0577316 Feb 08 18:14:53.449967 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1362101b-9ed4-475f-b931-1776fd3b9b14 req-6554d261-5fad-41a6-a1be-02c8d3fd08fb tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0407765 Feb 08 18:14:53.759584 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97f7b557-22dd-4424-8594-e497df783bc9 req-6ccfe4eb-c493-4e5d-bfcd-9333c52b5c5f tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:53.760912 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-97f7b557-22dd-4424-8594-e497df783bc9 req-6ccfe4eb-c493-4e5d-bfcd-9333c52b5c5f tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 945 time: 0.0610032 Feb 08 18:14:53.813101 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-97f7b557-22dd-4424-8594-e497df783bc9 req-746dbcd1-1c66-436b-ae62-2eda0b39e68f tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437903 Feb 08 18:14:53.853224 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cf50df4-b25d-4656-a73c-f6ef61c1af32 req-83773a98-3819-40c1-a2ba-b4bbc0f41064 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:53.854797 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5cf50df4-b25d-4656-a73c-f6ef61c1af32 req-83773a98-3819-40c1-a2ba-b4bbc0f41064 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.0537016 Feb 08 18:14:53.901728 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5cf50df4-b25d-4656-a73c-f6ef61c1af32 req-9d1da711-b4a0-4c94-9217-677dd4ae1e07 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414715 Feb 08 18:14:54.583440 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dae95dc4-31d4-46ce-a45a-33d749e14509 req-40fc0047-36f4-4e67-ad43-5318c742bffe tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:54.584948 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-dae95dc4-31d4-46ce-a45a-33d749e14509 req-40fc0047-36f4-4e67-ad43-5318c742bffe tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0578747 Feb 08 18:14:54.633958 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-dae95dc4-31d4-46ce-a45a-33d749e14509 req-9da0be76-b6d2-445a-95e7-7258eea351ba tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405653 Feb 08 18:14:54.984527 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7ec73b7-93ea-4668-9a01-a4825d9c56be req-582af498-206a-4e13-8765-bddedf2bd361 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:54.986105 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b7ec73b7-93ea-4668-9a01-a4825d9c56be req-582af498-206a-4e13-8765-bddedf2bd361 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=3fb51fc0e23f4c66a482d4d406197299&device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 1130 time: 0.0773199 Feb 08 18:14:54.996656 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6379004f-1ca4-40fc-ba83-5a50c1e47acc req-0f5232b2-5138-4c78-8caf-2dccbe0524ce tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:54.998112 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6379004f-1ca4-40fc-ba83-5a50c1e47acc req-0f5232b2-5138-4c78-8caf-2dccbe0524ce tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0813544 Feb 08 18:14:55.034574 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81996f30-0fdd-4381-a6c9-f730a58c864c req-580ff9a5-fa94-4f94-8984-e1acd91abf78 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:55.036095 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-81996f30-0fdd-4381-a6c9-f730a58c864c req-580ff9a5-fa94-4f94-8984-e1acd91abf78 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.0584366 Feb 08 18:14:55.085756 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-81996f30-0fdd-4381-a6c9-f730a58c864c req-72aad55d-d0ac-4ccb-917a-bcf9f3c5835d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439236 Feb 08 18:14:55.100729 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6379004f-1ca4-40fc-ba83-5a50c1e47acc req-18bd3208-1422-496e-85c9-53718c6f105b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0942154 Feb 08 18:14:55.116653 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7ec73b7-93ea-4668-9a01-a4825d9c56be req-e3f69a08-8966-4325-847c-9b814b664948 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:55.118164 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b7ec73b7-93ea-4668-9a01-a4825d9c56be req-e3f69a08-8966-4325-847c-9b814b664948 service neutron] 10.222.0.109 "GET /v2.0/networks?id=f089911e-72de-4ff6-880b-ac3dd7927165 HTTP/1.1" status: 200 len: 921 time: 0.1191962 Feb 08 18:14:55.159908 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b7ec73b7-93ea-4668-9a01-a4825d9c56be req-38be075d-8548-4287-accb-9f717ff2f4f7 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=f63fc38b-d10b-4316-b77f-d1816d07ca90 HTTP/1.1" status: 200 len: 217 time: 0.0343466 Feb 08 18:14:55.220598 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7ec73b7-93ea-4668-9a01-a4825d9c56be req-4e519af4-a4e8-4bd9-991a-a400752772c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:55.222100 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b7ec73b7-93ea-4668-9a01-a4825d9c56be req-4e519af4-a4e8-4bd9-991a-a400752772c8 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=0af67967-364e-4325-b04f-b7e157c3c3d4 HTTP/1.1" status: 200 len: 859 time: 0.0553558 Feb 08 18:14:55.270784 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b7ec73b7-93ea-4668-9a01-a4825d9c56be req-a4925d3c-1509-422a-b414-56bd33ac99f6 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=f089911e-72de-4ff6-880b-ac3dd7927165&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0366666 Feb 08 18:14:55.373113 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b7ec73b7-93ea-4668-9a01-a4825d9c56be req-934d20b2-b635-4c00-80e2-f9f9c76770d7 service neutron] 10.222.0.109 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0900075 Feb 08 18:14:55.477413 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b7ec73b7-93ea-4668-9a01-a4825d9c56be req-f62cd69e-347a-41d8-89e6-a540d04b0480 service neutron] 10.222.0.109 "GET /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0980527 Feb 08 18:14:56.219017 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e31f1d3e-9f00-487c-a869-bb682e6faef3 req-534b9860-fa7e-42c0-b1c5-8b502ec43384 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:56.220563 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e31f1d3e-9f00-487c-a869-bb682e6faef3 req-534b9860-fa7e-42c0-b1c5-8b502ec43384 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.0577695 Feb 08 18:14:56.224137 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-889a2aef-94f3-490b-b9a6-ea409b7d6396 req-c9f5e504-6848-4a21-88bd-c62c3ba44465 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:56.225618 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-889a2aef-94f3-490b-b9a6-ea409b7d6396 req-c9f5e504-6848-4a21-88bd-c62c3ba44465 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0512545 Feb 08 18:14:56.269067 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e31f1d3e-9f00-487c-a869-bb682e6faef3 req-40ead27f-f8d7-49e2-990d-619358ef8c23 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425451 Feb 08 18:14:56.270494 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-889a2aef-94f3-490b-b9a6-ea409b7d6396 req-62719bec-a5d1-462a-b14a-2df24c78f7cb tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0392263 Feb 08 18:14:57.395942 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1429219-2817-4405-9d5d-f8e6943c8a7b req-332d710c-fbde-45d2-b960-05a549fa86cf tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:57.397491 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e1429219-2817-4405-9d5d-f8e6943c8a7b req-332d710c-fbde-45d2-b960-05a549fa86cf tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.0547578 Feb 08 18:14:57.398197 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-089abf1e-657b-40c3-853c-afcc6cc0eeb2 req-d54efaa9-8bff-48a8-8696-908c5855f811 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:57.399740 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-089abf1e-657b-40c3-853c-afcc6cc0eeb2 req-d54efaa9-8bff-48a8-8696-908c5855f811 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0549788 Feb 08 18:14:57.444338 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e1429219-2817-4405-9d5d-f8e6943c8a7b req-73535bc2-8e22-4ccf-8269-f2799dd3d4ac tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411823 Feb 08 18:14:57.445537 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-089abf1e-657b-40c3-853c-afcc6cc0eeb2 req-f175932a-f59c-42df-afa8-387dea67a59f tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0401464 Feb 08 18:14:58.577435 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc513094-9eee-44aa-9a40-6ac3323f08fe req-f0f0afb5-4652-4dc5-adb1-bf96dcce819f tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:58.578063 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6fbbcdf-799b-4d0c-a9da-56830ddc3dae req-5187b28a-df76-4325-8737-4a2ad771d630 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:58.578991 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-cc513094-9eee-44aa-9a40-6ac3323f08fe req-f0f0afb5-4652-4dc5-adb1-bf96dcce819f tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.0515630 Feb 08 18:14:58.579369 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f6fbbcdf-799b-4d0c-a9da-56830ddc3dae req-5187b28a-df76-4325-8737-4a2ad771d630 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0527625 Feb 08 18:14:58.627438 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f6fbbcdf-799b-4d0c-a9da-56830ddc3dae req-dd5b6939-805c-41aa-be63-2e40c6cf6b69 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422416 Feb 08 18:14:58.630801 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-cc513094-9eee-44aa-9a40-6ac3323f08fe req-2e83f75d-0db1-492b-89d5-0a46f3392422 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460873 Feb 08 18:14:59.766529 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79d9be3b-677f-49fc-b1c5-78447e512c49 req-c5d8cd77-2e1b-4df2-ac24-cb5e75122657 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:14:59.768030 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-79d9be3b-677f-49fc-b1c5-78447e512c49 req-c5d8cd77-2e1b-4df2-ac24-cb5e75122657 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 943 time: 0.0549359 Feb 08 18:14:59.822392 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-79d9be3b-677f-49fc-b1c5-78447e512c49 req-bef8d7f5-b64a-47a0-ad6d-4a752d0121dd tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459888 Feb 08 18:15:00.509869 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:15:00.613143 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:15:00.624508 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'port_id': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8', 'mac_address': 'fa:16:3e:15:4a:9a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1053, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '73de7865-d87d-4a2a-a702-160c400f145f', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:15:00.660698 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:15:00.661085 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:00.677679 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:15:00.697833 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:15:00.702545 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:00.751009 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8,revision_number=9']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:00.958827 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-209c702d-2bc2-4b10-87bc-0e373a114248 req-b4e90d50-e65c-4320-a829-6f6d9e2ca5a7 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:00.960337 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-209c702d-2bc2-4b10-87bc-0e373a114248 req-b4e90d50-e65c-4320-a829-6f6d9e2ca5a7 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 944 time: 0.0654891 Feb 08 18:15:01.007364 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-209c702d-2bc2-4b10-87bc-0e373a114248 req-9892b8c2-24ea-444c-9839-8b8551d5159e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413082 Feb 08 18:15:01.188295 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['2f2d1cfd-91ec-450a-bfe2-52d21f9196e8'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:15:02.133758 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e28db3cd-0a33-4619-bd4f-add8f14b2f28 req-0d0a2a5d-0cb3-46bd-a403-840bddd1499e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:02.135289 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e28db3cd-0a33-4619-bd4f-add8f14b2f28 req-0d0a2a5d-0cb3-46bd-a403-840bddd1499e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 944 time: 0.0552349 Feb 08 18:15:02.183932 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e28db3cd-0a33-4619-bd4f-add8f14b2f28 req-cbc49491-7f60-4817-b8fc-378adfd31ace tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428336 Feb 08 18:15:02.522899 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:15:02.581508 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:15:02.581877 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:02.657187 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:15:02.657487 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:02.679791 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:15:02.681969 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8a29150d-41b6-4318-a5a6-fb2913fbe815" -d '{"events": [{"server_uuid": "75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5", "name": "network-vif-plugged", "status": "completed", "tag": "2f2d1cfd-91ec-450a-bfe2-52d21f9196e8"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:15:02.697314 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:15:02.703747 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:02.727380 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:15:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-33ff1bbb-158e-4cd6-865d-e413f9c18bd9 x-openstack-request-id: req-33ff1bbb-158e-4cd6-865d-e413f9c18bd9 {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:15:02.727673 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5", "name": "network-vif-plugged", "status": "completed", "tag": "2f2d1cfd-91ec-450a-bfe2-52d21f9196e8", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:15:02.727941 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-33ff1bbb-158e-4cd6-865d-e413f9c18bd9 {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:15:02.728279 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8', 'code': 200} Feb 08 18:15:02.756554 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8,revision_number=10']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:03.391469 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-031d4466-7034-488d-a17d-9070359feba7 req-89ca1280-0c24-4a26-adff-78f5a6249eb6 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:03.392953 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-031d4466-7034-488d-a17d-9070359feba7 req-89ca1280-0c24-4a26-adff-78f5a6249eb6 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 946 time: 0.0905268 Feb 08 18:15:03.395464 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ae034a0-26de-44f8-b1fe-16e75b1f3889 req-91a65a57-6f37-45ea-a4ec-1a54c813b863 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:03.396790 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6ae034a0-26de-44f8-b1fe-16e75b1f3889 req-91a65a57-6f37-45ea-a4ec-1a54c813b863 service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 1130 time: 0.0665979 Feb 08 18:15:03.458020 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-031d4466-7034-488d-a17d-9070359feba7 req-a4d7debf-12c7-4390-98d3-e2b2950ef776 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0590854 Feb 08 18:15:03.472609 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6ae034a0-26de-44f8-b1fe-16e75b1f3889 req-6663bdd7-dcca-4ee4-95af-10ebaa83408f service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0575433 Feb 08 18:15:04.590439 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-720dce08-4bb6-427c-bc1b-d3e3f40caf79 req-17a9b7e8-ca76-48f9-ba42-8cca101b2ece tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:04.591845 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-720dce08-4bb6-427c-bc1b-d3e3f40caf79 req-17a9b7e8-ca76-48f9-ba42-8cca101b2ece tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 946 time: 0.0602667 Feb 08 18:15:04.640000 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-720dce08-4bb6-427c-bc1b-d3e3f40caf79 req-805f67d2-4831-4de8-b0ba-8c1bd3d78b84 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0397146 Feb 08 18:15:05.778284 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e453a9e2-f375-4aaa-9e56-0d6cced8bf18 req-cb12c281-4e89-4f1d-99c3-20d389429349 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:05.780802 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e453a9e2-f375-4aaa-9e56-0d6cced8bf18 req-cb12c281-4e89-4f1d-99c3-20d389429349 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 946 time: 0.0670159 Feb 08 18:15:05.829297 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e453a9e2-f375-4aaa-9e56-0d6cced8bf18 req-7abef00b-2079-422a-b1bb-32317881e6be tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419378 Feb 08 18:15:06.772389 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b07544d-5afe-4055-8957-15b839ab4005 req-cea29471-2cc6-4dd6-b70a-192692078313 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:06.774028 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0b07544d-5afe-4055-8957-15b839ab4005 req-cea29471-2cc6-4dd6-b70a-192692078313 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 945 time: 0.0578527 Feb 08 18:15:06.826180 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0b07544d-5afe-4055-8957-15b839ab4005 req-f7caad0f-e3fd-4839-91c9-20b98a93eff4 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451219 Feb 08 18:15:06.867331 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afd32499-81c4-487b-bfe4-e24f619c185c req-5f42ae08-895c-4582-8d00-e9bffa44caf8 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:06.868802 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-afd32499-81c4-487b-bfe4-e24f619c185c req-5f42ae08-895c-4582-8d00-e9bffa44caf8 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0510573 Feb 08 18:15:06.918326 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-afd32499-81c4-487b-bfe4-e24f619c185c req-957b7fa0-34a9-4c35-86dc-8603ade4e7ce tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0435340 Feb 08 18:15:06.953063 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06b7c022-f947-4f68-9201-07a1f2c0c602 req-54f81027-7895-4491-b372-51cb9b460267 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:06.954555 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-06b7c022-f947-4f68-9201-07a1f2c0c602 req-54f81027-7895-4491-b372-51cb9b460267 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 946 time: 0.0523610 Feb 08 18:15:07.001513 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-06b7c022-f947-4f68-9201-07a1f2c0c602 req-b1660e3b-d8da-4e0d-b596-411cef5ebe58 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412235 Feb 08 18:15:07.960397 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11c0337a-7fc6-438f-bf57-3faa6d0943af req-e1a42484-7225-4993-9f32-f6de2383f1a1 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:07.961874 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-11c0337a-7fc6-438f-bf57-3faa6d0943af req-e1a42484-7225-4993-9f32-f6de2383f1a1 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 945 time: 0.0554466 Feb 08 18:15:07.978521 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:15:08.008905 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-11c0337a-7fc6-438f-bf57-3faa6d0943af req-0f4f9fea-6646-4bec-8282-c226bee40d0f tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0411940 Feb 08 18:15:08.041868 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29e44896-b9da-4287-b0c3-b8007f368d94 req-83af7838-3189-412e-88cb-3f4cf552a0b5 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:08.043437 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-29e44896-b9da-4287-b0c3-b8007f368d94 req-83af7838-3189-412e-88cb-3f4cf552a0b5 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0574729 Feb 08 18:15:08.091154 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-29e44896-b9da-4287-b0c3-b8007f368d94 req-96aafd59-a51c-4814-851d-5efc3b887684 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419178 Feb 08 18:15:08.977368 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b78029d-56cb-489b-ae7a-023d3bb91141 req-161d07f0-e1d4-4ca3-9d03-5c9a26dbd9b2 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:08.978870 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2b78029d-56cb-489b-ae7a-023d3bb91141 req-161d07f0-e1d4-4ca3-9d03-5c9a26dbd9b2 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.109 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 945 time: 0.0678024 Feb 08 18:15:09.129443 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2e09623-1d1a-4695-a17e-d8ea4db2a5c3 req-6a0a46c9-427b-46ef-bcd2-7034813d2b27 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:09.135266 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d2e09623-1d1a-4695-a17e-d8ea4db2a5c3 req-6a0a46c9-427b-46ef-bcd2-7034813d2b27 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 945 time: 0.0573890 Feb 08 18:15:09.137758 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [req-2b78029d-56cb-489b-ae7a-023d3bb91141 req-8e28158a-0cbc-42d4-8ebe-1730ec1f09c6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Deleting port ea47f272-34ce-4df1-b42c-009ad5f91a31 {{(pid=102559) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:15:09.138262 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-2b78029d-56cb-489b-ae7a-023d3bb91141 req-8e28158a-0cbc-42d4-8ebe-1730ec1f09c6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (ea47f272-34ce-4df1-b42c-009ad5f91a31), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:09.178812 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d2e09623-1d1a-4695-a17e-d8ea4db2a5c3 req-a5a3597e-67f1-4be4-98dd-e7bfdcf6b38f tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422528 Feb 08 18:15:09.259311 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-2b78029d-56cb-489b-ae7a-023d3bb91141 req-8e28158a-0cbc-42d4-8ebe-1730ec1f09c6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] For port ea47f272-34ce-4df1-b42c-009ad5f91a31, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=ea47f272-34ce-4df1-b42c-009ad5f91a31,segment=NetworkSegment(acdb31ea-e529-495f-b01f-8c3d7b96781f),segment_id=acdb31ea-e529-495f-b01f-8c3d7b96781f)] {{(pid=102559) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:15:09.259566 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-2b78029d-56cb-489b-ae7a-023d3bb91141 req-8e28158a-0cbc-42d4-8ebe-1730ec1f09c6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (ea47f272-34ce-4df1-b42c-009ad5f91a31), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:09.268034 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e90501aa-5db6-41a5-b535-637ac7d2ded0 req-c95c463b-2809-4838-86de-c56f9263b848 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:09.269529 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e90501aa-5db6-41a5-b535-637ac7d2ded0 req-c95c463b-2809-4838-86de-c56f9263b848 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0909839 Feb 08 18:15:09.290973 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [req-2b78029d-56cb-489b-ae7a-023d3bb91141 req-8e28158a-0cbc-42d4-8ebe-1730ec1f09c6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Calling delete_port for ea47f272-34ce-4df1-b42c-009ad5f91a31 owned by compute:nova {{(pid=102559) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:15:09.402880 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e90501aa-5db6-41a5-b535-637ac7d2ded0 req-8a88e411-037b-4c9f-a3e9-f1024b07d2b2 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1276922 Feb 08 18:15:09.489624 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-2b78029d-56cb-489b-ae7a-023d3bb91141 req-8e28158a-0cbc-42d4-8ebe-1730ec1f09c6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442'] for port (ea47f272-34ce-4df1-b42c-009ad5f91a31), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:09.504659 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['5676d44a-8ef0-472a-9703-1a68bebb5ad4', '58368d01-b8e8-4efd-b4a1-c88b7cdc4771', '0e17ac77-e9a3-4c18-9145-3f139aa468e9', 'ea47f272-34ce-4df1-b42c-009ad5f91a31'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:15:09.528278 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8e28158a-0cbc-42d4-8ebe-1730ec1f09c6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Pushing event deleted for resources: {'Port': ['ID=ea47f272-34ce-4df1-b42c-009ad5f91a31,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:09.588246 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [req-2b78029d-56cb-489b-ae7a-023d3bb91141 req-8e28158a-0cbc-42d4-8ebe-1730ec1f09c6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] No DVR routers for this DVR port ea47f272-34ce-4df1-b42c-009ad5f91a31 on host hv-cinder-77398 {{(pid=102559) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:15:09.591504 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-2b78029d-56cb-489b-ae7a-023d3bb91141 req-8e28158a-0cbc-42d4-8ebe-1730ec1f09c6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:09.594868 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2b78029d-56cb-489b-ae7a-023d3bb91141 req-8e28158a-0cbc-42d4-8ebe-1730ec1f09c6 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.109 "DELETE /v2.0/ports/ea47f272-34ce-4df1-b42c-009ad5f91a31 HTTP/1.1" status: 204 len: 173 time: 0.6095905 Feb 08 18:15:09.595327 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '963f7229-2841-485f-98f9-64722824a6df', 'name': 'network-vif-deleted', 'tag': 'ea47f272-34ce-4df1-b42c-009ad5f91a31'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:15:09.597660 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4de7919c-8715-455c-b5e8-27c04b600dac" -d '{"events": [{"server_uuid": "963f7229-2841-485f-98f9-64722824a6df", "name": "network-vif-deleted", "tag": "ea47f272-34ce-4df1-b42c-009ad5f91a31"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:15:09.637790 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:15:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7ba59302-73d3-4b2b-914b-75c476ead024 x-openstack-request-id: req-7ba59302-73d3-4b2b-914b-75c476ead024 {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:15:09.638077 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "963f7229-2841-485f-98f9-64722824a6df", "name": "network-vif-deleted", "tag": "ea47f272-34ce-4df1-b42c-009ad5f91a31", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:15:09.638456 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-7ba59302-73d3-4b2b-914b-75c476ead024 {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:15:09.639162 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '963f7229-2841-485f-98f9-64722824a6df', 'name': 'network-vif-deleted', 'tag': 'ea47f272-34ce-4df1-b42c-009ad5f91a31', 'status': 'completed', 'code': 200} Feb 08 18:15:10.189781 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca04934b-1d59-4c06-b036-d5476b37479b req-fefcfb36-cf1a-41fc-ba97-7f5f76d53b85 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:10.191286 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ca04934b-1d59-4c06-b036-d5476b37479b req-fefcfb36-cf1a-41fc-ba97-7f5f76d53b85 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.109 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0588975 Feb 08 18:15:10.300232 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-86393186-8d1b-4bb3-b399-03a2dbd245b0 req-66e793f7-f3e5-48ae-9895-48cf2432067f tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=963f7229-2841-485f-98f9-64722824a6df HTTP/1.1" status: 200 len: 210 time: 0.0288975 Feb 08 18:15:10.326673 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [req-ca04934b-1d59-4c06-b036-d5476b37479b req-83950a94-7e00-4364-9b5b-b766ad47bf69 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Deleting port 062ed5c0-df28-461b-87fe-826944e42c54 {{(pid=102559) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:15:10.327044 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-ca04934b-1d59-4c06-b036-d5476b37479b req-83950a94-7e00-4364-9b5b-b766ad47bf69 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (062ed5c0-df28-461b-87fe-826944e42c54), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:10.415534 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-ca04934b-1d59-4c06-b036-d5476b37479b req-83950a94-7e00-4364-9b5b-b766ad47bf69 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] For port 062ed5c0-df28-461b-87fe-826944e42c54, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=062ed5c0-df28-461b-87fe-826944e42c54,segment=NetworkSegment(7e36cc20-402b-47f5-9242-a15d0de4717c),segment_id=7e36cc20-402b-47f5-9242-a15d0de4717c)] {{(pid=102559) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:15:10.415903 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-ca04934b-1d59-4c06-b036-d5476b37479b req-83950a94-7e00-4364-9b5b-b766ad47bf69 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (062ed5c0-df28-461b-87fe-826944e42c54), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:10.428740 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [req-ca04934b-1d59-4c06-b036-d5476b37479b req-83950a94-7e00-4364-9b5b-b766ad47bf69 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Calling delete_port for 062ed5c0-df28-461b-87fe-826944e42c54 owned by compute:nova {{(pid=102559) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:15:10.525082 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc835c8e-8200-491d-968c-297a7d50bca1 req-2bd4f90d-e2b7-40f4-8a49-7e27f6b27da3 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:10.527412 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-cc835c8e-8200-491d-968c-297a7d50bca1 req-2bd4f90d-e2b7-40f4-8a49-7e27f6b27da3 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=eb0ad33a-c04e-4d37-ab65-6b2bd025791d HTTP/1.1" status: 200 len: 945 time: 0.0568452 Feb 08 18:15:10.551217 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-ca04934b-1d59-4c06-b036-d5476b37479b req-83950a94-7e00-4364-9b5b-b766ad47bf69 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442'] for port (062ed5c0-df28-461b-87fe-826944e42c54), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:10.565132 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['f63fc38b-d10b-4316-b77f-d1816d07ca90', '062ed5c0-df28-461b-87fe-826944e42c54'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:15:10.577328 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-cc835c8e-8200-491d-968c-297a7d50bca1 req-f76f8f84-8386-4768-9fe8-d7b4eb9a4077 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0436456 Feb 08 18:15:10.582561 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83950a94-7e00-4364-9b5b-b766ad47bf69 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Pushing event deleted for resources: {'Port': ['ID=062ed5c0-df28-461b-87fe-826944e42c54,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:10.623956 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [req-ca04934b-1d59-4c06-b036-d5476b37479b req-83950a94-7e00-4364-9b5b-b766ad47bf69 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] No DVR routers for this DVR port 062ed5c0-df28-461b-87fe-826944e42c54 on host hv-cinder-77398 {{(pid=102559) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:15:10.627086 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-ca04934b-1d59-4c06-b036-d5476b37479b req-83950a94-7e00-4364-9b5b-b766ad47bf69 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:10.630509 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ca04934b-1d59-4c06-b036-d5476b37479b req-83950a94-7e00-4364-9b5b-b766ad47bf69 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.109 "DELETE /v2.0/ports/062ed5c0-df28-461b-87fe-826944e42c54 HTTP/1.1" status: 204 len: 173 time: 0.4315455 Feb 08 18:15:11.640293 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'eb0ad33a-c04e-4d37-ab65-6b2bd025791d', 'name': 'network-vif-deleted', 'tag': '062ed5c0-df28-461b-87fe-826944e42c54'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:15:11.642703 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7348c28c-8e9f-46f9-9cf2-8e0a962e94dc" -d '{"events": [{"server_uuid": "eb0ad33a-c04e-4d37-ab65-6b2bd025791d", "name": "network-vif-deleted", "tag": "062ed5c0-df28-461b-87fe-826944e42c54"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:15:11.677655 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:15:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-74f33c13-2a9b-4a8f-a7a3-17c8a270ed83 x-openstack-request-id: req-74f33c13-2a9b-4a8f-a7a3-17c8a270ed83 {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:15:11.678003 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "eb0ad33a-c04e-4d37-ab65-6b2bd025791d", "name": "network-vif-deleted", "tag": "062ed5c0-df28-461b-87fe-826944e42c54", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:15:11.678252 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-74f33c13-2a9b-4a8f-a7a3-17c8a270ed83 {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:15:11.678652 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'eb0ad33a-c04e-4d37-ab65-6b2bd025791d', 'name': 'network-vif-deleted', 'tag': '062ed5c0-df28-461b-87fe-826944e42c54', 'status': 'completed', 'code': 200} Feb 08 18:15:11.883896 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cca905a-319b-4d55-aa3d-0796b5dc7759 req-bff33f11-3772-438f-a10c-a411ccc01267 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:11.885272 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4cca905a-319b-4d55-aa3d-0796b5dc7759 req-bff33f11-3772-438f-a10c-a411ccc01267 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0563099 Feb 08 18:15:11.931326 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4cca905a-319b-4d55-aa3d-0796b5dc7759 req-d669974d-982e-421d-bd2d-8ae067a7de51 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402949 Feb 08 18:15:12.556546 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 062ed5c0-df28-461b-87fe-826944e42c54 no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:15:12.577854 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] No Port match for: 062ed5c0-df28-461b-87fe-826944e42c54 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:15:12.578194 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 062ed5c0-df28-461b-87fe-826944e42c54 not bound to the agent host hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:15:12.578610 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device ea47f272-34ce-4df1-b42c-009ad5f91a31 no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:15:12.602444 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] No Port match for: ea47f272-34ce-4df1-b42c-009ad5f91a31 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:15:12.602993 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device ea47f272-34ce-4df1-b42c-009ad5f91a31 not bound to the agent host hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:15:12.738724 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d90affe5-4a22-4bd5-bc62-b70f6146abfe req-8e2fa62a-bd47-44f0-b06a-e6324ba8029d tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:12.740141 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d90affe5-4a22-4bd5-bc62-b70f6146abfe req-8e2fa62a-bd47-44f0-b06a-e6324ba8029d tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=505d3a98-d004-47d4-9a5f-f3b39fa267a3 HTTP/1.1" status: 200 len: 946 time: 0.0623300 Feb 08 18:15:12.787867 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d90affe5-4a22-4bd5-bc62-b70f6146abfe req-dcbdbfc3-3d28-48dc-9a5b-9a748ac6b92a tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419757 Feb 08 18:15:13.065740 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ab3a50b-4522-402c-8f5e-8c2119057a7a req-950fcded-d337-491c-a752-04b5c75789e2 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:13.067212 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1ab3a50b-4522-402c-8f5e-8c2119057a7a req-950fcded-d337-491c-a752-04b5c75789e2 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0523999 Feb 08 18:15:13.111974 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1ab3a50b-4522-402c-8f5e-8c2119057a7a req-eea679c5-dedd-422d-889d-4a5cbcfbcc03 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0391533 Feb 08 18:15:13.907864 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59b212a2-2632-4614-86e3-a1908399b00c req-55e6ed5b-1e3b-4c77-98a4-ac13de0569a4 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:13.909329 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-59b212a2-2632-4614-86e3-a1908399b00c req-55e6ed5b-1e3b-4c77-98a4-ac13de0569a4 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=505d3a98-d004-47d4-9a5f-f3b39fa267a3 HTTP/1.1" status: 200 len: 946 time: 0.0538187 Feb 08 18:15:13.960545 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-59b212a2-2632-4614-86e3-a1908399b00c req-eef67e04-6774-4439-be4f-ea73e9b2e899 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427971 Feb 08 18:15:14.478195 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43e503be-8ff5-4692-b988-fa20e9c6c805 req-93e68690-52cd-4059-8a0b-71954a36c37b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:14.479735 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-43e503be-8ff5-4692-b988-fa20e9c6c805 req-93e68690-52cd-4059-8a0b-71954a36c37b tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.2971520 Feb 08 18:15:14.538275 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-43e503be-8ff5-4692-b988-fa20e9c6c805 req-546494d3-15a0-400d-8d72-99d31e52070e tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0507469 Feb 08 18:15:14.903986 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc236d3a-ec9e-4a2b-8d46-4a4bd0b89f96 req-7141a918-765f-49c8-84e8-990b39155c47 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:14.905373 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-dc236d3a-ec9e-4a2b-8d46-4a4bd0b89f96 req-7141a918-765f-49c8-84e8-990b39155c47 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.109 "GET /v2.0/ports?device_id=505d3a98-d004-47d4-9a5f-f3b39fa267a3 HTTP/1.1" status: 200 len: 946 time: 0.0630598 Feb 08 18:15:15.010500 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [req-dc236d3a-ec9e-4a2b-8d46-4a4bd0b89f96 req-b62b33a5-3d8f-41cc-9c9d-5c4c54105dee tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Deleting port 0e17ac77-e9a3-4c18-9145-3f139aa468e9 {{(pid=102559) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:15:15.010874 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-dc236d3a-ec9e-4a2b-8d46-4a4bd0b89f96 req-b62b33a5-3d8f-41cc-9c9d-5c4c54105dee tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (0e17ac77-e9a3-4c18-9145-3f139aa468e9), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:15.093556 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-873af99f-1c13-4861-970f-97506e1caa1c req-27376bf7-509d-4bb2-af8c-7becb04562db tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:15.095089 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-873af99f-1c13-4861-970f-97506e1caa1c req-27376bf7-509d-4bb2-af8c-7becb04562db tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=505d3a98-d004-47d4-9a5f-f3b39fa267a3 HTTP/1.1" status: 200 len: 946 time: 0.0549393 Feb 08 18:15:15.099937 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-dc236d3a-ec9e-4a2b-8d46-4a4bd0b89f96 req-b62b33a5-3d8f-41cc-9c9d-5c4c54105dee tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] For port 0e17ac77-e9a3-4c18-9145-3f139aa468e9, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=0e17ac77-e9a3-4c18-9145-3f139aa468e9,segment=NetworkSegment(acdb31ea-e529-495f-b01f-8c3d7b96781f),segment_id=acdb31ea-e529-495f-b01f-8c3d7b96781f)] {{(pid=102559) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:15:15.100309 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-dc236d3a-ec9e-4a2b-8d46-4a4bd0b89f96 req-b62b33a5-3d8f-41cc-9c9d-5c4c54105dee tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (0e17ac77-e9a3-4c18-9145-3f139aa468e9), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:15.113248 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [req-dc236d3a-ec9e-4a2b-8d46-4a4bd0b89f96 req-b62b33a5-3d8f-41cc-9c9d-5c4c54105dee tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Calling delete_port for 0e17ac77-e9a3-4c18-9145-3f139aa468e9 owned by compute:nova {{(pid=102559) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:15:15.146457 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-873af99f-1c13-4861-970f-97506e1caa1c req-3f64136d-7c55-4c51-9138-b272ac496eec tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0455461 Feb 08 18:15:15.242534 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-dc236d3a-ec9e-4a2b-8d46-4a4bd0b89f96 req-b62b33a5-3d8f-41cc-9c9d-5c4c54105dee tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442'] for port (0e17ac77-e9a3-4c18-9145-3f139aa468e9), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:15.261888 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['5676d44a-8ef0-472a-9703-1a68bebb5ad4', '58368d01-b8e8-4efd-b4a1-c88b7cdc4771', '0e17ac77-e9a3-4c18-9145-3f139aa468e9'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:15:15.272065 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b62b33a5-3d8f-41cc-9c9d-5c4c54105dee tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Pushing event deleted for resources: {'Port': ['ID=0e17ac77-e9a3-4c18-9145-3f139aa468e9,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:15.318884 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [req-dc236d3a-ec9e-4a2b-8d46-4a4bd0b89f96 req-b62b33a5-3d8f-41cc-9c9d-5c4c54105dee tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] No DVR routers for this DVR port 0e17ac77-e9a3-4c18-9145-3f139aa468e9 on host hv-cinder-77398 {{(pid=102559) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:15:15.321655 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-dc236d3a-ec9e-4a2b-8d46-4a4bd0b89f96 req-b62b33a5-3d8f-41cc-9c9d-5c4c54105dee tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:15.325429 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-dc236d3a-ec9e-4a2b-8d46-4a4bd0b89f96 req-b62b33a5-3d8f-41cc-9c9d-5c4c54105dee tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.109 "DELETE /v2.0/ports/0e17ac77-e9a3-4c18-9145-3f139aa468e9 HTTP/1.1" status: 204 len: 173 time: 0.4086339 Feb 08 18:15:15.325870 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '505d3a98-d004-47d4-9a5f-f3b39fa267a3', 'name': 'network-vif-deleted', 'tag': '0e17ac77-e9a3-4c18-9145-3f139aa468e9'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:15:15.328212 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b99b93df-433a-495c-a909-d0d4c94faab3" -d '{"events": [{"server_uuid": "505d3a98-d004-47d4-9a5f-f3b39fa267a3", "name": "network-vif-deleted", "tag": "0e17ac77-e9a3-4c18-9145-3f139aa468e9"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:15:15.366629 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:15:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aa4a8f9d-cf27-4b95-9f1f-334bc866ce0c x-openstack-request-id: req-aa4a8f9d-cf27-4b95-9f1f-334bc866ce0c {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:15:15.367030 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "505d3a98-d004-47d4-9a5f-f3b39fa267a3", "name": "network-vif-deleted", "tag": "0e17ac77-e9a3-4c18-9145-3f139aa468e9", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:15:15.367307 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-aa4a8f9d-cf27-4b95-9f1f-334bc866ce0c {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:15:15.367685 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '505d3a98-d004-47d4-9a5f-f3b39fa267a3', 'name': 'network-vif-deleted', 'tag': '0e17ac77-e9a3-4c18-9145-3f139aa468e9', 'status': 'completed', 'code': 200} Feb 08 18:15:15.386408 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-e2a96d48-45d4-450e-9575-7c6f14f25f10 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:15.666205 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de09cba9-e6aa-4794-8baa-1e9863102ab6 req-8d838611-c3f3-4a17-81bf-7aa10ce6bf46 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:15.667745 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-de09cba9-e6aa-4794-8baa-1e9863102ab6 req-8d838611-c3f3-4a17-81bf-7aa10ce6bf46 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0562606 Feb 08 18:15:15.715772 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-de09cba9-e6aa-4794-8baa-1e9863102ab6 req-a0cb969c-22c3-47d9-a33d-338285fda69e tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422385 Feb 08 18:15:16.454035 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc94a60e-1aa1-4af3-b58b-c79d2f98a38d req-68623ce3-13b8-4c13-acbf-a66c2c533efa tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:16.455476 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-bc94a60e-1aa1-4af3-b58b-c79d2f98a38d req-68623ce3-13b8-4c13-acbf-a66c2c533efa tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea HTTP/1.1" status: 200 len: 945 time: 0.0637033 Feb 08 18:15:16.503338 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-bc94a60e-1aa1-4af3-b58b-c79d2f98a38d req-55a6fc75-8c9a-464d-8636-6d075511c3b1 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416112 Feb 08 18:15:16.855675 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a8edf30-19e6-462e-bd5c-56191ef5b1a6 req-97230e3b-ec0f-4dcb-bbe8-f0cd8b668382 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:16.857142 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0a8edf30-19e6-462e-bd5c-56191ef5b1a6 req-97230e3b-ec0f-4dcb-bbe8-f0cd8b668382 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0661464 Feb 08 18:15:16.907037 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0a8edf30-19e6-462e-bd5c-56191ef5b1a6 req-41e721c7-a1af-48be-b9b3-99bf6cb4d309 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439386 Feb 08 18:15:17.632821 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e15af8b-f523-439a-82a7-e6631120d59b req-474da43b-474b-4eda-b43b-cf8793dd0f5b tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:17.634335 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0e15af8b-f523-439a-82a7-e6631120d59b req-474da43b-474b-4eda-b43b-cf8793dd0f5b tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea HTTP/1.1" status: 200 len: 945 time: 0.0555711 Feb 08 18:15:17.683217 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0e15af8b-f523-439a-82a7-e6631120d59b req-dcdf31bc-9b0a-4583-9f1e-b8c15014aab4 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427222 Feb 08 18:15:17.812462 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-7fda2dfb-b1e7-4a7b-93d7-93a4cd076585 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:17.829558 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3f4f0ebc-5d8b-48cc-af93-6e42ab20728f req-36d0b1d5-5252-495a-9733-9ed3494c5a3c service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0507336 Feb 08 18:15:17.906719 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f4f0ebc-5d8b-48cc-af93-6e42ab20728f req-eb0a4702-fff8-415f-b916-be7627cba068 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:17.908278 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3f4f0ebc-5d8b-48cc-af93-6e42ab20728f req-eb0a4702-fff8-415f-b916-be7627cba068 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=357dab3d3db74ef9a8ee50fdd8a8bdcd&device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 1130 time: 0.0460699 Feb 08 18:15:17.952285 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:18.034121 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36b30e9a-13eb-49fa-88e0-216b3231a09f req-5bffd66f-961c-49a7-8bae-e73c17df8f83 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:18.035691 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-36b30e9a-13eb-49fa-88e0-216b3231a09f req-5bffd66f-961c-49a7-8bae-e73c17df8f83 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0575452 Feb 08 18:15:18.067174 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f4f0ebc-5d8b-48cc-af93-6e42ab20728f req-127a064d-572d-4770-ba29-0e64177c36b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:18.068723 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3f4f0ebc-5d8b-48cc-af93-6e42ab20728f req-127a064d-572d-4770-ba29-0e64177c36b2 service neutron] 10.222.0.109 "GET /v2.0/networks?id=7a854399-3ce6-42bd-bfc4-061132ecb9c2 HTTP/1.1" status: 200 len: 918 time: 0.1045170 Feb 08 18:15:18.082067 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-36b30e9a-13eb-49fa-88e0-216b3231a09f req-66718b2e-8489-456e-9487-7b9738eb8c62 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/security-groups?id=3f13be41-fc10-4e73-b2e6-a6baad01d4aa&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403557 Feb 08 18:15:18.138106 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3f4f0ebc-5d8b-48cc-af93-6e42ab20728f req-a0c2c998-1430-4604-a9fd-083dbe8e5bad service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 HTTP/1.1" status: 200 len: 1001 time: 0.0622056 Feb 08 18:15:18.232973 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f4f0ebc-5d8b-48cc-af93-6e42ab20728f req-ca4ead65-0d96-4a61-ad80-c0836b74df1a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:18.234445 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3f4f0ebc-5d8b-48cc-af93-6e42ab20728f req-ca4ead65-0d96-4a61-ad80-c0836b74df1a service neutron] 10.222.0.109 "GET /v2.0/subnets?id=73de7865-d87d-4a2a-a702-160c400f145f HTTP/1.1" status: 200 len: 855 time: 0.0686092 Feb 08 18:15:18.251774 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-080198e6-f8f3-4928-b35b-ae3f079af0f1 req-2d12586a-ef7e-490b-b76a-a339b5ce3a02 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:18.253117 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-080198e6-f8f3-4928-b35b-ae3f079af0f1 req-2d12586a-ef7e-490b-b76a-a339b5ce3a02 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.109 "GET /v2.0/ports?device_id=126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea HTTP/1.1" status: 200 len: 945 time: 0.0799179 Feb 08 18:15:18.352245 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f4f0ebc-5d8b-48cc-af93-6e42ab20728f req-79bc51b7-1263-4e0f-9d19-99c6472bc801 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:18.353667 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3f4f0ebc-5d8b-48cc-af93-6e42ab20728f req-79bc51b7-1263-4e0f-9d19-99c6472bc801 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=7a854399-3ce6-42bd-bfc4-061132ecb9c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0997190 Feb 08 18:15:18.420876 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [req-080198e6-f8f3-4928-b35b-ae3f079af0f1 req-7bb2a561-136e-40d8-b6cb-94f8ad4011c7 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Deleting port 58368d01-b8e8-4efd-b4a1-c88b7cdc4771 {{(pid=102559) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:15:18.421188 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-080198e6-f8f3-4928-b35b-ae3f079af0f1 req-7bb2a561-136e-40d8-b6cb-94f8ad4011c7 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (58368d01-b8e8-4efd-b4a1-c88b7cdc4771), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:18.488370 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:18.517627 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3f4f0ebc-5d8b-48cc-af93-6e42ab20728f req-88e46dcd-4b2b-4e59-be62-ada42f149743 service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1475079 Feb 08 18:15:18.545261 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 0e17ac77-e9a3-4c18-9145-3f139aa468e9 no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:15:18.565898 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] No Port match for: 0e17ac77-e9a3-4c18-9145-3f139aa468e9 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:15:18.566243 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 0e17ac77-e9a3-4c18-9145-3f139aa468e9 not bound to the agent host hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:15:18.589704 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-080198e6-f8f3-4928-b35b-ae3f079af0f1 req-7bb2a561-136e-40d8-b6cb-94f8ad4011c7 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] For port 58368d01-b8e8-4efd-b4a1-c88b7cdc4771, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=58368d01-b8e8-4efd-b4a1-c88b7cdc4771,segment=NetworkSegment(acdb31ea-e529-495f-b01f-8c3d7b96781f),segment_id=acdb31ea-e529-495f-b01f-8c3d7b96781f)] {{(pid=102559) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:15:18.590083 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-080198e6-f8f3-4928-b35b-ae3f079af0f1 req-7bb2a561-136e-40d8-b6cb-94f8ad4011c7 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (58368d01-b8e8-4efd-b4a1-c88b7cdc4771), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:18.606025 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [req-080198e6-f8f3-4928-b35b-ae3f079af0f1 req-7bb2a561-136e-40d8-b6cb-94f8ad4011c7 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Calling delete_port for 58368d01-b8e8-4efd-b4a1-c88b7cdc4771 owned by compute:nova {{(pid=102559) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:15:18.692331 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ce9baf5-a448-4187-a8de-76ccd37b847f req-773c171e-1305-40f3-a732-7a9c4f4d7281 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:18.693789 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4ce9baf5-a448-4187-a8de-76ccd37b847f req-773c171e-1305-40f3-a732-7a9c4f4d7281 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.109 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 946 time: 0.0548491 Feb 08 18:15:18.705357 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3f4f0ebc-5d8b-48cc-af93-6e42ab20728f req-8c769abf-91d4-4964-bcac-eaaf68f060cc service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1815302 Feb 08 18:15:18.819437 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-4ce9baf5-a448-4187-a8de-76ccd37b847f req-88e8205c-b475-486f-9c5d-188a3d6519e6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Deleting port f63fc38b-d10b-4316-b77f-d1816d07ca90 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:15:18.819879 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-4ce9baf5-a448-4187-a8de-76ccd37b847f req-88e8205c-b475-486f-9c5d-188a3d6519e6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (f63fc38b-d10b-4316-b77f-d1816d07ca90), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:18.842353 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-080198e6-f8f3-4928-b35b-ae3f079af0f1 req-7bb2a561-136e-40d8-b6cb-94f8ad4011c7 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442'] for port (58368d01-b8e8-4efd-b4a1-c88b7cdc4771), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:18.856130 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['5676d44a-8ef0-472a-9703-1a68bebb5ad4', '58368d01-b8e8-4efd-b4a1-c88b7cdc4771'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:15:18.875946 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bb2a561-136e-40d8-b6cb-94f8ad4011c7 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Pushing event deleted for resources: {'Port': ['ID=58368d01-b8e8-4efd-b4a1-c88b7cdc4771,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:18.891795 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0653c8b-11d2-4692-9cab-8ef4c4c4ada2 req-08746700-1091-4a6d-9a08-2f06a5ddc164 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:18.895947 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e0653c8b-11d2-4692-9cab-8ef4c4c4ada2 req-08746700-1091-4a6d-9a08-2f06a5ddc164 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea HTTP/1.1" status: 200 len: 945 time: 0.1086409 Feb 08 18:15:18.932999 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-4ce9baf5-a448-4187-a8de-76ccd37b847f req-88e8205c-b475-486f-9c5d-188a3d6519e6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] For port f63fc38b-d10b-4316-b77f-d1816d07ca90, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=f63fc38b-d10b-4316-b77f-d1816d07ca90,segment=NetworkSegment(7e36cc20-402b-47f5-9242-a15d0de4717c),segment_id=7e36cc20-402b-47f5-9242-a15d0de4717c)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:15:18.933412 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-4ce9baf5-a448-4187-a8de-76ccd37b847f req-88e8205c-b475-486f-9c5d-188a3d6519e6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (f63fc38b-d10b-4316-b77f-d1816d07ca90), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:18.948472 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [req-080198e6-f8f3-4928-b35b-ae3f079af0f1 req-7bb2a561-136e-40d8-b6cb-94f8ad4011c7 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] No DVR routers for this DVR port 58368d01-b8e8-4efd-b4a1-c88b7cdc4771 on host hv-cinder-77398 {{(pid=102559) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:15:18.951222 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-080198e6-f8f3-4928-b35b-ae3f079af0f1 req-7bb2a561-136e-40d8-b6cb-94f8ad4011c7 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:18.951913 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-4ce9baf5-a448-4187-a8de-76ccd37b847f req-88e8205c-b475-486f-9c5d-188a3d6519e6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Calling delete_port for f63fc38b-d10b-4316-b77f-d1816d07ca90 owned by compute:nova {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:15:18.954895 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-080198e6-f8f3-4928-b35b-ae3f079af0f1 req-7bb2a561-136e-40d8-b6cb-94f8ad4011c7 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.109 "DELETE /v2.0/ports/58368d01-b8e8-4efd-b4a1-c88b7cdc4771 HTTP/1.1" status: 204 len: 173 time: 0.6934919 Feb 08 18:15:18.956517 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea', 'name': 'network-vif-deleted', 'tag': '58368d01-b8e8-4efd-b4a1-c88b7cdc4771'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:15:18.960060 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9e0c9523-e37c-42cc-8cd6-2438931834ff" -d '{"events": [{"server_uuid": "126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea", "name": "network-vif-deleted", "tag": "58368d01-b8e8-4efd-b4a1-c88b7cdc4771"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:15:19.010679 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e0653c8b-11d2-4692-9cab-8ef4c4c4ada2 req-9d7f28b6-7268-4417-9663-be61eca7a6c9 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1066756 Feb 08 18:15:19.024567 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:15:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b3fa6d89-3d08-46a2-bff0-e3001018fdfe x-openstack-request-id: req-b3fa6d89-3d08-46a2-bff0-e3001018fdfe {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:15:19.024567 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea", "name": "network-vif-deleted", "tag": "58368d01-b8e8-4efd-b4a1-c88b7cdc4771", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:15:19.024567 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-b3fa6d89-3d08-46a2-bff0-e3001018fdfe {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:15:19.024870 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '126c8ffd-cd3a-4b4b-9e42-0d5045d2ddea', 'name': 'network-vif-deleted', 'tag': '58368d01-b8e8-4efd-b4a1-c88b7cdc4771', 'status': 'completed', 'code': 200} Feb 08 18:15:19.137650 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-4ce9baf5-a448-4187-a8de-76ccd37b847f req-88e8205c-b475-486f-9c5d-188a3d6519e6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (f63fc38b-d10b-4316-b77f-d1816d07ca90), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:19.152259 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['f63fc38b-d10b-4316-b77f-d1816d07ca90'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:15:19.174746 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-88e8205c-b475-486f-9c5d-188a3d6519e6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Pushing event deleted for resources: {'Port': ['ID=f63fc38b-d10b-4316-b77f-d1816d07ca90,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:19.202943 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e8205c-b475-486f-9c5d-188a3d6519e6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:19.203617 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e8205c-b475-486f-9c5d-188a3d6519e6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:19.204487 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e8205c-b475-486f-9c5d-188a3d6519e6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:19.205146 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e8205c-b475-486f-9c5d-188a3d6519e6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:19.205802 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e8205c-b475-486f-9c5d-188a3d6519e6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:19.206301 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e8205c-b475-486f-9c5d-188a3d6519e6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:19.206955 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e8205c-b475-486f-9c5d-188a3d6519e6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:19.207578 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e8205c-b475-486f-9c5d-188a3d6519e6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:19.208043 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d451da0c-3e0a-4f98-b56a-6f405953e559 req-576678df-8975-42fa-901c-65ba21f6a4d1 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.118 "GET /v2.0/ports?device_id=3eb2132b-01b1-4916-84eb-81ab88bcfc6d HTTP/1.1" status: 200 len: 210 time: 0.0415704 Feb 08 18:15:19.208195 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e8205c-b475-486f-9c5d-188a3d6519e6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:19.208673 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e8205c-b475-486f-9c5d-188a3d6519e6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:19.209148 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e8205c-b475-486f-9c5d-188a3d6519e6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:19.209662 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e8205c-b475-486f-9c5d-188a3d6519e6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:19.210267 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-88e8205c-b475-486f-9c5d-188a3d6519e6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:19.254173 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [req-4ce9baf5-a448-4187-a8de-76ccd37b847f req-88e8205c-b475-486f-9c5d-188a3d6519e6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] No DVR routers for this DVR port f63fc38b-d10b-4316-b77f-d1816d07ca90 on host hv-cinder-77398 {{(pid=102560) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:15:19.258232 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-4ce9baf5-a448-4187-a8de-76ccd37b847f req-88e8205c-b475-486f-9c5d-188a3d6519e6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:19.262055 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4ce9baf5-a448-4187-a8de-76ccd37b847f req-88e8205c-b475-486f-9c5d-188a3d6519e6 tempest-ServerRescueNegativeTestJSON-22597108 tempest-ServerRescueNegativeTestJSON-22597108-project] 10.222.0.109 "DELETE /v2.0/ports/f63fc38b-d10b-4316-b77f-d1816d07ca90 HTTP/1.1" status: 204 len: 173 time: 0.5624046 Feb 08 18:15:19.262517 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3eb2132b-01b1-4916-84eb-81ab88bcfc6d', 'name': 'network-vif-deleted', 'tag': 'f63fc38b-d10b-4316-b77f-d1816d07ca90'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:15:19.267422 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-21f28fed-ba87-4936-87b1-d5068495be7c" -d '{"events": [{"server_uuid": "3eb2132b-01b1-4916-84eb-81ab88bcfc6d", "name": "network-vif-deleted", "tag": "f63fc38b-d10b-4316-b77f-d1816d07ca90"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:15:19.326480 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:15:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5baa05da-d1ac-449a-9b3b-990aabf8a367 x-openstack-request-id: req-5baa05da-d1ac-449a-9b3b-990aabf8a367 {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:15:19.326898 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3eb2132b-01b1-4916-84eb-81ab88bcfc6d", "name": "network-vif-deleted", "tag": "f63fc38b-d10b-4316-b77f-d1816d07ca90", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:15:19.327848 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-5baa05da-d1ac-449a-9b3b-990aabf8a367 {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:15:19.328277 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3eb2132b-01b1-4916-84eb-81ab88bcfc6d', 'name': 'network-vif-deleted', 'tag': 'f63fc38b-d10b-4316-b77f-d1816d07ca90', 'status': 'completed', 'code': 200} Feb 08 18:15:20.094199 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:20.258912 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 39768) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:20.660887 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e3e4508-02b2-48dd-9caa-50d28f995024 req-15ae6098-4e16-4cf8-b596-39f2ee60864e tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:20.663427 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8e3e4508-02b2-48dd-9caa-50d28f995024 req-15ae6098-4e16-4cf8-b596-39f2ee60864e tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0589378 Feb 08 18:15:20.714988 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8e3e4508-02b2-48dd-9caa-50d28f995024 req-6863164e-c370-4366-8731-6f63bf967686 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434194 Feb 08 18:15:20.922141 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3629e927-69fc-4908-8caf-a322145d8547 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-559978'] for router_interface (751d5daa-7864-4c4e-a90b-e2428fafc279), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:21.212550 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-3629e927-69fc-4908-8caf-a322145d8547 admin admin] Deleting port f7548915-8b6b-47ac-982b-ba931ac61b22 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:15:21.212890 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3629e927-69fc-4908-8caf-a322145d8547 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (f7548915-8b6b-47ac-982b-ba931ac61b22), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:21.292122 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [None req-3629e927-69fc-4908-8caf-a322145d8547 admin admin] For port f7548915-8b6b-47ac-982b-ba931ac61b22, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=f7548915-8b6b-47ac-982b-ba931ac61b22,segment=NetworkSegment(7e36cc20-402b-47f5-9242-a15d0de4717c),segment_id=7e36cc20-402b-47f5-9242-a15d0de4717c)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:15:21.292842 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3629e927-69fc-4908-8caf-a322145d8547 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (f7548915-8b6b-47ac-982b-ba931ac61b22), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:21.308417 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-3629e927-69fc-4908-8caf-a322145d8547 admin admin] Calling delete_port for f7548915-8b6b-47ac-982b-ba931ac61b22 owned by network:router_interface {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:15:21.429783 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8733e4cd-eaa7-4b9d-bb02-1434fdb21bea req-4ad9a226-1d39-4ecb-a8bb-8dfbc062ac51 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:21.431524 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8733e4cd-eaa7-4b9d-bb02-1434fdb21bea req-4ad9a226-1d39-4ecb-a8bb-8dfbc062ac51 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=d2fb9a58-8375-440e-8e25-2a60d637eb7a HTTP/1.1" status: 200 len: 945 time: 0.0583813 Feb 08 18:15:21.478064 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8733e4cd-eaa7-4b9d-bb02-1434fdb21bea req-7c544047-ceab-4748-bac1-e5251d7d4b39 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405984 Feb 08 18:15:21.495472 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3629e927-69fc-4908-8caf-a322145d8547 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (f7548915-8b6b-47ac-982b-ba931ac61b22), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:21.519689 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3629e927-69fc-4908-8caf-a322145d8547 admin admin] Pushing event deleted for resources: {'Port': ['ID=f7548915-8b6b-47ac-982b-ba931ac61b22,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:21.667117 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:21.682528 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3629e927-69fc-4908-8caf-a322145d8547 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-631690', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-560126'] for router_interface (751d5daa-7864-4c4e-a90b-e2428fafc279), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:21.911234 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c846f945-e034-4011-86aa-2281880ee70c req-5892e111-08de-47dc-90f2-fb8204adad26 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:21.913050 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c846f945-e034-4011-86aa-2281880ee70c req-5892e111-08de-47dc-90f2-fb8204adad26 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.1265285 Feb 08 18:15:21.962184 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3629e927-69fc-4908-8caf-a322145d8547 admin admin] Router 751d5daa-7864-4c4e-a90b-e2428fafc279 has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:15:21.999483 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c846f945-e034-4011-86aa-2281880ee70c req-7e8c7439-e516-4498-8e82-c6d191359c47 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0796080 Feb 08 18:15:22.101212 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3629e927-69fc-4908-8caf-a322145d8547 admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:15:22.107141 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-3629e927-69fc-4908-8caf-a322145d8547 admin admin] 10.222.0.118 "PUT /v2.0/routers/751d5daa-7864-4c4e-a90b-e2428fafc279/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8470838 Feb 08 18:15:22.109526 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 39784) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:22.110340 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d13183f6-12bf-47c3-ba9a-d68b640428ff None None] Sync routers for ids ['751d5daa-7864-4c4e-a90b-e2428fafc279'] in dv-cinder-773985-21-iscsi {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:15:22.120754 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d13183f6-12bf-47c3-ba9a-d68b640428ff None None] Routers {'751d5daa-7864-4c4e-a90b-e2428fafc279'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:15:22.121359 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-d13183f6-12bf-47c3-ba9a-d68b640428ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:15:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['751d5daa-7864-4c4e-a90b-e2428fafc279'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:15:22.211979 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3366dfa7-1916-413f-b5d9-3c4692dd675d admin admin] Publish callbacks [] for router (751d5daa-7864-4c4e-a90b-e2428fafc279), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:22.227001 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-d13183f6-12bf-47c3-ba9a-d68b640428ff None None] Set router 751d5daa-7864-4c4e-a90b-e2428fafc279 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:15:22.319832 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3366dfa7-1916-413f-b5d9-3c4692dd675d admin admin] Publish callbacks [] for router_gateway (751d5daa-7864-4c4e-a90b-e2428fafc279), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:22.416819 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-d13183f6-12bf-47c3-ba9a-d68b640428ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '751d5daa-7864-4c4e-a90b-e2428fafc279', 'name': 'tempest-ServerRescueNegativeTestJSON-1610510663-router', 'tenant_id': '3fb51fc0e23f4c66a482d4d406197299', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.140'}], 'enable_snat': True}, 'gw_port_id': 'af462b70-3112-405d-a84b-10c4370a9bbe', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:08Z', 'updated_at': '2022-02-08T18:15:21Z', 'revision_number': 5, 'project_id': '3fb51fc0e23f4c66a482d4d406197299', 'gw_port': {'id': 'af462b70-3112-405d-a84b-10c4370a9bbe', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:14:c7:f7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '751d5daa-7864-4c4e-a90b-e2428fafc279', 'device_owner': 'network:router_gateway', 'standard_attr_id': 64, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.140', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:09Z', 'updated_at': '2022-02-08T18:12:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:15:22.444173 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d13183f6-12bf-47c3-ba9a-d68b640428ff None None] Checking router: 751d5daa-7864-4c4e-a90b-e2428fafc279 for host: dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:15:22.453231 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d13183f6-12bf-47c3-ba9a-d68b640428ff None None] Routers {'751d5daa-7864-4c4e-a90b-e2428fafc279'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:15:22.453839 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-d13183f6-12bf-47c3-ba9a-d68b640428ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:15:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['751d5daa-7864-4c4e-a90b-e2428fafc279'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:15:22.542321 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-d13183f6-12bf-47c3-ba9a-d68b640428ff None None] Set router 751d5daa-7864-4c4e-a90b-e2428fafc279 gateway port host: None {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:15:22.560113 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device f63fc38b-d10b-4316-b77f-d1816d07ca90 no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:15:22.583229 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] No Port match for: f63fc38b-d10b-4316-b77f-d1816d07ca90 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:15:22.584329 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device f63fc38b-d10b-4316-b77f-d1816d07ca90 not bound to the agent host hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:15:22.585189 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 58368d01-b8e8-4efd-b4a1-c88b7cdc4771 no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:15:22.605750 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e06b7293-708f-422c-bbad-6116e27ac387 req-9c91ce9a-51b4-4a8f-a9ab-2dffc33a7e70 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:22.609408 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] No Port match for: 58368d01-b8e8-4efd-b4a1-c88b7cdc4771 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:15:22.610025 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 58368d01-b8e8-4efd-b4a1-c88b7cdc4771 not bound to the agent host hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:15:22.612292 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-d13183f6-12bf-47c3-ba9a-d68b640428ff None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '751d5daa-7864-4c4e-a90b-e2428fafc279', 'name': 'tempest-ServerRescueNegativeTestJSON-1610510663-router', 'tenant_id': '3fb51fc0e23f4c66a482d4d406197299', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:08Z', 'updated_at': '2022-02-08T18:15:22Z', 'revision_number': 6, 'project_id': '3fb51fc0e23f4c66a482d4d406197299', 'gw_port_host': None}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:15:22.612833 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e06b7293-708f-422c-bbad-6116e27ac387 req-9c91ce9a-51b4-4a8f-a9ab-2dffc33a7e70 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=d2fb9a58-8375-440e-8e25-2a60d637eb7a HTTP/1.1" status: 200 len: 945 time: 0.0612471 Feb 08 18:15:22.612979 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-3366dfa7-1916-413f-b5d9-3c4692dd675d admin admin] Deleting port af462b70-3112-405d-a84b-10c4370a9bbe {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:15:22.613313 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3366dfa7-1916-413f-b5d9-3c4692dd675d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (af462b70-3112-405d-a84b-10c4370a9bbe), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:22.665986 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e06b7293-708f-422c-bbad-6116e27ac387 req-9c927a08-f7ef-4e03-890a-05d2b415979e tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/security-groups?id=ee26d93a-0e97-42a4-942d-86acae001415&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0522897 Feb 08 18:15:22.693371 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [None req-3366dfa7-1916-413f-b5d9-3c4692dd675d admin admin] For port af462b70-3112-405d-a84b-10c4370a9bbe, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=af462b70-3112-405d-a84b-10c4370a9bbe,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:15:22.693733 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3366dfa7-1916-413f-b5d9-3c4692dd675d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (af462b70-3112-405d-a84b-10c4370a9bbe), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:22.706894 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-3366dfa7-1916-413f-b5d9-3c4692dd675d admin admin] Calling delete_port for af462b70-3112-405d-a84b-10c4370a9bbe owned by network:router_gateway {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:15:22.731333 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d13183f6-12bf-47c3-ba9a-d68b640428ff None None] The sync data for ids ['751d5daa-7864-4c4e-a90b-e2428fafc279'] in dv-cinder-773985-21-iscsi is: [{'id': '751d5daa-7864-4c4e-a90b-e2428fafc279', 'name': 'tempest-ServerRescueNegativeTestJSON-1610510663-router', 'tenant_id': '3fb51fc0e23f4c66a482d4d406197299', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:08Z', 'updated_at': '2022-02-08T18:15:22Z', 'revision_number': 6, 'project_id': '3fb51fc0e23f4c66a482d4d406197299', 'gw_port_host': None}] {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:15:22.872797 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3366dfa7-1916-413f-b5d9-3c4692dd675d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (af462b70-3112-405d-a84b-10c4370a9bbe), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:22.896414 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3366dfa7-1916-413f-b5d9-3c4692dd675d admin admin] Pushing event deleted for resources: {'Port': ['ID=af462b70-3112-405d-a84b-10c4370a9bbe,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:22.954161 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3366dfa7-1916-413f-b5d9-3c4692dd675d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-560668'] for router_gateway (751d5daa-7864-4c4e-a90b-e2428fafc279), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:23.058601 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3366dfa7-1916-413f-b5d9-3c4692dd675d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-557467', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6918'] for router (751d5daa-7864-4c4e-a90b-e2428fafc279), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:23.060718 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3366dfa7-1916-413f-b5d9-3c4692dd675d admin admin] Publish callbacks [] for router_controller (751d5daa-7864-4c4e-a90b-e2428fafc279), precommit_delete_associations {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:23.173530 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3366dfa7-1916-413f-b5d9-3c4692dd675d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-557452'] for router (751d5daa-7864-4c4e-a90b-e2428fafc279), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:23.174043 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3366dfa7-1916-413f-b5d9-3c4692dd675d admin admin] Fanout notify agent at l3_agent the message router_deleted on router 751d5daa-7864-4c4e-a90b-e2428fafc279 {{(pid=102560) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Feb 08 18:15:23.184141 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3366dfa7-1916-413f-b5d9-3c4692dd675d admin admin] Publish callbacks [] for router (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:23.185131 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-3366dfa7-1916-413f-b5d9-3c4692dd675d admin admin] 10.222.0.118 "DELETE /v2.0/routers/751d5daa-7864-4c4e-a90b-e2428fafc279 HTTP/1.1" status: 204 len: 168 time: 1.0745790 Feb 08 18:15:23.187871 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 39792) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:23.208844 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1193854-ec93-4008-bf59-e672de44fbf3 req-51458ae9-9d5a-4f0d-a25b-5e700ef30a8a tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:23.210374 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b1193854-ec93-4008-bf59-e672de44fbf3 req-51458ae9-9d5a-4f0d-a25b-5e700ef30a8a tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.1245637 Feb 08 18:15:23.217621 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-736cd0f3-2b18-4dbd-9f4a-eacb070f3d6b req-47c77937-e851-45b1-aa92-53acaa98c9d9 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:23.219026 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-736cd0f3-2b18-4dbd-9f4a-eacb070f3d6b req-47c77937-e851-45b1-aa92-53acaa98c9d9 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.109 "GET /v2.0/ports?device_id=d2fb9a58-8375-440e-8e25-2a60d637eb7a HTTP/1.1" status: 200 len: 945 time: 0.1025333 Feb 08 18:15:23.232901 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_v2 [None req-518e08a5-b40f-4279-9e8a-746259522e16 admin admin] Deleting subnet 0af67967-364e-4325-b04f-b7e157c3c3d4 {{(pid=102559) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Feb 08 18:15:23.236012 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-518e08a5-b40f-4279-9e8a-746259522e16 admin admin] Publish callbacks [] for subnet (0af67967-364e-4325-b04f-b7e157c3c3d4), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:23.274498 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-518e08a5-b40f-4279-9e8a-746259522e16 admin admin] Publish callbacks [] for subnet (0af67967-364e-4325-b04f-b7e157c3c3d4), precommit_delete_associations {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:23.280427 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-518e08a5-b40f-4279-9e8a-746259522e16 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1801023'] for subnet (0af67967-364e-4325-b04f-b7e157c3c3d4), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:23.310637 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b1193854-ec93-4008-bf59-e672de44fbf3 req-4ca4d0b2-88f2-44a6-a4aa-f82784faddcb tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0907292 Feb 08 18:15:23.344633 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-518e08a5-b40f-4279-9e8a-746259522e16 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1801156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for subnet (0af67967-364e-4325-b04f-b7e157c3c3d4), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:23.345404 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-736cd0f3-2b18-4dbd-9f4a-eacb070f3d6b req-6fb5c803-62cf-4bb0-96e0-0fef4bb688c9 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Deleting port 5676d44a-8ef0-472a-9703-1a68bebb5ad4 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:15:23.345893 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-736cd0f3-2b18-4dbd-9f4a-eacb070f3d6b req-6fb5c803-62cf-4bb0-96e0-0fef4bb688c9 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (5676d44a-8ef0-472a-9703-1a68bebb5ad4), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:23.371206 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-518e08a5-b40f-4279-9e8a-746259522e16 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0af67967-364e-4325-b04f-b7e157c3c3d4,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:23.373746 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-518e08a5-b40f-4279-9e8a-746259522e16 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:23.379125 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-518e08a5-b40f-4279-9e8a-746259522e16 admin admin] 10.222.0.118 "DELETE /v2.0/subnets/0af67967-364e-4325-b04f-b7e157c3c3d4 HTTP/1.1" status: 204 len: 168 time: 0.1876080 Feb 08 18:15:23.381880 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 39794) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:23.390000 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-518e08a5-b40f-4279-9e8a-746259522e16 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:23.390317 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-518e08a5-b40f-4279-9e8a-746259522e16 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:23.390665 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-518e08a5-b40f-4279-9e8a-746259522e16 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:23.391133 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-518e08a5-b40f-4279-9e8a-746259522e16 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:23.391469 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-518e08a5-b40f-4279-9e8a-746259522e16 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:23.391799 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-518e08a5-b40f-4279-9e8a-746259522e16 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:23.392109 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-518e08a5-b40f-4279-9e8a-746259522e16 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:23.392436 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-518e08a5-b40f-4279-9e8a-746259522e16 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:23.392764 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-518e08a5-b40f-4279-9e8a-746259522e16 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:23.393084 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-518e08a5-b40f-4279-9e8a-746259522e16 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:23.393408 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-518e08a5-b40f-4279-9e8a-746259522e16 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:23.393727 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-518e08a5-b40f-4279-9e8a-746259522e16 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:23.394034 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-518e08a5-b40f-4279-9e8a-746259522e16 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:15:23.437124 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-736cd0f3-2b18-4dbd-9f4a-eacb070f3d6b req-6fb5c803-62cf-4bb0-96e0-0fef4bb688c9 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] For port 5676d44a-8ef0-472a-9703-1a68bebb5ad4, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=5676d44a-8ef0-472a-9703-1a68bebb5ad4,segment=NetworkSegment(acdb31ea-e529-495f-b01f-8c3d7b96781f),segment_id=acdb31ea-e529-495f-b01f-8c3d7b96781f)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:15:23.437345 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-736cd0f3-2b18-4dbd-9f4a-eacb070f3d6b req-6fb5c803-62cf-4bb0-96e0-0fef4bb688c9 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (5676d44a-8ef0-472a-9703-1a68bebb5ad4), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:23.449914 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-736cd0f3-2b18-4dbd-9f4a-eacb070f3d6b req-6fb5c803-62cf-4bb0-96e0-0fef4bb688c9 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Calling delete_port for 5676d44a-8ef0-472a-9703-1a68bebb5ad4 owned by compute:nova {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:15:23.458291 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1860329'] for network (f089911e-72de-4ff6-880b-ac3dd7927165), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:23.543324 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1721768', 'neutron.services.segments.db._delete_segments_for_network-8770558865089'] for network (f089911e-72de-4ff6-880b-ac3dd7927165), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:23.565589 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=102559) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:15:23.565942 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102559) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:15:23.566848 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102559) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:15:23.567193 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] Subscribe: > port after_create 55550000 {{(pid=102559) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:15:23.567624 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] Subscribe: > port after_delete 55550000 {{(pid=102559) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:15:23.567942 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] Subscribe: > port after_update 55550000 {{(pid=102559) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:15:23.568202 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=102559) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:15:23.568539 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102559) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:15:23.568961 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102559) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:15:23.569161 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=102559) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:15:23.585203 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-736cd0f3-2b18-4dbd-9f4a-eacb070f3d6b req-6fb5c803-62cf-4bb0-96e0-0fef4bb688c9 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (5676d44a-8ef0-472a-9703-1a68bebb5ad4), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:23.599046 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['5676d44a-8ef0-472a-9703-1a68bebb5ad4'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:15:23.614444 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fb5c803-62cf-4bb0-96e0-0fef4bb688c9 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Pushing event deleted for resources: {'Port': ['ID=5676d44a-8ef0-472a-9703-1a68bebb5ad4,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:23.641495 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device f7548915-8b6b-47ac-982b-ba931ac61b22 no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:15:23.669152 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: f7548915-8b6b-47ac-982b-ba931ac61b22 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:15:23.669345 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [req-736cd0f3-2b18-4dbd-9f4a-eacb070f3d6b req-6fb5c803-62cf-4bb0-96e0-0fef4bb688c9 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] No DVR routers for this DVR port 5676d44a-8ef0-472a-9703-1a68bebb5ad4 on host hv-cinder-77398 {{(pid=102560) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:15:23.669475 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device f7548915-8b6b-47ac-982b-ba931ac61b22 not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:15:23.669475 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device af462b70-3112-405d-a84b-10c4370a9bbe no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:15:23.671073 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102559) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:15:23.671539 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-736cd0f3-2b18-4dbd-9f4a-eacb070f3d6b req-6fb5c803-62cf-4bb0-96e0-0fef4bb688c9 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:23.672574 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102559) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:15:23.672574 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=102559) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:15:23.672574 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=102559) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Feb 08 18:15:23.672574 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.services.segments.db [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f089911e-72de-4ff6-880b-ac3dd7927165']}} {{(pid=102559) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:15:23.675053 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-736cd0f3-2b18-4dbd-9f4a-eacb070f3d6b req-6fb5c803-62cf-4bb0-96e0-0fef4bb688c9 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.109 "DELETE /v2.0/ports/5676d44a-8ef0-472a-9703-1a68bebb5ad4 HTTP/1.1" status: 204 len: 173 time: 0.4485784 Feb 08 18:15:23.675850 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd2fb9a58-8375-440e-8e25-2a60d637eb7a', 'name': 'network-vif-deleted', 'tag': '5676d44a-8ef0-472a-9703-1a68bebb5ad4'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:15:23.678191 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2f8d9453-14b6-45b3-af4a-5907c836bf4c" -d '{"events": [{"server_uuid": "d2fb9a58-8375-440e-8e25-2a60d637eb7a", "name": "network-vif-deleted", "tag": "5676d44a-8ef0-472a-9703-1a68bebb5ad4"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:15:23.696538 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.services.segments.db [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7e36cc20-402b-47f5-9242-a15d0de4717c') {'for_net_delete': True} {{(pid=102559) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:15:23.696956 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.services.segments.db [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7e36cc20-402b-47f5-9242-a15d0de4717c') {} {{(pid=102559) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:15:23.718548 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8770558866122', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-63850230'] for segment (7e36cc20-402b-47f5-9242-a15d0de4717c), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:23.721793 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: af462b70-3112-405d-a84b-10c4370a9bbe {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:15:23.722280 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device af462b70-3112-405d-a84b-10c4370a9bbe not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:15:23.739789 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:15:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-29818be1-a70e-4e15-82a8-479e835be947 x-openstack-request-id: req-29818be1-a70e-4e15-82a8-479e835be947 {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:15:23.740278 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d2fb9a58-8375-440e-8e25-2a60d637eb7a", "name": "network-vif-deleted", "tag": "5676d44a-8ef0-472a-9703-1a68bebb5ad4", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:15:23.740673 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-29818be1-a70e-4e15-82a8-479e835be947 {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:15:23.741225 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd2fb9a58-8375-440e-8e25-2a60d637eb7a', 'name': 'network-vif-deleted', 'tag': '5676d44a-8ef0-472a-9703-1a68bebb5ad4', 'status': 'completed', 'code': 200} Feb 08 18:15:23.752941 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (7e36cc20-402b-47f5-9242-a15d0de4717c), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:23.764247 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] Releasing vlan 1065 on physical network physnet1 to pool {{(pid=102559) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Feb 08 18:15:23.764688 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-63856418'] for segment (7e36cc20-402b-47f5-9242-a15d0de4717c), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: from cryptography.utils import int_from_bytes Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: from cryptography.utils import int_from_bytes Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: Traceback (most recent call last): Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: timer() Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: cb(*args, **kw) Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: return func(*args, **kwargs) Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: self._notify() Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: self.callback(batched_events) Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: event.method(event) Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: aggregate_uuid = self.p_client.list_aggregates( Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: return f(self, *a, **k) Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: return self._get(url).json() Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: return self._client.get(url, endpoint_filter=self._ks_filter, Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: return self.request(url, 'GET', **kwargs) Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: base_url = self.get_endpoint(auth, allow=allow, Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 08 18:15:23.770756 dv-cinder-773985-21-iscsi neutron-server[102559]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 08 18:15:23.799382 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-dc43a04e-aa47-4ad3-9d2b-1130a22187a8 req-7299f3b5-54cf-4ebe-8b23-11497e0417a9 tempest-AttachVolumeNegativeTest-817835669 tempest-AttachVolumeNegativeTest-817835669-project] 10.222.0.118 "GET /v2.0/ports?device_id=d2fb9a58-8375-440e-8e25-2a60d637eb7a HTTP/1.1" status: 200 len: 210 time: 0.0370018 Feb 08 18:15:23.841508 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1721777', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-560760'] for network (f089911e-72de-4ff6-880b-ac3dd7927165), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:23.848826 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:23.852426 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] 10.222.0.118 "DELETE /v2.0/networks/f089911e-72de-4ff6-880b-ac3dd7927165 HTTP/1.1" status: 204 len: 168 time: 0.4695904 Feb 08 18:15:23.861963 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0683ea8-7819-425f-b248-e7f2a2553da3 admin admin] Pushing event deleted for resources: {'Network': ['ID=f089911e-72de-4ff6-880b-ac3dd7927165,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:24.058727 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 39804) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:24.108666 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-33acd832-f557-45d5-a116-d53e30f2b274 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=3fb51fc0e23f4c66a482d4d406197299&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0487065 Feb 08 18:15:24.112225 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 39806) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:24.161778 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-dad70a43-2f8a-4249-9e83-bd8a3833305a admin admin] Publish callbacks [] for security_group (3f13be41-fc10-4e73-b2e6-a6baad01d4aa), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:24.183805 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-dad70a43-2f8a-4249-9e83-bd8a3833305a admin admin] Publish callbacks [] for security_group (3f13be41-fc10-4e73-b2e6-a6baad01d4aa), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:24.230878 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-dad70a43-2f8a-4249-9e83-bd8a3833305a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (3f13be41-fc10-4e73-b2e6-a6baad01d4aa), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:24.233549 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-dad70a43-2f8a-4249-9e83-bd8a3833305a admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:24.234707 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-dad70a43-2f8a-4249-9e83-bd8a3833305a admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/3f13be41-fc10-4e73-b2e6-a6baad01d4aa HTTP/1.1" status: 204 len: 168 time: 0.1215839 Feb 08 18:15:24.245157 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dad70a43-2f8a-4249-9e83-bd8a3833305a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3f13be41-fc10-4e73-b2e6-a6baad01d4aa,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:24.436091 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deec37f4-aec9-47c3-93eb-987bb8b305d6 req-a53af2b8-5186-4219-8083-7380c671908b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:24.437592 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-deec37f4-aec9-47c3-93eb-987bb8b305d6 req-a53af2b8-5186-4219-8083-7380c671908b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0542357 Feb 08 18:15:24.488421 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-deec37f4-aec9-47c3-93eb-987bb8b305d6 req-57ee19eb-7556-4bf6-8426-705a0004fc06 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450644 Feb 08 18:15:24.856405 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 39830) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:24.900226 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_v2 [None req-e9ddbfee-068d-4fba-8971-6ad22ef3c06b admin admin] Deleting subnet 080b9f96-e4e1-410a-a6ed-01cf523843d5 {{(pid=102560) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Feb 08 18:15:24.903353 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e9ddbfee-068d-4fba-8971-6ad22ef3c06b admin admin] Publish callbacks [] for subnet (080b9f96-e4e1-410a-a6ed-01cf523843d5), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:24.937577 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e9ddbfee-068d-4fba-8971-6ad22ef3c06b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-64533851'] for subnet (080b9f96-e4e1-410a-a6ed-01cf523843d5), precommit_delete_associations {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:24.978602 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e9ddbfee-068d-4fba-8971-6ad22ef3c06b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1801023'] for subnet (080b9f96-e4e1-410a-a6ed-01cf523843d5), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:25.033649 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e9ddbfee-068d-4fba-8971-6ad22ef3c06b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1801156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-64531538', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-64597460'] for subnet (080b9f96-e4e1-410a-a6ed-01cf523843d5), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:25.059991 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9ddbfee-068d-4fba-8971-6ad22ef3c06b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=080b9f96-e4e1-410a-a6ed-01cf523843d5,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:25.061936 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e9ddbfee-068d-4fba-8971-6ad22ef3c06b admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:25.067672 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-e9ddbfee-068d-4fba-8971-6ad22ef3c06b admin admin] 10.222.0.118 "DELETE /v2.0/subnets/080b9f96-e4e1-410a-a6ed-01cf523843d5 HTTP/1.1" status: 204 len: 168 time: 0.2077234 Feb 08 18:15:25.067836 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 39836) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:25.134866 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-616d0bea-9143-4ad4-9462-e165b4178d9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1860329'] for network (622fcad3-2fd8-49df-8f66-feb243e2b24d), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:25.213982 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-616d0bea-9143-4ad4-9462-e165b4178d9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1721768', 'neutron.services.segments.db._delete_segments_for_network-8770558865089'] for network (622fcad3-2fd8-49df-8f66-feb243e2b24d), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:25.237583 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-616d0bea-9143-4ad4-9462-e165b4178d9f admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['622fcad3-2fd8-49df-8f66-feb243e2b24d']}} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:15:25.246614 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-616d0bea-9143-4ad4-9462-e165b4178d9f admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'acdb31ea-e529-495f-b01f-8c3d7b96781f') {'for_net_delete': True} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:15:25.246947 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-616d0bea-9143-4ad4-9462-e165b4178d9f admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'acdb31ea-e529-495f-b01f-8c3d7b96781f') {} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:15:25.256101 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-616d0bea-9143-4ad4-9462-e165b4178d9f admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8770558866122', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-64533840'] for segment (acdb31ea-e529-495f-b01f-8c3d7b96781f), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:25.269368 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-616d0bea-9143-4ad4-9462-e165b4178d9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (acdb31ea-e529-495f-b01f-8c3d7b96781f), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:25.277150 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-616d0bea-9143-4ad4-9462-e165b4178d9f admin admin] Releasing vlan 1074 on physical network physnet1 to pool {{(pid=102560) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Feb 08 18:15:25.277150 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-616d0bea-9143-4ad4-9462-e165b4178d9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-64531704'] for segment (acdb31ea-e529-495f-b01f-8c3d7b96781f), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: Traceback (most recent call last): Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: timer() Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: cb(*args, **kw) Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: return func(*args, **kwargs) Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: self._notify() Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: self.callback(batched_events) Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: event.method(event) Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: aggregate_uuid = self.p_client.list_aggregates( Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: return f(self, *a, **k) Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: return self._get(url).json() Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: return self._client.get(url, endpoint_filter=self._ks_filter, Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: return self.request(url, 'GET', **kwargs) Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: base_url = self.get_endpoint(auth, allow=allow, Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 08 18:15:25.277479 dv-cinder-773985-21-iscsi neutron-server[102560]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 08 18:15:25.333824 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-616d0bea-9143-4ad4-9462-e165b4178d9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1721777', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-560760'] for network (622fcad3-2fd8-49df-8f66-feb243e2b24d), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:25.340120 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-616d0bea-9143-4ad4-9462-e165b4178d9f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:25.345713 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-616d0bea-9143-4ad4-9462-e165b4178d9f admin admin] 10.222.0.118 "DELETE /v2.0/networks/622fcad3-2fd8-49df-8f66-feb243e2b24d HTTP/1.1" status: 204 len: 168 time: 0.2744951 Feb 08 18:15:25.352466 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-616d0bea-9143-4ad4-9462-e165b4178d9f admin admin] Pushing event deleted for resources: {'Network': ['ID=622fcad3-2fd8-49df-8f66-feb243e2b24d,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:25.463399 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 39852) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:25.503350 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-e80ea28a-e757-4f8c-a931-10b2301621de admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=602d106ac7104b10bebcfc0421ea5edc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0386553 Feb 08 18:15:25.505851 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 39854) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:25.556005 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0d007d26-d106-4a05-a1aa-3341e7b518f1 admin admin] Publish callbacks [] for security_group (ee26d93a-0e97-42a4-942d-86acae001415), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:25.583504 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0d007d26-d106-4a05-a1aa-3341e7b518f1 admin admin] Publish callbacks [] for security_group (ee26d93a-0e97-42a4-942d-86acae001415), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:25.616649 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d19855a-f1c9-4f46-aeb0-e247e8159334 req-894ea4f5-d44c-4b8e-b9a3-dd167ffe832a tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:25.618144 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2d19855a-f1c9-4f46-aeb0-e247e8159334 req-894ea4f5-d44c-4b8e-b9a3-dd167ffe832a tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0587263 Feb 08 18:15:25.635930 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0d007d26-d106-4a05-a1aa-3341e7b518f1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (ee26d93a-0e97-42a4-942d-86acae001415), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:25.638920 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0d007d26-d106-4a05-a1aa-3341e7b518f1 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:25.643257 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-0d007d26-d106-4a05-a1aa-3341e7b518f1 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/ee26d93a-0e97-42a4-942d-86acae001415 HTTP/1.1" status: 204 len: 168 time: 0.1361907 Feb 08 18:15:25.651919 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d007d26-d106-4a05-a1aa-3341e7b518f1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ee26d93a-0e97-42a4-942d-86acae001415,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:25.671498 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2d19855a-f1c9-4f46-aeb0-e247e8159334 req-06fb1788-c879-4c28-8f3f-8e792e1ad27f tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468881 Feb 08 18:15:26.101180 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 39886) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:26.273466 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-b07f4f20-7f69-4697-8ebf-feef5457fec8 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:26.348847 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-b07f4f20-7f69-4697-8ebf-feef5457fec8 admin admin] Publish callbacks [] for security_group (644514d7-e9da-4450-9b46-bd54c2d78bd4), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:26.353484 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-b07f4f20-7f69-4697-8ebf-feef5457fec8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (644514d7-e9da-4450-9b46-bd54c2d78bd4), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:26.390248 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-b07f4f20-7f69-4697-8ebf-feef5457fec8 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=cfa9815b937f40ffa7b1144fa91777d3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2878680 Feb 08 18:15:26.391432 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b07f4f20-7f69-4697-8ebf-feef5457fec8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=644514d7-e9da-4450-9b46-bd54c2d78bd4,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:26.393126 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 39900) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:26.442347 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6076b12-42d8-4cbf-8733-f7dcf22542b6 admin admin] Publish callbacks [] for security_group (644514d7-e9da-4450-9b46-bd54c2d78bd4), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:26.466622 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6076b12-42d8-4cbf-8733-f7dcf22542b6 admin admin] Publish callbacks [] for security_group (644514d7-e9da-4450-9b46-bd54c2d78bd4), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:26.521038 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6076b12-42d8-4cbf-8733-f7dcf22542b6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (644514d7-e9da-4450-9b46-bd54c2d78bd4), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:26.525508 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6076b12-42d8-4cbf-8733-f7dcf22542b6 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:26.527482 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-f6076b12-42d8-4cbf-8733-f7dcf22542b6 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/644514d7-e9da-4450-9b46-bd54c2d78bd4 HTTP/1.1" status: 204 len: 168 time: 0.1331174 Feb 08 18:15:26.538736 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6076b12-42d8-4cbf-8733-f7dcf22542b6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=644514d7-e9da-4450-9b46-bd54c2d78bd4,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:26.602067 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 5676d44a-8ef0-472a-9703-1a68bebb5ad4 no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:15:26.623932 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] No Port match for: 5676d44a-8ef0-472a-9703-1a68bebb5ad4 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:15:26.624292 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 5676d44a-8ef0-472a-9703-1a68bebb5ad4 not bound to the agent host hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:15:26.803999 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-331e3b57-b9b6-40bd-b71e-3c386dd65a49 req-e26134be-1e94-4e47-857c-da13cbe1c634 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:26.806525 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-331e3b57-b9b6-40bd-b71e-3c386dd65a49 req-e26134be-1e94-4e47-857c-da13cbe1c634 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0633357 Feb 08 18:15:26.858042 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-331e3b57-b9b6-40bd-b71e-3c386dd65a49 req-26b2e8e3-2bcd-4a89-800f-597fb18bc92c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445745 Feb 08 18:15:26.880516 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 39914) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:26.894334 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d47bb831-06a5-4803-8a83-ccb73c905d3a admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:26.984370 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d47bb831-06a5-4803-8a83-ccb73c905d3a admin admin] Publish callbacks [] for security_group (20359322-4b3f-467c-9c30-9a62d249fcf5), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:26.989343 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d47bb831-06a5-4803-8a83-ccb73c905d3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (20359322-4b3f-467c-9c30-9a62d249fcf5), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:27.029259 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-d47bb831-06a5-4803-8a83-ccb73c905d3a admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=61c9959828d046b9a43f9612646a7ac8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1472418 Feb 08 18:15:27.030319 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d47bb831-06a5-4803-8a83-ccb73c905d3a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=20359322-4b3f-467c-9c30-9a62d249fcf5,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:27.031825 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 39924) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:27.080453 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4338075c-178c-4022-aefe-47e423a0e8ed admin admin] Publish callbacks [] for security_group (20359322-4b3f-467c-9c30-9a62d249fcf5), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:27.101070 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4338075c-178c-4022-aefe-47e423a0e8ed admin admin] Publish callbacks [] for security_group (20359322-4b3f-467c-9c30-9a62d249fcf5), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:27.154710 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4338075c-178c-4022-aefe-47e423a0e8ed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (20359322-4b3f-467c-9c30-9a62d249fcf5), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:27.158920 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4338075c-178c-4022-aefe-47e423a0e8ed admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:27.160643 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-4338075c-178c-4022-aefe-47e423a0e8ed admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/20359322-4b3f-467c-9c30-9a62d249fcf5 HTTP/1.1" status: 204 len: 168 time: 0.1276634 Feb 08 18:15:27.170564 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4338075c-178c-4022-aefe-47e423a0e8ed admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=20359322-4b3f-467c-9c30-9a62d249fcf5,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:27.977283 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-718b084f-c3b7-4c35-b036-c9275411e7de req-aa649c15-7a02-4fa2-9b10-f4fbae2486a8 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:27.978808 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-718b084f-c3b7-4c35-b036-c9275411e7de req-aa649c15-7a02-4fa2-9b10-f4fbae2486a8 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0514007 Feb 08 18:15:28.029682 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-718b084f-c3b7-4c35-b036-c9275411e7de req-b04b5c4e-6dba-4243-b5dc-b56e33c04a82 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451946 Feb 08 18:15:29.148998 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a43c27a-652f-4e05-85cd-edde5c40214e req-a7342e29-faf0-41d8-aea2-99f5279caa02 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:29.150609 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0a43c27a-652f-4e05-85cd-edde5c40214e req-a7342e29-faf0-41d8-aea2-99f5279caa02 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0529680 Feb 08 18:15:29.157306 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 40018) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:29.203289 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0a43c27a-652f-4e05-85cd-edde5c40214e req-b35f039a-bc0f-426c-8b32-c8aecf90a975 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468559 Feb 08 18:15:29.262965 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-47b6fcde-1b64-45cd-8cae-92dbbbe121db admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:29.351932 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-47b6fcde-1b64-45cd-8cae-92dbbbe121db admin admin] Publish callbacks [] for security_group (f3b1c026-20ee-4644-a56f-510926aa82de), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:29.357394 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-47b6fcde-1b64-45cd-8cae-92dbbbe121db admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (f3b1c026-20ee-4644-a56f-510926aa82de), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:29.400398 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-47b6fcde-1b64-45cd-8cae-92dbbbe121db admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=529043447e654b01917f131c47dd2387&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2419503 Feb 08 18:15:29.402309 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47b6fcde-1b64-45cd-8cae-92dbbbe121db admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f3b1c026-20ee-4644-a56f-510926aa82de,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:29.403208 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 40028) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:29.452132 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-757fd322-cb39-4d28-84f8-8d8ac20a3f26 admin admin] Publish callbacks [] for security_group (f3b1c026-20ee-4644-a56f-510926aa82de), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:29.473322 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-757fd322-cb39-4d28-84f8-8d8ac20a3f26 admin admin] Publish callbacks [] for security_group (f3b1c026-20ee-4644-a56f-510926aa82de), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:29.517286 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 40032) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:29.521520 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-757fd322-cb39-4d28-84f8-8d8ac20a3f26 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (f3b1c026-20ee-4644-a56f-510926aa82de), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:29.524489 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-757fd322-cb39-4d28-84f8-8d8ac20a3f26 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:29.525600 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-757fd322-cb39-4d28-84f8-8d8ac20a3f26 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/f3b1c026-20ee-4644-a56f-510926aa82de HTTP/1.1" status: 204 len: 168 time: 0.1213760 Feb 08 18:15:29.533840 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-757fd322-cb39-4d28-84f8-8d8ac20a3f26 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f3b1c026-20ee-4644-a56f-510926aa82de,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:29.736842 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-9b7a415d-8456-42f1-b8d1-d5b9cf1cf0bc admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:29.790630 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 40040) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:29.811217 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-816fb29c-5fe3-4550-85a7-c7ce374791c7 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:29.831682 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-9b7a415d-8456-42f1-b8d1-d5b9cf1cf0bc admin admin] Publish callbacks [] for security_group (5fd1a5a1-010d-413b-801c-b0ee83ad1070), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:29.840528 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-9b7a415d-8456-42f1-b8d1-d5b9cf1cf0bc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (5fd1a5a1-010d-413b-801c-b0ee83ad1070), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:29.893592 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-9b7a415d-8456-42f1-b8d1-d5b9cf1cf0bc admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=cf5e47f0578e44f695269d304ab0027d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3748977 Feb 08 18:15:29.896286 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b7a415d-8456-42f1-b8d1-d5b9cf1cf0bc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5fd1a5a1-010d-413b-801c-b0ee83ad1070,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:29.896501 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 40042) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:29.937232 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-816fb29c-5fe3-4550-85a7-c7ce374791c7 admin admin] Publish callbacks [] for security_group (4bbacb17-e1f0-44b5-bb69-7ec841422810), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:29.943351 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-816fb29c-5fe3-4550-85a7-c7ce374791c7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (4bbacb17-e1f0-44b5-bb69-7ec841422810), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:29.947684 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1a04cc0c-3b02-4e3c-bb77-92baa964037c admin admin] Publish callbacks [] for security_group (5fd1a5a1-010d-413b-801c-b0ee83ad1070), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:29.969008 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1a04cc0c-3b02-4e3c-bb77-92baa964037c admin admin] Publish callbacks [] for security_group (5fd1a5a1-010d-413b-801c-b0ee83ad1070), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:29.979962 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-816fb29c-5fe3-4550-85a7-c7ce374791c7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4bbacb17-e1f0-44b5-bb69-7ec841422810,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:29.984032 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-816fb29c-5fe3-4550-85a7-c7ce374791c7 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=fd9e13256ba54d6c9cf5060afce25b98&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1914902 Feb 08 18:15:29.986738 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 40044) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:30.017556 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1a04cc0c-3b02-4e3c-bb77-92baa964037c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (5fd1a5a1-010d-413b-801c-b0ee83ad1070), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:30.020381 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1a04cc0c-3b02-4e3c-bb77-92baa964037c admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:30.023994 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-1a04cc0c-3b02-4e3c-bb77-92baa964037c admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/5fd1a5a1-010d-413b-801c-b0ee83ad1070 HTTP/1.1" status: 204 len: 168 time: 0.1240761 Feb 08 18:15:30.034366 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a04cc0c-3b02-4e3c-bb77-92baa964037c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5fd1a5a1-010d-413b-801c-b0ee83ad1070,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:30.045467 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ef44bb61-c417-4ed2-82ad-ce8093cf498b admin admin] Publish callbacks [] for security_group (4bbacb17-e1f0-44b5-bb69-7ec841422810), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:30.067014 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ef44bb61-c417-4ed2-82ad-ce8093cf498b admin admin] Publish callbacks [] for security_group (4bbacb17-e1f0-44b5-bb69-7ec841422810), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:30.113225 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ef44bb61-c417-4ed2-82ad-ce8093cf498b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (4bbacb17-e1f0-44b5-bb69-7ec841422810), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:30.115961 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ef44bb61-c417-4ed2-82ad-ce8093cf498b admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:30.117130 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-ef44bb61-c417-4ed2-82ad-ce8093cf498b admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/4bbacb17-e1f0-44b5-bb69-7ec841422810 HTTP/1.1" status: 204 len: 168 time: 0.1294920 Feb 08 18:15:30.125845 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef44bb61-c417-4ed2-82ad-ce8093cf498b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4bbacb17-e1f0-44b5-bb69-7ec841422810,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:30.341618 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55584447-a095-4295-a307-4349cf15579d req-83b8a515-99b4-4081-891d-9b739af28bf5 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:30.343490 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-55584447-a095-4295-a307-4349cf15579d req-83b8a515-99b4-4081-891d-9b739af28bf5 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0703433 Feb 08 18:15:30.392390 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-55584447-a095-4295-a307-4349cf15579d req-4eebde84-50d8-4579-a1b0-80572c5a7844 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426931 Feb 08 18:15:30.866702 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 40090) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:30.972197 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-03899cdc-e5d3-4d39-93c0-f3f9b60cb174 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-932763174-network', 'tenant_id': 'd79db57c8c264cd680dd87d2b99f6ebb'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:15:30.992157 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-03899cdc-e5d3-4d39-93c0-f3f9b60cb174 admin admin] Made reservation on behalf of d79db57c8c264cd680dd87d2b99f6ebb for: {'network': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:15:30.998091 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-03899cdc-e5d3-4d39-93c0-f3f9b60cb174 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for network (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:31.006844 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-03899cdc-e5d3-4d39-93c0-f3f9b60cb174 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:31.089442 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-03899cdc-e5d3-4d39-93c0-f3f9b60cb174 admin admin] Publish callbacks [] for security_group (8d8fff6e-6e70-4fab-b750-c3052e6198d0), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:31.094668 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-03899cdc-e5d3-4d39-93c0-f3f9b60cb174 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (8d8fff6e-6e70-4fab-b750-c3052e6198d0), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:31.114910 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-03899cdc-e5d3-4d39-93c0-f3f9b60cb174 admin admin] vlan segment allocate from pool success with {'vlan_id': 1094, 'physical_network': 'physnet1'} {{(pid=102560) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Feb 08 18:15:31.129481 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03899cdc-e5d3-4d39-93c0-f3f9b60cb174 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8d8fff6e-6e70-4fab-b750-c3052e6198d0,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:31.132414 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-03899cdc-e5d3-4d39-93c0-f3f9b60cb174 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (9660affe-270d-401a-89cc-105ae6ad2183), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:31.132755 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.segments_db [None req-03899cdc-e5d3-4d39-93c0-f3f9b60cb174 admin admin] Added segment 9660affe-270d-401a-89cc-105ae6ad2183 of type vlan for network e861722a-6c3e-408a-8c41-77287d1f06d4 Feb 08 18:15:31.172361 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-03899cdc-e5d3-4d39-93c0-f3f9b60cb174 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8770558521384'] for network (e861722a-6c3e-408a-8c41-77287d1f06d4), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:31.200327 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-03899cdc-e5d3-4d39-93c0-f3f9b60cb174 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for network (e861722a-6c3e-408a-8c41-77287d1f06d4), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:31.201351 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-03899cdc-e5d3-4d39-93c0-f3f9b60cb174 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:31.201935 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-03899cdc-e5d3-4d39-93c0-f3f9b60cb174 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:31.254910 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-03899cdc-e5d3-4d39-93c0-f3f9b60cb174 admin admin] 10.222.0.118 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.3842237 Feb 08 18:15:31.258618 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 40106) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:31.264737 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-f813071f-6c2b-46da-8900-8154aa2aaddf admin admin] Request body: {'subnet': {'network_id': 'e861722a-6c3e-408a-8c41-77287d1f06d4', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-932763174-subnet', 'tenant_id': 'd79db57c8c264cd680dd87d2b99f6ebb', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:15:31.268559 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03899cdc-e5d3-4d39-93c0-f3f9b60cb174 admin admin] Pushing event updated for resources: {'Network': ['ID=e861722a-6c3e-408a-8c41-77287d1f06d4,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:31.279490 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Network e861722a-6c3e-408a-8c41-77287d1f06d4 details requested by agent ovs-agent-dv-cinder-773985-21-iscsi with host dv-cinder-773985-21-iscsi {{(pid=102561) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Feb 08 18:15:31.287541 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f813071f-6c2b-46da-8900-8154aa2aaddf admin admin] Made reservation on behalf of d79db57c8c264cd680dd87d2b99f6ebb for: {'subnet': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:15:31.289968 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f813071f-6c2b-46da-8900-8154aa2aaddf admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-63685351'] for subnet (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:31.469063 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f813071f-6c2b-46da-8900-8154aa2aaddf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-63856587', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-63685337'] for subnet (2085df58-b213-4f90-8416-9f2c9a9420b0), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:31.531505 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f813071f-6c2b-46da-8900-8154aa2aaddf admin admin] Pushing event updated for resources: {'Subnet': ['ID=2085df58-b213-4f90-8416-9f2c9a9420b0,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:31.540067 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f813071f-6c2b-46da-8900-8154aa2aaddf admin admin] Checking segment: {'id': '9660affe-270d-401a-89cc-105ae6ad2183', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1094, 'network_id': 'e861722a-6c3e-408a-8c41-77287d1f06d4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102559) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:15:31.540424 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f813071f-6c2b-46da-8900-8154aa2aaddf admin admin] Network hostable DHCP agents. Network: e861722a-6c3e-408a-8c41-77287d1f06d4, hostable agents: ['006b5388-ac7d-4794-a124-14bb8e5d8fec'], hosted agents: [] {{(pid=102559) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Feb 08 18:15:31.541105 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83dcd688-11e0-4802-a338-92f1233a4b64 req-cb1b4e04-73a4-4491-8197-5ec5dc2a6681 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:31.547235 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-83dcd688-11e0-4802-a338-92f1233a4b64 req-cb1b4e04-73a4-4491-8197-5ec5dc2a6681 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0767343 Feb 08 18:15:31.560106 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f813071f-6c2b-46da-8900-8154aa2aaddf admin admin] Network e861722a-6c3e-408a-8c41-77287d1f06d4 is scheduled to be hosted by DHCP agent 006b5388-ac7d-4794-a124-14bb8e5d8fec with binding_index 1 {{(pid=102559) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Feb 08 18:15:31.571062 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-f813071f-6c2b-46da-8900-8154aa2aaddf admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773985-21-iscsi, e861722a-6c3e-408a-8c41-77287d1f06d4) {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:15:31.576044 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f813071f-6c2b-46da-8900-8154aa2aaddf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:31.576865 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f813071f-6c2b-46da-8900-8154aa2aaddf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:31.585983 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6621e889-f04f-49eb-9bfe-53628821c9cb None None] Network e861722a-6c3e-408a-8c41-77287d1f06d4 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:15:31.597267 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-f813071f-6c2b-46da-8900-8154aa2aaddf admin admin] 10.222.0.118 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3373768 Feb 08 18:15:31.632544 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-83dcd688-11e0-4802-a338-92f1233a4b64 req-20070c19-0e42-46d7-ab8b-2dc8d1669743 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0834184 Feb 08 18:15:31.726505 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9abc420e-23e3-40dc-bb10-8fcedff16df1 None None] Network e861722a-6c3e-408a-8c41-77287d1f06d4 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:15:31.942484 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb8fcb0b-8672-4294-af7f-aea41664188c req-3d84a52c-a5e3-48da-9e7a-9a3cab20617c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:31.944623 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-bb8fcb0b-8672-4294-af7f-aea41664188c req-3d84a52c-a5e3-48da-9e7a-9a3cab20617c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0870352 Feb 08 18:15:31.949893 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5be0e0b4-6f87-4c7a-a941-84f1b612faf6 req-523a37c0-e9e9-4d9d-a04b-ac5dd1b75c6d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:31.953860 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5be0e0b4-6f87-4c7a-a941-84f1b612faf6 req-523a37c0-e9e9-4d9d-a04b-ac5dd1b75c6d service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=630172c388404c75bda3d0ba2d9d5834&device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 1130 time: 0.0632524 Feb 08 18:15:32.045766 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-bb8fcb0b-8672-4294-af7f-aea41664188c req-e0ff1510-d77d-4399-b944-821a72c0c0cb tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0934162 Feb 08 18:15:32.075195 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5be0e0b4-6f87-4c7a-a941-84f1b612faf6 req-3e6a1eca-ae70-4fec-af18-12397c469f12 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:32.076676 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5be0e0b4-6f87-4c7a-a941-84f1b612faf6 req-3e6a1eca-ae70-4fec-af18-12397c469f12 service neutron] 10.222.0.109 "GET /v2.0/networks?id=e430084e-9b28-426f-9937-61346814b135 HTTP/1.1" status: 200 len: 912 time: 0.1170504 Feb 08 18:15:32.147884 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5be0e0b4-6f87-4c7a-a941-84f1b612faf6 req-be5d973d-0a1b-4c81-a0b9-ff78cac67021 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb HTTP/1.1" status: 200 len: 1002 time: 0.0613749 Feb 08 18:15:32.183020 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 40140) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:32.190553 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-331a6795-b377-46c4-85b0-95b10b1fa4c2 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1871603361-network', 'tenant_id': '3c9980c371f945a2b74398ba27cd5da2'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:15:32.210696 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5be0e0b4-6f87-4c7a-a941-84f1b612faf6 req-27959be0-bacf-4c26-a48b-ac6cbaae0b73 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:32.212240 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5be0e0b4-6f87-4c7a-a941-84f1b612faf6 req-27959be0-bacf-4c26-a48b-ac6cbaae0b73 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=86592955-e7d0-4e8a-9490-976e17240d7c HTTP/1.1" status: 200 len: 849 time: 0.0575302 Feb 08 18:15:32.219289 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-331a6795-b377-46c4-85b0-95b10b1fa4c2 admin admin] Made reservation on behalf of 3c9980c371f945a2b74398ba27cd5da2 for: {'network': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:15:32.221578 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-331a6795-b377-46c4-85b0-95b10b1fa4c2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for network (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:32.250913 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-331a6795-b377-46c4-85b0-95b10b1fa4c2 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:32.292456 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5be0e0b4-6f87-4c7a-a941-84f1b612faf6 req-02e52578-6581-4ee5-9ea9-c93c186a0ad6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:32.294079 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5be0e0b4-6f87-4c7a-a941-84f1b612faf6 req-02e52578-6581-4ee5-9ea9-c93c186a0ad6 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=e430084e-9b28-426f-9937-61346814b135&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0704048 Feb 08 18:15:32.397513 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-331a6795-b377-46c4-85b0-95b10b1fa4c2 admin admin] Publish callbacks [] for security_group (44d2b451-eaf7-4506-b0a6-5bd10a1bd046), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:32.407692 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-331a6795-b377-46c4-85b0-95b10b1fa4c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (44d2b451-eaf7-4506-b0a6-5bd10a1bd046), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:32.417147 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5be0e0b4-6f87-4c7a-a941-84f1b612faf6 req-18dde777-6bbf-4be5-af81-086e2bf93b65 service neutron] 10.222.0.109 "GET /v2.0/networks/e430084e-9b28-426f-9937-61346814b135?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1144321 Feb 08 18:15:32.439361 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-331a6795-b377-46c4-85b0-95b10b1fa4c2 admin admin] vlan segment allocate from pool success with {'vlan_id': 1073, 'physical_network': 'physnet1'} {{(pid=102560) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Feb 08 18:15:32.491713 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-331a6795-b377-46c4-85b0-95b10b1fa4c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=44d2b451-eaf7-4506-b0a6-5bd10a1bd046,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:32.496053 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-331a6795-b377-46c4-85b0-95b10b1fa4c2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (27dffb5a-ba77-4a4f-8f60-cf4adeebd4a9), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:32.496378 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.segments_db [None req-331a6795-b377-46c4-85b0-95b10b1fa4c2 admin admin] Added segment 27dffb5a-ba77-4a4f-8f60-cf4adeebd4a9 of type vlan for network 9e46e43c-9a0e-4aa5-ae29-657bef15fd06 Feb 08 18:15:32.547940 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-331a6795-b377-46c4-85b0-95b10b1fa4c2 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8770558521384'] for network (9e46e43c-9a0e-4aa5-ae29-657bef15fd06), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:32.568317 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5be0e0b4-6f87-4c7a-a941-84f1b612faf6 req-3204610d-cd2e-4f7c-999e-577b8e83ec5f service neutron] 10.222.0.109 "GET /v2.0/networks/e430084e-9b28-426f-9937-61346814b135?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1430073 Feb 08 18:15:32.583640 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-331a6795-b377-46c4-85b0-95b10b1fa4c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for network (9e46e43c-9a0e-4aa5-ae29-657bef15fd06), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:32.584600 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-331a6795-b377-46c4-85b0-95b10b1fa4c2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:32.585252 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-331a6795-b377-46c4-85b0-95b10b1fa4c2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:32.633794 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-331a6795-b377-46c4-85b0-95b10b1fa4c2 admin admin] 10.222.0.118 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.4497132 Feb 08 18:15:32.637543 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 40144) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:32.643033 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-80de78b4-aed3-4e01-82e9-6ab348684031 admin admin] Request body: {'subnet': {'network_id': '9e46e43c-9a0e-4aa5-ae29-657bef15fd06', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1871603361-subnet', 'tenant_id': '3c9980c371f945a2b74398ba27cd5da2', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:15:32.645888 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-331a6795-b377-46c4-85b0-95b10b1fa4c2 admin admin] Pushing event updated for resources: {'Network': ['ID=9e46e43c-9a0e-4aa5-ae29-657bef15fd06,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:32.656409 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Network 9e46e43c-9a0e-4aa5-ae29-657bef15fd06 details requested by agent ovs-agent-dv-cinder-773985-21-iscsi with host dv-cinder-773985-21-iscsi {{(pid=102561) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Feb 08 18:15:32.664549 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-80de78b4-aed3-4e01-82e9-6ab348684031 admin admin] Made reservation on behalf of 3c9980c371f945a2b74398ba27cd5da2 for: {'subnet': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:15:32.667115 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-80de78b4-aed3-4e01-82e9-6ab348684031 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-63685351'] for subnet (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:32.832885 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-80de78b4-aed3-4e01-82e9-6ab348684031 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-63856587', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-63685337'] for subnet (bba9e0af-815f-4878-bdf5-e96922f6d737), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:32.887491 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80de78b4-aed3-4e01-82e9-6ab348684031 admin admin] Pushing event updated for resources: {'Subnet': ['ID=bba9e0af-815f-4878-bdf5-e96922f6d737,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:32.894729 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-80de78b4-aed3-4e01-82e9-6ab348684031 admin admin] Checking segment: {'id': '27dffb5a-ba77-4a4f-8f60-cf4adeebd4a9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1073, 'network_id': '9e46e43c-9a0e-4aa5-ae29-657bef15fd06'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102559) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:15:32.895081 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-80de78b4-aed3-4e01-82e9-6ab348684031 admin admin] Network hostable DHCP agents. Network: 9e46e43c-9a0e-4aa5-ae29-657bef15fd06, hostable agents: ['006b5388-ac7d-4794-a124-14bb8e5d8fec'], hosted agents: [] {{(pid=102559) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Feb 08 18:15:32.913062 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-80de78b4-aed3-4e01-82e9-6ab348684031 admin admin] Network 9e46e43c-9a0e-4aa5-ae29-657bef15fd06 is scheduled to be hosted by DHCP agent 006b5388-ac7d-4794-a124-14bb8e5d8fec with binding_index 1 {{(pid=102559) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Feb 08 18:15:32.923813 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-80de78b4-aed3-4e01-82e9-6ab348684031 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773985-21-iscsi, 9e46e43c-9a0e-4aa5-ae29-657bef15fd06) {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:15:32.928433 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80de78b4-aed3-4e01-82e9-6ab348684031 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:32.929098 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-80de78b4-aed3-4e01-82e9-6ab348684031 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:32.934387 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b09ea634-2c87-4247-8154-c0bd3b03f667 None None] Network 9e46e43c-9a0e-4aa5-ae29-657bef15fd06 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:15:32.954536 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-80de78b4-aed3-4e01-82e9-6ab348684031 admin admin] 10.222.0.118 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.3083875 Feb 08 18:15:33.058507 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b7925876-c4b2-43d9-8e3c-10e66104b3f2 None None] Network 9e46e43c-9a0e-4aa5-ae29-657bef15fd06 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:15:33.241364 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d930423-d055-4e12-b175-e6669c1672de req-5461d6d7-2c67-44d6-82d5-f3f003999154 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:33.243293 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1d930423-d055-4e12-b175-e6669c1672de req-5461d6d7-2c67-44d6-82d5-f3f003999154 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.1141040 Feb 08 18:15:33.298197 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1d930423-d055-4e12-b175-e6669c1672de req-f453e6b1-3f5d-4baf-bca6-2ae6d701566d tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0420537 Feb 08 18:15:34.421182 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-307b7b8a-ba78-415a-b34a-c9f52396ba2b req-2deaffd3-2767-4cf3-8151-0b899c7695d4 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:34.422654 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-307b7b8a-ba78-415a-b34a-c9f52396ba2b req-2deaffd3-2767-4cf3-8151-0b899c7695d4 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0556130 Feb 08 18:15:34.470377 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-307b7b8a-ba78-415a-b34a-c9f52396ba2b req-3a1141ca-214e-4c91-80c0-1601f7ae6a7d tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413513 Feb 08 18:15:44.977925 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:15:45.377314 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2550b1fe-1a15-4ba0-8a24-3d2117311e6a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:47.816671 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-e7a786db-d1aa-476e-be86-09cbbbe6fefc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:47.963350 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:48.491234 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:48.713010 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 40436) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:48.757494 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_v2 [None req-a545efd2-6952-48a1-a1a3-fa68ba87a956 admin admin] Deleting subnet 2085df58-b213-4f90-8416-9f2c9a9420b0 {{(pid=102559) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Feb 08 18:15:48.761881 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a545efd2-6952-48a1-a1a3-fa68ba87a956 admin admin] Publish callbacks [] for subnet (2085df58-b213-4f90-8416-9f2c9a9420b0), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:48.794123 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a545efd2-6952-48a1-a1a3-fa68ba87a956 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-63850237'] for subnet (2085df58-b213-4f90-8416-9f2c9a9420b0), precommit_delete_associations {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:48.834949 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a545efd2-6952-48a1-a1a3-fa68ba87a956 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1801023'] for subnet (2085df58-b213-4f90-8416-9f2c9a9420b0), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:48.888886 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a545efd2-6952-48a1-a1a3-fa68ba87a956 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1801156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-63856520', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-63685312'] for subnet (2085df58-b213-4f90-8416-9f2c9a9420b0), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:48.911164 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a545efd2-6952-48a1-a1a3-fa68ba87a956 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2085df58-b213-4f90-8416-9f2c9a9420b0,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:48.918519 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a545efd2-6952-48a1-a1a3-fa68ba87a956 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:48.921870 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-a545efd2-6952-48a1-a1a3-fa68ba87a956 admin admin] 10.222.0.118 "DELETE /v2.0/subnets/2085df58-b213-4f90-8416-9f2c9a9420b0 HTTP/1.1" status: 204 len: 168 time: 0.2077572 Feb 08 18:15:48.924495 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 40440) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:48.989647 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5162b9ee-0e64-4a08-b5db-00f53846f634 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1860329'] for network (e861722a-6c3e-408a-8c41-77287d1f06d4), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:49.071506 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5162b9ee-0e64-4a08-b5db-00f53846f634 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1721768', 'neutron.services.segments.db._delete_segments_for_network-8770558865089'] for network (e861722a-6c3e-408a-8c41-77287d1f06d4), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:49.093321 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.services.segments.db [None req-5162b9ee-0e64-4a08-b5db-00f53846f634 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e861722a-6c3e-408a-8c41-77287d1f06d4']}} {{(pid=102559) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:15:49.102988 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.services.segments.db [None req-5162b9ee-0e64-4a08-b5db-00f53846f634 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9660affe-270d-401a-89cc-105ae6ad2183') {'for_net_delete': True} {{(pid=102559) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:15:49.103288 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.services.segments.db [None req-5162b9ee-0e64-4a08-b5db-00f53846f634 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9660affe-270d-401a-89cc-105ae6ad2183') {} {{(pid=102559) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:15:49.112637 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5162b9ee-0e64-4a08-b5db-00f53846f634 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8770558866122', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-63850230'] for segment (9660affe-270d-401a-89cc-105ae6ad2183), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:49.126213 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5162b9ee-0e64-4a08-b5db-00f53846f634 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (9660affe-270d-401a-89cc-105ae6ad2183), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:49.132713 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-5162b9ee-0e64-4a08-b5db-00f53846f634 admin admin] Releasing vlan 1094 on physical network physnet1 to pool {{(pid=102559) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Feb 08 18:15:49.133115 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5162b9ee-0e64-4a08-b5db-00f53846f634 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-63856418'] for segment (9660affe-270d-401a-89cc-105ae6ad2183), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: Traceback (most recent call last): Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: timer() Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: cb(*args, **kw) Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: return func(*args, **kwargs) Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: self._notify() Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: self.callback(batched_events) Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: event.method(event) Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: aggregate_uuid = self.p_client.list_aggregates( Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: return f(self, *a, **k) Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: return self._get(url).json() Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: return self._client.get(url, endpoint_filter=self._ks_filter, Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: return self.request(url, 'GET', **kwargs) Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: base_url = self.get_endpoint(auth, allow=allow, Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 08 18:15:49.134904 dv-cinder-773985-21-iscsi neutron-server[102559]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 08 18:15:49.189439 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5162b9ee-0e64-4a08-b5db-00f53846f634 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1721777', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-560760'] for network (e861722a-6c3e-408a-8c41-77287d1f06d4), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:49.194496 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5162b9ee-0e64-4a08-b5db-00f53846f634 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:49.197630 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-5162b9ee-0e64-4a08-b5db-00f53846f634 admin admin] 10.222.0.118 "DELETE /v2.0/networks/e861722a-6c3e-408a-8c41-77287d1f06d4 HTTP/1.1" status: 204 len: 168 time: 0.2718763 Feb 08 18:15:49.200590 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 40442) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:49.211919 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5162b9ee-0e64-4a08-b5db-00f53846f634 admin admin] Pushing event deleted for resources: {'Network': ['ID=e861722a-6c3e-408a-8c41-77287d1f06d4,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:49.245650 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_v2 [None req-eb729605-7bf6-4ebf-9355-9395ae13db1b admin admin] Deleting subnet bba9e0af-815f-4878-bdf5-e96922f6d737 {{(pid=102560) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Feb 08 18:15:49.249067 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-eb729605-7bf6-4ebf-9355-9395ae13db1b admin admin] Publish callbacks [] for subnet (bba9e0af-815f-4878-bdf5-e96922f6d737), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:49.284546 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-eb729605-7bf6-4ebf-9355-9395ae13db1b admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-64533851'] for subnet (bba9e0af-815f-4878-bdf5-e96922f6d737), precommit_delete_associations {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:49.328794 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-eb729605-7bf6-4ebf-9355-9395ae13db1b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1801023'] for subnet (bba9e0af-815f-4878-bdf5-e96922f6d737), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:49.383167 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-eb729605-7bf6-4ebf-9355-9395ae13db1b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1801156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-64531538', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-64597460'] for subnet (bba9e0af-815f-4878-bdf5-e96922f6d737), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:49.407642 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb729605-7bf6-4ebf-9355-9395ae13db1b admin admin] Pushing event deleted for resources: {'Subnet': ['ID=bba9e0af-815f-4878-bdf5-e96922f6d737,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:49.411233 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-eb729605-7bf6-4ebf-9355-9395ae13db1b admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:49.414497 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-eb729605-7bf6-4ebf-9355-9395ae13db1b admin admin] 10.222.0.118 "DELETE /v2.0/subnets/bba9e0af-815f-4878-bdf5-e96922f6d737 HTTP/1.1" status: 204 len: 168 time: 0.2126875 Feb 08 18:15:49.417041 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 40444) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:49.481624 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-922ec0f4-d872-4155-be5a-3b6ca0722d69 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1860329'] for network (9e46e43c-9a0e-4aa5-ae29-657bef15fd06), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:49.562046 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-922ec0f4-d872-4155-be5a-3b6ca0722d69 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1721768', 'neutron.services.segments.db._delete_segments_for_network-8770558865089'] for network (9e46e43c-9a0e-4aa5-ae29-657bef15fd06), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:49.582797 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-922ec0f4-d872-4155-be5a-3b6ca0722d69 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9e46e43c-9a0e-4aa5-ae29-657bef15fd06']}} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:15:49.592358 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-922ec0f4-d872-4155-be5a-3b6ca0722d69 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '27dffb5a-ba77-4a4f-8f60-cf4adeebd4a9') {'for_net_delete': True} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:15:49.592661 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-922ec0f4-d872-4155-be5a-3b6ca0722d69 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '27dffb5a-ba77-4a4f-8f60-cf4adeebd4a9') {} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:15:49.602195 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-922ec0f4-d872-4155-be5a-3b6ca0722d69 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8770558866122', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-64533840'] for segment (27dffb5a-ba77-4a4f-8f60-cf4adeebd4a9), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:49.615984 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-922ec0f4-d872-4155-be5a-3b6ca0722d69 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (27dffb5a-ba77-4a4f-8f60-cf4adeebd4a9), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:49.622322 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-922ec0f4-d872-4155-be5a-3b6ca0722d69 admin admin] Releasing vlan 1073 on physical network physnet1 to pool {{(pid=102560) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Feb 08 18:15:49.622812 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-922ec0f4-d872-4155-be5a-3b6ca0722d69 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-64531704'] for segment (27dffb5a-ba77-4a4f-8f60-cf4adeebd4a9), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: Traceback (most recent call last): Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: timer() Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: cb(*args, **kw) Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: return func(*args, **kwargs) Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: self._notify() Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: self.callback(batched_events) Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: event.method(event) Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: aggregate_uuid = self.p_client.list_aggregates( Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: return f(self, *a, **k) Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: return self._get(url).json() Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: return self._client.get(url, endpoint_filter=self._ks_filter, Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: return self.request(url, 'GET', **kwargs) Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: base_url = self.get_endpoint(auth, allow=allow, Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 08 18:15:49.624398 dv-cinder-773985-21-iscsi neutron-server[102560]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 08 18:15:49.683010 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-922ec0f4-d872-4155-be5a-3b6ca0722d69 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1721777', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-560760'] for network (9e46e43c-9a0e-4aa5-ae29-657bef15fd06), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:49.688149 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-922ec0f4-d872-4155-be5a-3b6ca0722d69 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:49.691286 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-922ec0f4-d872-4155-be5a-3b6ca0722d69 admin admin] 10.222.0.118 "DELETE /v2.0/networks/9e46e43c-9a0e-4aa5-ae29-657bef15fd06 HTTP/1.1" status: 204 len: 168 time: 0.2733450 Feb 08 18:15:49.702373 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-922ec0f4-d872-4155-be5a-3b6ca0722d69 admin admin] Pushing event deleted for resources: {'Network': ['ID=9e46e43c-9a0e-4aa5-ae29-657bef15fd06,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:49.856493 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 40460) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:49.896889 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-4ff1a966-4196-4059-81a4-ed00a36d0265 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=d79db57c8c264cd680dd87d2b99f6ebb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0391011 Feb 08 18:15:49.899499 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 40462) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:49.954181 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-5ef3a383-7bdb-4c10-8943-7256db2f6ab9 admin admin] Publish callbacks [] for security_group (8d8fff6e-6e70-4fab-b750-c3052e6198d0), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:49.974845 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-5ef3a383-7bdb-4c10-8943-7256db2f6ab9 admin admin] Publish callbacks [] for security_group (8d8fff6e-6e70-4fab-b750-c3052e6198d0), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:50.057732 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-250ae98d-b28b-4ca7-b04a-1e21cea92316 req-59af1157-f475-4ccb-a6f9-766430b6a223 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:50.059238 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-250ae98d-b28b-4ca7-b04a-1e21cea92316 req-59af1157-f475-4ccb-a6f9-766430b6a223 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 946 time: 0.0707567 Feb 08 18:15:50.060303 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-5ef3a383-7bdb-4c10-8943-7256db2f6ab9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (8d8fff6e-6e70-4fab-b750-c3052e6198d0), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:50.062840 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-5ef3a383-7bdb-4c10-8943-7256db2f6ab9 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:50.063843 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-5ef3a383-7bdb-4c10-8943-7256db2f6ab9 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/8d8fff6e-6e70-4fab-b750-c3052e6198d0 HTTP/1.1" status: 204 len: 168 time: 0.1634922 Feb 08 18:15:50.082693 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ef3a383-7bdb-4c10-8943-7256db2f6ab9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8d8fff6e-6e70-4fab-b750-c3052e6198d0,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:50.105667 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:50.115393 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-250ae98d-b28b-4ca7-b04a-1e21cea92316 req-3ccbd222-4ede-4af5-b87d-3e02d721313c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0489166 Feb 08 18:15:50.400963 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 40470) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:50.442809 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-c9ac58c9-d1df-4629-84e8-c0896f259fc8 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=3c9980c371f945a2b74398ba27cd5da2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0400271 Feb 08 18:15:50.444841 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 40472) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:50.507632 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-93490511-ea41-40f4-beab-93882b1bc7d4 admin admin] Publish callbacks [] for security_group (44d2b451-eaf7-4506-b0a6-5bd10a1bd046), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:50.529178 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-93490511-ea41-40f4-beab-93882b1bc7d4 admin admin] Publish callbacks [] for security_group (44d2b451-eaf7-4506-b0a6-5bd10a1bd046), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:50.576600 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-93490511-ea41-40f4-beab-93882b1bc7d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (44d2b451-eaf7-4506-b0a6-5bd10a1bd046), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:50.579369 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-93490511-ea41-40f4-beab-93882b1bc7d4 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:50.580514 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-93490511-ea41-40f4-beab-93882b1bc7d4 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/44d2b451-eaf7-4506-b0a6-5bd10a1bd046 HTTP/1.1" status: 204 len: 168 time: 0.1347554 Feb 08 18:15:50.587982 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93490511-ea41-40f4-beab-93882b1bc7d4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=44d2b451-eaf7-4506-b0a6-5bd10a1bd046,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:51.242804 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32f8290d-a9d8-4d9c-898a-07c2f9d89ecf req-0b5536eb-a1a7-43ea-9982-e8ad121c2959 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:51.244336 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-32f8290d-a9d8-4d9c-898a-07c2f9d89ecf req-0b5536eb-a1a7-43ea-9982-e8ad121c2959 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 946 time: 0.0534785 Feb 08 18:15:51.294344 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-32f8290d-a9d8-4d9c-898a-07c2f9d89ecf req-c1c7d694-d2eb-410e-b8cf-af792fb50261 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=996a6093-6720-4c3e-aa49-14509ff61ad7&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439351 Feb 08 18:15:51.540273 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d297f19b-24ca-4810-9e9b-4e704a676fa0 req-64030615-7fdd-4031-a982-4c78ad50fa56 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:15:51.541762 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d297f19b-24ca-4810-9e9b-4e704a676fa0 req-64030615-7fdd-4031-a982-4c78ad50fa56 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.109 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 946 time: 0.0559018 Feb 08 18:15:51.637199 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-d297f19b-24ca-4810-9e9b-4e704a676fa0 req-3a236785-e9b7-47be-9a77-14e5f705c7b5 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Deleting port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:15:51.637537 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-d297f19b-24ca-4810-9e9b-4e704a676fa0 req-3a236785-e9b7-47be-9a77-14e5f705c7b5 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:51.670615 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:51.733732 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-d297f19b-24ca-4810-9e9b-4e704a676fa0 req-3a236785-e9b7-47be-9a77-14e5f705c7b5 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] For port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:15:51.734337 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-d297f19b-24ca-4810-9e9b-4e704a676fa0 req-3a236785-e9b7-47be-9a77-14e5f705c7b5 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:52.224279 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-d297f19b-24ca-4810-9e9b-4e704a676fa0 req-3a236785-e9b7-47be-9a77-14e5f705c7b5 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:52.224644 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-d297f19b-24ca-4810-9e9b-4e704a676fa0 req-3a236785-e9b7-47be-9a77-14e5f705c7b5 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-560746'] for floatingip (693198c9-5ae8-4773-8f2e-6a69445aaeef), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:52.224975 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.l3_db [req-d297f19b-24ca-4810-9e9b-4e704a676fa0 req-3a236785-e9b7-47be-9a77-14e5f705c7b5 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Floating IP 693198c9-5ae8-4773-8f2e-6a69445aaeef disassociated. External IP: 172.27.1.172, port: 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8. Feb 08 18:15:52.225332 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-d297f19b-24ca-4810-9e9b-4e704a676fa0 req-3a236785-e9b7-47be-9a77-14e5f705c7b5 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Calling delete_port for 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 owned by compute:nova {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:15:52.364122 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-d297f19b-24ca-4810-9e9b-4e704a676fa0 req-3a236785-e9b7-47be-9a77-14e5f705c7b5 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (2f2d1cfd-91ec-450a-bfe2-52d21f9196e8), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:52.400538 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a236785-e9b7-47be-9a77-14e5f705c7b5 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Pushing event deleted for resources: {'Port': ['ID=2f2d1cfd-91ec-450a-bfe2-52d21f9196e8,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:52.417210 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-71c166fa-0329-4889-bd3f-31991e101d4f req-1e25b5a1-d0b6-42d4-8e18-0e1a25dfee28 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 210 time: 0.0465503 Feb 08 18:15:52.536246 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [req-d297f19b-24ca-4810-9e9b-4e704a676fa0 req-3a236785-e9b7-47be-9a77-14e5f705c7b5 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Router 058f0c04-e3de-4d16-8a7a-a7247919133c has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:15:52.651223 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-d297f19b-24ca-4810-9e9b-4e704a676fa0 req-3a236785-e9b7-47be-9a77-14e5f705c7b5 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:15:52.664180 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a989eb2b-2733-4e5e-af0c-829b028602c5 None None] Sync routers for ids ['058f0c04-e3de-4d16-8a7a-a7247919133c'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:15:52.676230 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a989eb2b-2733-4e5e-af0c-829b028602c5 None None] Routers {'058f0c04-e3de-4d16-8a7a-a7247919133c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:15:52.677085 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-a989eb2b-2733-4e5e-af0c-829b028602c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:15:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['058f0c04-e3de-4d16-8a7a-a7247919133c'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:15:52.694269 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [req-d297f19b-24ca-4810-9e9b-4e704a676fa0 req-3a236785-e9b7-47be-9a77-14e5f705c7b5 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] No DVR routers for this DVR port 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 on host hv-cinder-77398 {{(pid=102560) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:15:52.696779 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-d297f19b-24ca-4810-9e9b-4e704a676fa0 req-3a236785-e9b7-47be-9a77-14e5f705c7b5 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:52.700291 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d297f19b-24ca-4810-9e9b-4e704a676fa0 req-3a236785-e9b7-47be-9a77-14e5f705c7b5 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.109 "DELETE /v2.0/ports/2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 HTTP/1.1" status: 204 len: 173 time: 1.1525173 Feb 08 18:15:52.700727 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5', 'name': 'network-vif-deleted', 'tag': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:15:52.703003 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ad82d4f9-6793-41cc-886d-a71bd8399704" -d '{"events": [{"server_uuid": "75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5", "name": "network-vif-deleted", "tag": "2f2d1cfd-91ec-450a-bfe2-52d21f9196e8"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:15:52.742667 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:15:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9219b609-be65-4be2-baaa-97229d73be29 x-openstack-request-id: req-9219b609-be65-4be2-baaa-97229d73be29 {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:15:52.743006 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5", "name": "network-vif-deleted", "tag": "2f2d1cfd-91ec-450a-bfe2-52d21f9196e8", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:15:52.743256 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-9219b609-be65-4be2-baaa-97229d73be29 {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:15:52.743651 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5', 'name': 'network-vif-deleted', 'tag': '2f2d1cfd-91ec-450a-bfe2-52d21f9196e8', 'status': 'completed', 'code': 200} Feb 08 18:15:52.798606 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-a989eb2b-2733-4e5e-af0c-829b028602c5 None None] Set router 058f0c04-e3de-4d16-8a7a-a7247919133c gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:15:53.006381 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-a989eb2b-2733-4e5e-af0c-829b028602c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'name': 'tempest-AttachVolumeShelveTestJSON-785190803-router', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106'}], 'enable_snat': True}, 'gw_port_id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:11Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'gw_port': {'id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:49:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:14Z', 'updated_at': '2022-02-08T18:12:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'e29130bd-e04d-4042-835b-4ba71dbf114e', 'name': '', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'mac_address': 'fa:16:3e:aa:1e:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '73de7865-d87d-4a2a-a702-160c400f145f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:21Z', 'updated_at': '2022-02-08T18:12:30Z', 'revision_number': 5, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'subnets': [{'id': '73de7865-d87d-4a2a-a702-160c400f145f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:15:53.032700 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a989eb2b-2733-4e5e-af0c-829b028602c5 None None] Checking router: 058f0c04-e3de-4d16-8a7a-a7247919133c for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:15:53.042396 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a989eb2b-2733-4e5e-af0c-829b028602c5 None None] Routers {'058f0c04-e3de-4d16-8a7a-a7247919133c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:15:53.043013 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-a989eb2b-2733-4e5e-af0c-829b028602c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:15:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['058f0c04-e3de-4d16-8a7a-a7247919133c'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:15:53.155796 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-a989eb2b-2733-4e5e-af0c-829b028602c5 None None] Set router 058f0c04-e3de-4d16-8a7a-a7247919133c gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:15:53.369256 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-a989eb2b-2733-4e5e-af0c-829b028602c5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'name': 'tempest-AttachVolumeShelveTestJSON-785190803-router', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106'}], 'enable_snat': True}, 'gw_port_id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:11Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'gw_port': {'id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:49:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:14Z', 'updated_at': '2022-02-08T18:12:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'e29130bd-e04d-4042-835b-4ba71dbf114e', 'name': '', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'mac_address': 'fa:16:3e:aa:1e:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '73de7865-d87d-4a2a-a702-160c400f145f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:21Z', 'updated_at': '2022-02-08T18:12:30Z', 'revision_number': 5, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'subnets': [{'id': '73de7865-d87d-4a2a-a702-160c400f145f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:15:53.396444 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a989eb2b-2733-4e5e-af0c-829b028602c5 None None] The sync data for ids ['058f0c04-e3de-4d16-8a7a-a7247919133c'] in dv-cinder-773985-21-iscsi is: [{'id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'name': 'tempest-AttachVolumeShelveTestJSON-785190803-router', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106'}], 'enable_snat': True}, 'gw_port_id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:11Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'gw_port': {'id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:49:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:14Z', 'updated_at': '2022-02-08T18:12:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'e29130bd-e04d-4042-835b-4ba71dbf114e', 'name': '', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'mac_address': 'fa:16:3e:aa:1e:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '73de7865-d87d-4a2a-a702-160c400f145f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:21Z', 'updated_at': '2022-02-08T18:12:30Z', 'revision_number': 5, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'subnets': [{'id': '73de7865-d87d-4a2a-a702-160c400f145f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:15:53.529891 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-df503c25-7701-4268-918b-ed6ace742845 req-776c2ebb-8474-45b1-b204-6bf9ffb08b0f tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 210 time: 0.0327468 Feb 08 18:15:53.629727 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2a6c98f2-6221-4228-9333-ae6387defc07 None None] New status for floating IP 693198c9-5ae8-4773-8f2e-6a69445aaeef: DOWN {{(pid=102562) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Feb 08 18:15:54.645891 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-532e2615-1ac0-4a93-8986-4d924e5ca5fc req-8b2aa74d-5c0d-4fed-83d5-e210d84feaf4 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 210 time: 0.0304537 Feb 08 18:15:55.764162 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-7c31ec39-feb9-406a-9017-cfcd620b02e8 req-dce9b9cf-4456-4b42-bcd5-d6f2e436a8f2 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 210 time: 0.0305107 Feb 08 18:15:56.893027 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-15ff31db-d19e-409c-9f01-a0bdcbdafe81 req-02574375-0880-460d-b8d0-47529ef675c6 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=75bd19f4-6c42-4436-b9ff-ad9b5cbdf2c5 HTTP/1.1" status: 200 len: 210 time: 0.0394757 Feb 08 18:15:57.775611 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:15:57.800655 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] No Port match for: 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:15:57.801051 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 2f2d1cfd-91ec-450a-bfe2-52d21f9196e8 not bound to the agent host hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:15:57.996383 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 40610) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:58.053284 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f7ccfb4f-8f45-4483-afe2-1d75a40ce522 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group (996a6093-6720-4c3e-aa49-14509ff61ad7), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:58.076887 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f7ccfb4f-8f45-4483-afe2-1d75a40ce522 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group (996a6093-6720-4c3e-aa49-14509ff61ad7), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:58.127353 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f7ccfb4f-8f45-4483-afe2-1d75a40ce522 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (996a6093-6720-4c3e-aa49-14509ff61ad7), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:58.129931 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f7ccfb4f-8f45-4483-afe2-1d75a40ce522 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:58.131106 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-f7ccfb4f-8f45-4483-afe2-1d75a40ce522 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "DELETE /v2.0/security-groups/996a6093-6720-4c3e-aa49-14509ff61ad7 HTTP/1.1" status: 204 len: 168 time: 0.1328816 Feb 08 18:15:58.133980 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 40612) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:58.140597 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f7ccfb4f-8f45-4483-afe2-1d75a40ce522 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=996a6093-6720-4c3e-aa49-14509ff61ad7,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:58.151750 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.api.v2.resource [None req-dff9def9-a721-45c8-a6f5-81d88b890e3e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] show failed (client error): The resource could not be found. Feb 08 18:15:58.156234 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-dff9def9-a721-45c8-a6f5-81d88b890e3e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups/996a6093-6720-4c3e-aa49-14509ff61ad7 HTTP/1.1" status: 404 len: 347 time: 0.0181818 Feb 08 18:15:58.157781 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 40616) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:58.319809 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-9f1221f2-98f3-47f8-92b1-aa688d32409c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Deleting port b74985b8-8fa2-411c-b4e8-fb2dcf0abb7b {{(pid=102559) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:15:58.320160 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9f1221f2-98f3-47f8-92b1-aa688d32409c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (b74985b8-8fa2-411c-b4e8-fb2dcf0abb7b), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:58.399686 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9f1221f2-98f3-47f8-92b1-aa688d32409c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (b74985b8-8fa2-411c-b4e8-fb2dcf0abb7b), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:58.400064 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9f1221f2-98f3-47f8-92b1-aa688d32409c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for floatingip (b74985b8-8fa2-411c-b4e8-fb2dcf0abb7b), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:58.412386 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-9f1221f2-98f3-47f8-92b1-aa688d32409c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Calling delete_port for b74985b8-8fa2-411c-b4e8-fb2dcf0abb7b owned by network:floatingip {{(pid=102559) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:15:58.558413 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9f1221f2-98f3-47f8-92b1-aa688d32409c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (b74985b8-8fa2-411c-b4e8-fb2dcf0abb7b), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:58.582808 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f1221f2-98f3-47f8-92b1-aa688d32409c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Pushing event deleted for resources: {'Port': ['ID=b74985b8-8fa2-411c-b4e8-fb2dcf0abb7b,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:58.646178 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9f1221f2-98f3-47f8-92b1-aa688d32409c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for floatingip (693198c9-5ae8-4773-8f2e-6a69445aaeef), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:58.648994 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9f1221f2-98f3-47f8-92b1-aa688d32409c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for floatingip (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:58.650271 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-9f1221f2-98f3-47f8-92b1-aa688d32409c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "DELETE /v2.0/floatingips/693198c9-5ae8-4773-8f2e-6a69445aaeef HTTP/1.1" status: 204 len: 168 time: 0.4928193 Feb 08 18:15:58.965877 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 40622) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:58.970622 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-3285ea0e-98e7-4029-aa0a-752e6934a2ab tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1162243627', 'description': 'tempest-description--1831302296'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:15:59.000647 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3285ea0e-98e7-4029-aa0a-752e6934a2ab tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:59.073524 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3285ea0e-98e7-4029-aa0a-752e6934a2ab tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group (625bb656-8167-4dc7-8c84-0415217847fb), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:59.078740 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3285ea0e-98e7-4029-aa0a-752e6934a2ab tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (625bb656-8167-4dc7-8c84-0415217847fb), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:59.120449 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3285ea0e-98e7-4029-aa0a-752e6934a2ab tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:59.121996 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-3285ea0e-98e7-4029-aa0a-752e6934a2ab tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.1548879 Feb 08 18:15:59.125106 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 40624) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:59.131102 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-26288789-d994-483a-ae23-66f82cec3e68 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Request body: {'security_group_rule': {'security_group_id': '625bb656-8167-4dc7-8c84-0415217847fb', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:15:59.136045 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3285ea0e-98e7-4029-aa0a-752e6934a2ab tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Pushing event updated for resources: {'SecurityGroup': ['ID=625bb656-8167-4dc7-8c84-0415217847fb,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:59.160519 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-26288789-d994-483a-ae23-66f82cec3e68 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group_rule (e4f60d6f-aada-4242-a5a9-98abd90a8bd6), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:59.219473 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-26288789-d994-483a-ae23-66f82cec3e68 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group_rule (e4f60d6f-aada-4242-a5a9-98abd90a8bd6), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:59.223944 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-26288789-d994-483a-ae23-66f82cec3e68 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (e4f60d6f-aada-4242-a5a9-98abd90a8bd6), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:59.241250 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26288789-d994-483a-ae23-66f82cec3e68 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e4f60d6f-aada-4242-a5a9-98abd90a8bd6,revision_number=0']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:59.249871 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-26288789-d994-483a-ae23-66f82cec3e68 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:59.251232 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-26288789-d994-483a-ae23-66f82cec3e68 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1243727 Feb 08 18:15:59.254125 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 40628) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:59.258798 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-fc4e4900-623d-45fd-8d44-4eac496e5071 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Request body: {'security_group_rule': {'security_group_id': '625bb656-8167-4dc7-8c84-0415217847fb', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:15:59.284980 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fc4e4900-623d-45fd-8d44-4eac496e5071 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group_rule (41dc1998-44a3-4ba6-9002-db628e86b8bd), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:59.347911 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fc4e4900-623d-45fd-8d44-4eac496e5071 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group_rule (41dc1998-44a3-4ba6-9002-db628e86b8bd), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:59.352637 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fc4e4900-623d-45fd-8d44-4eac496e5071 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (41dc1998-44a3-4ba6-9002-db628e86b8bd), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:59.375718 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc4e4900-623d-45fd-8d44-4eac496e5071 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=41dc1998-44a3-4ba6-9002-db628e86b8bd,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:59.383312 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fc4e4900-623d-45fd-8d44-4eac496e5071 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:59.387801 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-fc4e4900-623d-45fd-8d44-4eac496e5071 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1296070 Feb 08 18:15:59.387917 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 40636) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:15:59.392412 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-5c952fd9-1249-47df-88be-2abbd5ef3e1c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Request body: {'floatingip': {'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:15:59.412184 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5c952fd9-1249-47df-88be-2abbd5ef3e1c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for floatingip (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:59.514027 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5c952fd9-1249-47df-88be-2abbd5ef3e1c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:59.625308 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [None req-5c952fd9-1249-47df-88be-2abbd5ef3e1c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Allocated IP 172.27.1.57 (77055816-7c88-403d-8f8a-9be2c1faa10d/18547c52-7b23-42cd-bb53-214663ed102b/d9e5f415-0716-41fd-b19f-2aad9f978ef5) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:15:59.733106 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5c952fd9-1249-47df-88be-2abbd5ef3e1c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for port (d9e5f415-0716-41fd-b19f-2aad9f978ef5), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:59.773992 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5c952fd9-1249-47df-88be-2abbd5ef3e1c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (d9e5f415-0716-41fd-b19f-2aad9f978ef5), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:59.818743 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5c952fd9-1249-47df-88be-2abbd5ef3e1c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Network 77055816-7c88-403d-8f8a-9be2c1faa10d is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:15:59.821801 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-5c952fd9-1249-47df-88be-2abbd5ef3e1c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:15:59.824598 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5c952fd9-1249-47df-88be-2abbd5ef3e1c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:15:59.851115 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c952fd9-1249-47df-88be-2abbd5ef3e1c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Pushing event updated for resources: {'Port': ['ID=d9e5f415-0716-41fd-b19f-2aad9f978ef5,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:15:59.915969 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5c952fd9-1249-47df-88be-2abbd5ef3e1c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for floatingip (5fc12cc6-4f52-488c-9d27-d90b64bf94b3), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:15:59.953233 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5c952fd9-1249-47df-88be-2abbd5ef3e1c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (d9e5f415-0716-41fd-b19f-2aad9f978ef5), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:00.105546 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5c952fd9-1249-47df-88be-2abbd5ef3e1c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for port (d9e5f415-0716-41fd-b19f-2aad9f978ef5), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:00.111926 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5c952fd9-1249-47df-88be-2abbd5ef3e1c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-63856478'] for port (d9e5f415-0716-41fd-b19f-2aad9f978ef5), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:00.181658 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c952fd9-1249-47df-88be-2abbd5ef3e1c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Pushing event updated for resources: {'Port': ['ID=d9e5f415-0716-41fd-b19f-2aad9f978ef5,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:00.193556 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5c952fd9-1249-47df-88be-2abbd5ef3e1c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-560746'] for floatingip (5fc12cc6-4f52-488c-9d27-d90b64bf94b3), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:00.210980 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5c952fd9-1249-47df-88be-2abbd5ef3e1c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for floatingip (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:00.212244 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-5c952fd9-1249-47df-88be-2abbd5ef3e1c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 0.8234172 Feb 08 18:16:00.410942 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-0d9389e4-ea78-4aa5-bd9e-a54c3b151102 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?name=tempest-securitygroup--1162243627&fields=id&tenant_id=357dab3d3db74ef9a8ee50fdd8a8bdcd HTTP/1.1" status: 200 len: 267 time: 0.0441358 Feb 08 18:16:00.529007 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-0f42267b-d1c2-4480-9e2b-575c714a14b7 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:00.530475 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-0f42267b-d1c2-4480-9e2b-575c714a14b7 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/networks?id=7a854399-3ce6-42bd-bfc4-061132ecb9c2 HTTP/1.1" status: 200 len: 816 time: 0.1115031 Feb 08 18:16:00.546413 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-44696500-d9c5-446b-be84-1cba7c15e5ba tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/quotas/357dab3d3db74ef9a8ee50fdd8a8bdcd HTTP/1.1" status: 200 len: 375 time: 0.0102484 Feb 08 18:16:00.841790 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-c56d5711-2736-4c94-97ac-910f61ff60ec tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?tenant_id=357dab3d3db74ef9a8ee50fdd8a8bdcd&fields=id HTTP/1.1" status: 200 len: 302 time: 0.2898180 Feb 08 18:16:00.937340 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-cfec7191-25d9-4a47-9fb0-92675d1100b7 service neutron] 10.222.0.118 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0828221 Feb 08 18:16:01.033685 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-2887a2e6-094f-4607-a3b7-53325bf01797 service neutron] 10.222.0.118 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0905690 Feb 08 18:16:01.200560 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f0404810-bca5-41b4-98fc-7cf16ade1b1e req-f32efbae-3840-4b42-97f3-c18fa2f7e81b tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 210 time: 0.0292232 Feb 08 18:16:02.180882 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-469d6271-444a-457e-aa23-8eb0e7f78635 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:02.182471 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-469d6271-444a-457e-aa23-8eb0e7f78635 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.109 "GET /v2.0/networks?id=7a854399-3ce6-42bd-bfc4-061132ecb9c2 HTTP/1.1" status: 200 len: 816 time: 0.1184103 Feb 08 18:16:02.273853 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-95f1717b-2f53-4e39-a875-65bd95eba3cd tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.109 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=357dab3d3db74ef9a8ee50fdd8a8bdcd HTTP/1.1" status: 200 len: 380 time: 0.0816922 Feb 08 18:16:02.286935 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-0a491f6c-20d7-467b-a606-cee102d6ddb1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Request body: {'port': {'device_id': '097f7b21-9f4e-4341-831a-307f6b722f44', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'admin_state_up': True, 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'security_groups': ['625bb656-8167-4dc7-8c84-0415217847fb']}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:16:02.315116 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c0a497ef-3e64-4b8e-9e9b-047652f970cd req-9a74f1fd-0b46-4ff1-b3a6-ae340920050e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 210 time: 0.0365314 Feb 08 18:16:02.412959 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-0a491f6c-20d7-467b-a606-cee102d6ddb1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Made reservation on behalf of 357dab3d3db74ef9a8ee50fdd8a8bdcd for: {'port': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:16:02.418280 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-0a491f6c-20d7-467b-a606-cee102d6ddb1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:02.556362 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_common [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-0a491f6c-20d7-467b-a606-cee102d6ddb1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Allocated IP 172.20.0.5 (7a854399-3ce6-42bd-bfc4-061132ecb9c2/73de7865-d87d-4a2a-a702-160c400f145f/50b2e85d-5914-4f54-9939-14603e53f04e) {{(pid=102560) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:16:02.696614 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-0a491f6c-20d7-467b-a606-cee102d6ddb1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for port (50b2e85d-5914-4f54-9939-14603e53f04e), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:02.732504 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-0a491f6c-20d7-467b-a606-cee102d6ddb1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:02.775217 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-0a491f6c-20d7-467b-a606-cee102d6ddb1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Network 7a854399-3ce6-42bd-bfc4-061132ecb9c2 is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:16:02.778255 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-0a491f6c-20d7-467b-a606-cee102d6ddb1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:16:02.781850 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-0a491f6c-20d7-467b-a606-cee102d6ddb1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Received port after_create {{(pid=102560) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:16:02.788268 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0a491f6c-20d7-467b-a606-cee102d6ddb1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Pushing event updated for resources: {'Port': ['ID=50b2e85d-5914-4f54-9939-14603e53f04e,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:02.837727 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-0a491f6c-20d7-467b-a606-cee102d6ddb1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:02.838346 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-0a491f6c-20d7-467b-a606-cee102d6ddb1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:02.857441 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-0a491f6c-20d7-467b-a606-cee102d6ddb1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.109 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5744166 Feb 08 18:16:02.876047 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] Request body: {'port': {'device_id': '097f7b21-9f4e-4341-831a-307f6b722f44', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77398'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:16:02.937196 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:03.009213 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ce060880-932d-402d-bb7b-195ce7644005 None None] Provisioning complete for port 50b2e85d-5914-4f54-9939-14603e53f04e triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:16:03.009783 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ce060880-932d-402d-bb7b-195ce7644005 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:03.043099 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ce060880-932d-402d-bb7b-195ce7644005 None None] Port 50b2e85d-5914-4f54-9939-14603e53f04e cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:16:03.200451 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 50b2e85d-5914-4f54-9939-14603e53f04e {{(pid=102560) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:16:03.208448 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] Publish callbacks [] for port (50b2e85d-5914-4f54-9939-14603e53f04e), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:03.220450 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.provisioning_blocks [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] Transition to ACTIVE for port object 50b2e85d-5914-4f54-9939-14603e53f04e will not be triggered until provisioned by entity L2. {{(pid=102560) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Feb 08 18:16:03.225836 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-64531588'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:03.277106 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] Pushing event updated for resources: {'Port': ['ID=50b2e85d-5914-4f54-9939-14603e53f04e,revision_number=2']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:03.342965 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] Attempting to bind port 50b2e85d-5914-4f54-9939-14603e53f04e on host hv-cinder-77398 for vnic_type normal with profile {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:16:03.343801 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] Attempting to bind port 50b2e85d-5914-4f54-9939-14603e53f04e by drivers openvswitch,hyperv on host hv-cinder-77398 at level 0 using segments [{'id': '87601f46-1ba0-4a2e-93d3-e5859bcfbefa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1053, 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2'}] {{(pid=102560) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:16:03.344246 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] Attempting to bind port 50b2e85d-5914-4f54-9939-14603e53f04e on network 7a854399-3ce6-42bd-bfc4-061132ecb9c2 {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:16:03.350895 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] Port 50b2e85d-5914-4f54-9939-14603e53f04e on network 7a854399-3ce6-42bd-bfc4-061132ecb9c2 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77398 {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Feb 08 18:16:03.351229 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] Attempting to bind port 50b2e85d-5914-4f54-9939-14603e53f04e on network 7a854399-3ce6-42bd-bfc4-061132ecb9c2 {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:16:03.356710 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] Checking agent: {'id': '045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77398', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'started_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 15, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:16:03.357051 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] Checking segment: {'id': '87601f46-1ba0-4a2e-93d3-e5859bcfbefa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1053, 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102560) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:16:03.357431 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] Bound using segment: {'id': '87601f46-1ba0-4a2e-93d3-e5859bcfbefa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1053, 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2'} {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:16:03.357886 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] Bound port: 50b2e85d-5914-4f54-9939-14603e53f04e, host: hv-cinder-77398, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '87601f46-1ba0-4a2e-93d3-e5859bcfbefa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1053, 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2'}}] {{(pid=102560) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:16:03.358262 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:03.463146 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] For port 50b2e85d-5914-4f54-9939-14603e53f04e, host hv-cinder-77398, cleared binding levels {{(pid=102560) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:16:03.478759 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] For port 50b2e85d-5914-4f54-9939-14603e53f04e, host hv-cinder-77398, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=50b2e85d-5914-4f54-9939-14603e53f04e,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102560) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:16:03.487048 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-64531588'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:03.523287 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb01ec31-7cdd-4453-acde-2ece234c8cf9 req-75a94750-bda9-46a5-93bb-d87645c0e033 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:03.524829 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-fb01ec31-7cdd-4453-acde-2ece234c8cf9 req-75a94750-bda9-46a5-93bb-d87645c0e033 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 943 time: 0.1020899 Feb 08 18:16:03.533693 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:03.534869 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:03.536589 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] 10.222.0.109 "PUT /v2.0/ports/50b2e85d-5914-4f54-9939-14603e53f04e HTTP/1.1" status: 200 len: 1093 time: 0.6650863 Feb 08 18:16:03.540232 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '097f7b21-9f4e-4341-831a-307f6b722f44', 'tag': '50b2e85d-5914-4f54-9939-14603e53f04e'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:16:03.544037 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-23ed8c54-6edb-4552-9509-91a40ecbe1dd" -d '{"events": [{"name": "network-changed", "server_uuid": "097f7b21-9f4e-4341-831a-307f6b722f44", "tag": "50b2e85d-5914-4f54-9939-14603e53f04e"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:16:03.630115 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09dc734e-bdb1-4958-b7b0-bac223783e90 service neutron] Pushing event updated for resources: {'Port': ['ID=50b2e85d-5914-4f54-9939-14603e53f04e,revision_number=3']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:03.639956 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:16:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c0800e30-4a31-4d39-96c5-d57f1217e1ff x-openstack-request-id: req-c0800e30-4a31-4d39-96c5-d57f1217e1ff {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:16:03.640220 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "097f7b21-9f4e-4341-831a-307f6b722f44", "tag": "50b2e85d-5914-4f54-9939-14603e53f04e", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:16:03.640478 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-c0800e30-4a31-4d39-96c5-d57f1217e1ff {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:16:03.640954 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '097f7b21-9f4e-4341-831a-307f6b722f44', 'tag': '50b2e85d-5914-4f54-9939-14603e53f04e', 'status': 'completed', 'code': 200} Feb 08 18:16:03.668011 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-fb01ec31-7cdd-4453-acde-2ece234c8cf9 req-9416f686-6870-4dba-8523-bd69384d403a tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1303232 Feb 08 18:16:03.679943 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-33161c7c-cfb9-4189-9c44-71cafa122adb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:03.681456 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-33161c7c-cfb9-4189-9c44-71cafa122adb service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=357dab3d3db74ef9a8ee50fdd8a8bdcd&device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 1127 time: 0.0939085 Feb 08 18:16:03.735114 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-55908c3d-f835-4503-a8c5-69574b689bad service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=50b2e85d-5914-4f54-9939-14603e53f04e HTTP/1.1" status: 200 len: 217 time: 0.0390978 Feb 08 18:16:03.817052 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-05891228-778d-456d-b436-ef32c9b293d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:03.819305 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-05891228-778d-456d-b436-ef32c9b293d0 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=73de7865-d87d-4a2a-a702-160c400f145f HTTP/1.1" status: 200 len: 855 time: 0.0771952 Feb 08 18:16:03.879709 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-808e512b-ee63-4795-a7d6-f235249b29fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:03.881261 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-808e512b-ee63-4795-a7d6-f235249b29fb service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=7a854399-3ce6-42bd-bfc4-061132ecb9c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0543115 Feb 08 18:16:03.980305 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-f80ae4e8-0155-4ade-9dc2-6e2dbda9826c service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0911696 Feb 08 18:16:04.083146 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ef10d21a-1bbf-497a-9942-396baf6752d0 req-b4fc1b2e-2ed3-4811-a094-beade65c2196 service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0950205 Feb 08 18:16:04.218398 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ed8c54-6edb-4552-9509-91a40ecbe1dd req-d5637f16-7805-48c7-81a8-2f95aa1ffde1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:04.220050 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-23ed8c54-6edb-4552-9509-91a40ecbe1dd req-d5637f16-7805-48c7-81a8-2f95aa1ffde1 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=357dab3d3db74ef9a8ee50fdd8a8bdcd&device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 1127 time: 0.0537362 Feb 08 18:16:04.310709 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ed8c54-6edb-4552-9509-91a40ecbe1dd req-d684da13-c86b-4d3a-9741-4f1bfc49305c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:04.312231 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-23ed8c54-6edb-4552-9509-91a40ecbe1dd req-d684da13-c86b-4d3a-9741-4f1bfc49305c service neutron] 10.222.0.109 "GET /v2.0/networks?id=7a854399-3ce6-42bd-bfc4-061132ecb9c2 HTTP/1.1" status: 200 len: 918 time: 0.0825043 Feb 08 18:16:04.358497 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-23ed8c54-6edb-4552-9509-91a40ecbe1dd req-1b8a2614-ebc3-4d9e-b985-15565aa26bd1 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=50b2e85d-5914-4f54-9939-14603e53f04e HTTP/1.1" status: 200 len: 217 time: 0.0373259 Feb 08 18:16:04.413513 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ed8c54-6edb-4552-9509-91a40ecbe1dd req-7fef18fa-27b6-4f1b-a5bc-b6c33050f4e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:04.414951 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-23ed8c54-6edb-4552-9509-91a40ecbe1dd req-7fef18fa-27b6-4f1b-a5bc-b6c33050f4e6 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=73de7865-d87d-4a2a-a702-160c400f145f HTTP/1.1" status: 200 len: 855 time: 0.0429592 Feb 08 18:16:04.465793 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23ed8c54-6edb-4552-9509-91a40ecbe1dd req-f83b96c0-ad39-4383-9264-908f935834a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:04.467239 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-23ed8c54-6edb-4552-9509-91a40ecbe1dd req-f83b96c0-ad39-4383-9264-908f935834a8 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=7a854399-3ce6-42bd-bfc4-061132ecb9c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0453076 Feb 08 18:16:04.562656 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-23ed8c54-6edb-4552-9509-91a40ecbe1dd req-f0c542b0-2e45-4983-bad6-5130eae55011 service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0866342 Feb 08 18:16:04.650452 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-23ed8c54-6edb-4552-9509-91a40ecbe1dd req-2b567943-e208-4013-ba14-f22dd62cbb9d service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0795283 Feb 08 18:16:04.802105 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0e8e0e8-9909-476f-904c-dfb5601b9b13 req-12ef505f-86ac-4925-af39-4d779f34db11 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:04.803614 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a0e8e0e8-9909-476f-904c-dfb5601b9b13 req-12ef505f-86ac-4925-af39-4d779f34db11 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 943 time: 0.0553269 Feb 08 18:16:04.851354 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a0e8e0e8-9909-476f-904c-dfb5601b9b13 req-bd126d80-1a1e-450f-9317-02f2d9777317 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419025 Feb 08 18:16:05.983024 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-169cc075-5b03-467f-ab17-df7fd8850d26 req-9acd11cc-971f-4d6e-bbf1-168188a52164 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:05.984602 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-169cc075-5b03-467f-ab17-df7fd8850d26 req-9acd11cc-971f-4d6e-bbf1-168188a52164 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 943 time: 0.0541234 Feb 08 18:16:06.036297 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-169cc075-5b03-467f-ab17-df7fd8850d26 req-aaaacab8-2248-41f1-899b-6f8a82147c1c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459929 Feb 08 18:16:07.120883 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 50b2e85d-5914-4f54-9939-14603e53f04e details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:16:07.165767 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7377f866-f420-4959-abfa-2eac9d7d7c8a req-019f854c-2f0c-4f47-9244-a5a334dfc37a tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:07.167255 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7377f866-f420-4959-abfa-2eac9d7d7c8a req-019f854c-2f0c-4f47-9244-a5a334dfc37a tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 943 time: 0.0564103 Feb 08 18:16:07.213432 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7377f866-f420-4959-abfa-2eac9d7d7c8a req-8ccf5cdb-8708-4405-afd8-5f8bd90963a6 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404189 Feb 08 18:16:07.216688 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 50b2e85d-5914-4f54-9939-14603e53f04e, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=50b2e85d-5914-4f54-9939-14603e53f04e,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:16:07.228796 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': '50b2e85d-5914-4f54-9939-14603e53f04e', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'port_id': '50b2e85d-5914-4f54-9939-14603e53f04e', 'mac_address': 'fa:16:3e:8f:67:4b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1053, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '73de7865-d87d-4a2a-a702-160c400f145f', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:16:07.264639 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 50b2e85d-5914-4f54-9939-14603e53f04e is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:16:07.265024 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:07.281045 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 50b2e85d-5914-4f54-9939-14603e53f04e {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:16:07.303146 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 50b2e85d-5914-4f54-9939-14603e53f04e, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=50b2e85d-5914-4f54-9939-14603e53f04e,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:16:07.310053 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:07.361088 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=50b2e85d-5914-4f54-9939-14603e53f04e,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:07.368464 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:07.368816 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:07.369183 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:07.369518 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:07.369913 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:07.370341 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:07.370703 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:07.371140 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:07.371467 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:07.371812 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:07.372138 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:07.372459 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:07.372783 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:08.328671 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['50b2e85d-5914-4f54-9939-14603e53f04e'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:16:08.341747 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec79c808-0127-4abd-80af-7f4cd391df99 req-cc407490-feb3-40ea-86d8-fd8d899edd43 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:08.343258 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ec79c808-0127-4abd-80af-7f4cd391df99 req-cc407490-feb3-40ea-86d8-fd8d899edd43 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 944 time: 0.0565147 Feb 08 18:16:08.390543 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ec79c808-0127-4abd-80af-7f4cd391df99 req-03f48a02-161b-49df-86a4-ac45f076c92e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414073 Feb 08 18:16:09.514001 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48512cce-ea1f-41ce-b3ac-dc9ecdaab8bf req-a9beaa3a-26a2-4844-8666-3392485d5188 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:09.515712 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-48512cce-ea1f-41ce-b3ac-dc9ecdaab8bf req-a9beaa3a-26a2-4844-8666-3392485d5188 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 944 time: 0.0534372 Feb 08 18:16:09.579826 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-48512cce-ea1f-41ce-b3ac-dc9ecdaab8bf req-0d375fb3-b364-4e32-80ba-f0214202d0c7 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0564015 Feb 08 18:16:10.720152 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de525b86-171e-4455-8304-89c40cdeeb56 req-c0a77a98-827d-4747-a04f-14fd91d0a589 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:10.721609 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-de525b86-171e-4455-8304-89c40cdeeb56 req-c0a77a98-827d-4747-a04f-14fd91d0a589 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 944 time: 0.0590858 Feb 08 18:16:10.756143 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 50b2e85d-5914-4f54-9939-14603e53f04e up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:16:10.772159 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-de525b86-171e-4455-8304-89c40cdeeb56 req-2fca16bd-bce4-4a20-b95f-ca1b75975805 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445426 Feb 08 18:16:10.816450 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning for port 50b2e85d-5914-4f54-9939-14603e53f04e completed by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Feb 08 18:16:10.821532 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port 50b2e85d-5914-4f54-9939-14603e53f04e triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:16:10.822016 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:10.902987 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 50b2e85d-5914-4f54-9939-14603e53f04e is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:16:10.903561 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:10.928184 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '097f7b21-9f4e-4341-831a-307f6b722f44', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '50b2e85d-5914-4f54-9939-14603e53f04e'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:16:10.930947 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e73d3c05-77ec-450f-a9e8-64b5586c95ca" -d '{"events": [{"server_uuid": "097f7b21-9f4e-4341-831a-307f6b722f44", "name": "network-vif-plugged", "status": "completed", "tag": "50b2e85d-5914-4f54-9939-14603e53f04e"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:16:10.950657 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 50b2e85d-5914-4f54-9939-14603e53f04e, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=50b2e85d-5914-4f54-9939-14603e53f04e,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:16:10.955029 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:10.982567 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:16:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b78d63a8-e5a4-4f0f-b4de-32a30095a8dc x-openstack-request-id: req-b78d63a8-e5a4-4f0f-b4de-32a30095a8dc {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:16:10.983053 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "097f7b21-9f4e-4341-831a-307f6b722f44", "name": "network-vif-plugged", "status": "completed", "tag": "50b2e85d-5914-4f54-9939-14603e53f04e", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:16:10.983379 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-b78d63a8-e5a4-4f0f-b4de-32a30095a8dc {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:16:10.983935 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '097f7b21-9f4e-4341-831a-307f6b722f44', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '50b2e85d-5914-4f54-9939-14603e53f04e', 'code': 200} Feb 08 18:16:11.021078 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=50b2e85d-5914-4f54-9939-14603e53f04e,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:11.169829 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87c5830f-8877-425c-835e-3bea69d8b53d req-a252108d-940b-4f20-a54d-a655af70e9ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:11.171399 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-87c5830f-8877-425c-835e-3bea69d8b53d req-a252108d-940b-4f20-a54d-a655af70e9ce service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 1129 time: 0.0491166 Feb 08 18:16:11.216886 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-87c5830f-8877-425c-835e-3bea69d8b53d req-b4e9a637-7c67-4457-97e9-f4f40d8699fe service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0364027 Feb 08 18:16:11.906109 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed6bc5d2-c347-445b-9f7a-ff372ae46352 req-fd725bfb-2594-455a-ae56-be20dceefaa1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:11.907616 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ed6bc5d2-c347-445b-9f7a-ff372ae46352 req-fd725bfb-2594-455a-ae56-be20dceefaa1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0548642 Feb 08 18:16:11.955175 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ed6bc5d2-c347-445b-9f7a-ff372ae46352 req-cef94247-ed51-4d74-a915-f570753bf98a tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419285 Feb 08 18:16:12.400456 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 40876) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:16:12.503781 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d3d5586f-0c21-42f5-a760-579b49cab493 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:12.588912 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d3d5586f-0c21-42f5-a760-579b49cab493 admin admin] Publish callbacks [] for security_group (1a5f9e7d-b979-4172-8def-584edb7d5ad7), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:12.594557 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d3d5586f-0c21-42f5-a760-579b49cab493 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (1a5f9e7d-b979-4172-8def-584edb7d5ad7), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:12.631105 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-d3d5586f-0c21-42f5-a760-579b49cab493 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=ed573023ca8e46db8796aa5bedead520&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2295063 Feb 08 18:16:12.631912 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3d5586f-0c21-42f5-a760-579b49cab493 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1a5f9e7d-b979-4172-8def-584edb7d5ad7,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:12.634084 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 40880) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:16:12.687606 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-743bcea9-fed9-4577-a9e1-67d135377451 admin admin] Publish callbacks [] for security_group (1a5f9e7d-b979-4172-8def-584edb7d5ad7), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:12.718601 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-743bcea9-fed9-4577-a9e1-67d135377451 admin admin] Publish callbacks [] for security_group (1a5f9e7d-b979-4172-8def-584edb7d5ad7), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:12.776543 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-743bcea9-fed9-4577-a9e1-67d135377451 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (1a5f9e7d-b979-4172-8def-584edb7d5ad7), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:12.779346 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-743bcea9-fed9-4577-a9e1-67d135377451 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:12.780477 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-743bcea9-fed9-4577-a9e1-67d135377451 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/1a5f9e7d-b979-4172-8def-584edb7d5ad7 HTTP/1.1" status: 204 len: 168 time: 0.1454132 Feb 08 18:16:12.788201 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-743bcea9-fed9-4577-a9e1-67d135377451 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1a5f9e7d-b979-4172-8def-584edb7d5ad7,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:13.072547 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 40888) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:16:13.086047 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c17aa24b-0d02-468b-9707-16f8b0ae3614 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:13.096885 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-040627b7-9980-4649-ae26-ac7f72a9c4d8 req-e3340941-5011-4b46-8410-db7c4a6de50d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:13.098368 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-040627b7-9980-4649-ae26-ac7f72a9c4d8 req-e3340941-5011-4b46-8410-db7c4a6de50d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0637505 Feb 08 18:16:13.147310 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-040627b7-9980-4649-ae26-ac7f72a9c4d8 req-e43eb7f8-8d5c-4e9d-bdc9-0540f30ba846 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428882 Feb 08 18:16:13.161283 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c17aa24b-0d02-468b-9707-16f8b0ae3614 admin admin] Publish callbacks [] for security_group (ab53da73-5b20-4981-942f-ca47941afe5d), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:13.174488 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c17aa24b-0d02-468b-9707-16f8b0ae3614 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (ab53da73-5b20-4981-942f-ca47941afe5d), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:13.211807 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-c17aa24b-0d02-468b-9707-16f8b0ae3614 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=62082cd44f76469d9cef620300590c25&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1381855 Feb 08 18:16:13.212598 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c17aa24b-0d02-468b-9707-16f8b0ae3614 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ab53da73-5b20-4981-942f-ca47941afe5d,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:13.214691 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 40892) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:16:13.262079 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fa06ff12-c47d-4a7e-b5a5-5e6fe77e1534 admin admin] Publish callbacks [] for security_group (ab53da73-5b20-4981-942f-ca47941afe5d), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:13.283710 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fa06ff12-c47d-4a7e-b5a5-5e6fe77e1534 admin admin] Publish callbacks [] for security_group (ab53da73-5b20-4981-942f-ca47941afe5d), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:13.341641 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fa06ff12-c47d-4a7e-b5a5-5e6fe77e1534 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (ab53da73-5b20-4981-942f-ca47941afe5d), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:13.345049 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fa06ff12-c47d-4a7e-b5a5-5e6fe77e1534 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:13.346379 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-fa06ff12-c47d-4a7e-b5a5-5e6fe77e1534 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/ab53da73-5b20-4981-942f-ca47941afe5d HTTP/1.1" status: 204 len: 168 time: 0.1306167 Feb 08 18:16:13.354870 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa06ff12-c47d-4a7e-b5a5-5e6fe77e1534 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ab53da73-5b20-4981-942f-ca47941afe5d,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:14.281088 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07c70bfa-257d-4fe7-aa9b-8150583a285c req-b82c00f3-bb0d-465d-948e-4bc7986ff6a1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:14.281088 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-07c70bfa-257d-4fe7-aa9b-8150583a285c req-b82c00f3-bb0d-465d-948e-4bc7986ff6a1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0592287 Feb 08 18:16:14.329272 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-07c70bfa-257d-4fe7-aa9b-8150583a285c req-322a121a-66be-45d3-a694-a3f5cb640fbd tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443275 Feb 08 18:16:15.372105 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-6e48bc8e-c632-4ede-a01f-0c93c6eae453 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:15.455666 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3ccda5c-aeb5-40c6-bf42-826ed03362e4 req-be16ff4f-afea-4ab3-9b8b-fb3fb3501f95 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:15.457130 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b3ccda5c-aeb5-40c6-bf42-826ed03362e4 req-be16ff4f-afea-4ab3-9b8b-fb3fb3501f95 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0548327 Feb 08 18:16:15.505214 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b3ccda5c-aeb5-40c6-bf42-826ed03362e4 req-a3cabcc5-81f3-4ddd-9547-854a454eda68 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421033 Feb 08 18:16:15.626027 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06773d89-024c-4177-a313-b4587fea932f req-2a67625b-bc5d-4991-9d0f-b3c0712fb628 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:15.627568 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-06773d89-024c-4177-a313-b4587fea932f req-2a67625b-bc5d-4991-9d0f-b3c0712fb628 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0546682 Feb 08 18:16:15.637389 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 40952) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:16:15.641765 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-010220b3-5c76-4e27-954a-77f1cafa17f0 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Request body: {'floatingip': {'port_id': '50b2e85d-5914-4f54-9939-14603e53f04e'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:16:15.679367 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-010220b3-5c76-4e27-954a-77f1cafa17f0 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for floatingip (5fc12cc6-4f52-488c-9d27-d90b64bf94b3), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:16.103028 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-010220b3-5c76-4e27-954a-77f1cafa17f0 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:16.107922 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-010220b3-5c76-4e27-954a-77f1cafa17f0 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-560746'] for floatingip (5fc12cc6-4f52-488c-9d27-d90b64bf94b3), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:16.458970 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.l3_db [None req-010220b3-5c76-4e27-954a-77f1cafa17f0 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Floating IP 5fc12cc6-4f52-488c-9d27-d90b64bf94b3 associated. External IP: 172.27.1.57, port: 50b2e85d-5914-4f54-9939-14603e53f04e. Feb 08 18:16:16.675623 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-010220b3-5c76-4e27-954a-77f1cafa17f0 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Router 058f0c04-e3de-4d16-8a7a-a7247919133c has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:16:16.784770 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-010220b3-5c76-4e27-954a-77f1cafa17f0 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:16:16.789909 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-010220b3-5c76-4e27-954a-77f1cafa17f0 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for floatingip (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:16.796278 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f013acb0-14ef-4632-bcd0-6b4ef5209c70 None None] Sync routers for ids ['058f0c04-e3de-4d16-8a7a-a7247919133c'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:16:16.807019 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f013acb0-14ef-4632-bcd0-6b4ef5209c70 None None] Routers {'058f0c04-e3de-4d16-8a7a-a7247919133c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:16:16.807637 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-f013acb0-14ef-4632-bcd0-6b4ef5209c70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:15:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['058f0c04-e3de-4d16-8a7a-a7247919133c'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:16:16.821239 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-010220b3-5c76-4e27-954a-77f1cafa17f0 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "PUT /v2.0/floatingips/5fc12cc6-4f52-488c-9d27-d90b64bf94b3 HTTP/1.1" status: 200 len: 990 time: 1.1828077 Feb 08 18:16:16.821810 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '097f7b21-9f4e-4341-831a-307f6b722f44', 'tag': '50b2e85d-5914-4f54-9939-14603e53f04e'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:16:16.824062 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4ecd71b3-0c3c-4145-9fbe-e5b6ac4867f7" -d '{"events": [{"name": "network-changed", "server_uuid": "097f7b21-9f4e-4341-831a-307f6b722f44", "tag": "50b2e85d-5914-4f54-9939-14603e53f04e"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:16:16.868052 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:16:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3db9a776-5e12-443e-9897-0b920fa0137a x-openstack-request-id: req-3db9a776-5e12-443e-9897-0b920fa0137a {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:16:16.868428 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "097f7b21-9f4e-4341-831a-307f6b722f44", "tag": "50b2e85d-5914-4f54-9939-14603e53f04e", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:16:16.868752 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-3db9a776-5e12-443e-9897-0b920fa0137a {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:16:16.869211 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '097f7b21-9f4e-4341-831a-307f6b722f44', 'tag': '50b2e85d-5914-4f54-9939-14603e53f04e', 'status': 'completed', 'code': 200} Feb 08 18:16:16.921631 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-f013acb0-14ef-4632-bcd0-6b4ef5209c70 None None] Set router 058f0c04-e3de-4d16-8a7a-a7247919133c gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:16:16.925063 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7547039-00e1-4629-9e77-9e336ea44e10 req-15009804-4a6b-4a98-a4d3-6d5629a0e701 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:16.926715 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a7547039-00e1-4629-9e77-9e336ea44e10 req-15009804-4a6b-4a98-a4d3-6d5629a0e701 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0538905 Feb 08 18:16:16.934153 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ecd71b3-0c3c-4145-9fbe-e5b6ac4867f7 req-cdb0382a-04cf-4fc9-b858-529f571448e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:16.935759 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4ecd71b3-0c3c-4145-9fbe-e5b6ac4867f7 req-cdb0382a-04cf-4fc9-b858-529f571448e8 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=357dab3d3db74ef9a8ee50fdd8a8bdcd&device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 1129 time: 0.0457988 Feb 08 18:16:16.974058 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a7547039-00e1-4629-9e77-9e336ea44e10 req-6026170a-acd4-41a6-93ce-ddf38556aa9a tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411522 Feb 08 18:16:17.031992 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ecd71b3-0c3c-4145-9fbe-e5b6ac4867f7 req-199d0e22-f30d-4df3-903a-6fd5dce82e89 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:17.033541 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4ecd71b3-0c3c-4145-9fbe-e5b6ac4867f7 req-199d0e22-f30d-4df3-903a-6fd5dce82e89 service neutron] 10.222.0.109 "GET /v2.0/networks?id=7a854399-3ce6-42bd-bfc4-061132ecb9c2 HTTP/1.1" status: 200 len: 918 time: 0.0902095 Feb 08 18:16:17.101399 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4ecd71b3-0c3c-4145-9fbe-e5b6ac4867f7 req-47d1830e-bf33-48cf-9b96-a2f35c12129d service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=50b2e85d-5914-4f54-9939-14603e53f04e HTTP/1.1" status: 200 len: 998 time: 0.0609741 Feb 08 18:16:17.148628 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ecd71b3-0c3c-4145-9fbe-e5b6ac4867f7 req-6d2dc21c-1b07-4a95-ab15-4922cfc65778 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:17.150077 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4ecd71b3-0c3c-4145-9fbe-e5b6ac4867f7 req-6d2dc21c-1b07-4a95-ab15-4922cfc65778 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=73de7865-d87d-4a2a-a702-160c400f145f HTTP/1.1" status: 200 len: 855 time: 0.0423629 Feb 08 18:16:17.189638 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-f013acb0-14ef-4632-bcd0-6b4ef5209c70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'name': 'tempest-AttachVolumeShelveTestJSON-785190803-router', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106'}], 'enable_snat': True}, 'gw_port_id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:11Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'gw_port': {'id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:49:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:14Z', 'updated_at': '2022-02-08T18:12:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '5fc12cc6-4f52-488c-9d27-d90b64bf94b3', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'floating_ip_address': '172.27.1.57', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'port_id': '50b2e85d-5914-4f54-9939-14603e53f04e', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 450, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'mac_address': 'fa:16:3e:8f:67:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '097f7b21-9f4e-4341-831a-307f6b722f44', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:15:59Z', 'updated_at': '2022-02-08T18:16:16Z', 'revision_number': 1, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e29130bd-e04d-4042-835b-4ba71dbf114e', 'name': '', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'mac_address': 'fa:16:3e:aa:1e:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '73de7865-d87d-4a2a-a702-160c400f145f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:21Z', 'updated_at': '2022-02-08T18:12:30Z', 'revision_number': 5, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'subnets': [{'id': '73de7865-d87d-4a2a-a702-160c400f145f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:16:17.199897 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ecd71b3-0c3c-4145-9fbe-e5b6ac4867f7 req-d414cf0f-442f-4687-ba2d-d8ffdfb4a775 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:17.201402 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4ecd71b3-0c3c-4145-9fbe-e5b6ac4867f7 req-d414cf0f-442f-4687-ba2d-d8ffdfb4a775 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=7a854399-3ce6-42bd-bfc4-061132ecb9c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0442410 Feb 08 18:16:17.219063 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f013acb0-14ef-4632-bcd0-6b4ef5209c70 None None] Checking router: 058f0c04-e3de-4d16-8a7a-a7247919133c for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:16:17.227912 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f013acb0-14ef-4632-bcd0-6b4ef5209c70 None None] Routers {'058f0c04-e3de-4d16-8a7a-a7247919133c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:16:17.228584 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-f013acb0-14ef-4632-bcd0-6b4ef5209c70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:15:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['058f0c04-e3de-4d16-8a7a-a7247919133c'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:16:17.295510 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4ecd71b3-0c3c-4145-9fbe-e5b6ac4867f7 req-4a1c15a8-801d-46b1-aa6a-a7ea82b120a6 service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0874708 Feb 08 18:16:17.392417 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4ecd71b3-0c3c-4145-9fbe-e5b6ac4867f7 req-6569d3e1-dcd1-4508-9cd5-e9c9cf98a1b4 service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0874393 Feb 08 18:16:17.468410 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-f013acb0-14ef-4632-bcd0-6b4ef5209c70 None None] Set router 058f0c04-e3de-4d16-8a7a-a7247919133c gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:16:17.725800 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-f013acb0-14ef-4632-bcd0-6b4ef5209c70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'name': 'tempest-AttachVolumeShelveTestJSON-785190803-router', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106'}], 'enable_snat': True}, 'gw_port_id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:11Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'gw_port': {'id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:49:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:14Z', 'updated_at': '2022-02-08T18:12:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '5fc12cc6-4f52-488c-9d27-d90b64bf94b3', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'floating_ip_address': '172.27.1.57', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'port_id': '50b2e85d-5914-4f54-9939-14603e53f04e', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 450, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'mac_address': 'fa:16:3e:8f:67:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '097f7b21-9f4e-4341-831a-307f6b722f44', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:15:59Z', 'updated_at': '2022-02-08T18:16:16Z', 'revision_number': 1, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e29130bd-e04d-4042-835b-4ba71dbf114e', 'name': '', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'mac_address': 'fa:16:3e:aa:1e:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '73de7865-d87d-4a2a-a702-160c400f145f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:21Z', 'updated_at': '2022-02-08T18:12:30Z', 'revision_number': 5, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'subnets': [{'id': '73de7865-d87d-4a2a-a702-160c400f145f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:16:17.757905 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f013acb0-14ef-4632-bcd0-6b4ef5209c70 None None] The sync data for ids ['058f0c04-e3de-4d16-8a7a-a7247919133c'] in dv-cinder-773985-21-iscsi is: [{'id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'name': 'tempest-AttachVolumeShelveTestJSON-785190803-router', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106'}], 'enable_snat': True}, 'gw_port_id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:11Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'gw_port': {'id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:49:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:14Z', 'updated_at': '2022-02-08T18:12:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '5fc12cc6-4f52-488c-9d27-d90b64bf94b3', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'floating_ip_address': '172.27.1.57', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'port_id': '50b2e85d-5914-4f54-9939-14603e53f04e', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 450, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'mac_address': 'fa:16:3e:8f:67:4b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '097f7b21-9f4e-4341-831a-307f6b722f44', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:15:59Z', 'updated_at': '2022-02-08T18:16:16Z', 'revision_number': 1, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e29130bd-e04d-4042-835b-4ba71dbf114e', 'name': '', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'mac_address': 'fa:16:3e:aa:1e:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '73de7865-d87d-4a2a-a702-160c400f145f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:21Z', 'updated_at': '2022-02-08T18:12:30Z', 'revision_number': 5, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'subnets': [{'id': '73de7865-d87d-4a2a-a702-160c400f145f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:16:17.822977 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-dc521cd1-ae46-438c-b8c5-504d7c0e6802 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:17.976922 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:17.999380 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9f2b4e54-136b-4144-9a35-9f32c5a64963 None None] New status for floating IP 5fc12cc6-4f52-488c-9d27-d90b64bf94b3: ACTIVE {{(pid=102562) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Feb 08 18:16:18.105372 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bf9a305-c6ca-42d1-a07e-305cd56659ff req-9d105564-779a-43f7-beb8-3d95c1463ad0 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:18.112037 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1bf9a305-c6ca-42d1-a07e-305cd56659ff req-9d105564-779a-43f7-beb8-3d95c1463ad0 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0643919 Feb 08 18:16:18.112665 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f413f45-35b5-4130-930e-08d0d4f57465 req-202001f5-6958-477f-8284-25129e07754a tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:18.114338 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3f413f45-35b5-4130-930e-08d0d4f57465 req-202001f5-6958-477f-8284-25129e07754a tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0575652 Feb 08 18:16:18.158395 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1bf9a305-c6ca-42d1-a07e-305cd56659ff req-02de96ef-1824-4ca8-8511-5950fa537b23 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451822 Feb 08 18:16:18.165754 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3f413f45-35b5-4130-930e-08d0d4f57465 req-10c328fb-fd14-4640-831f-d6f4c305d22d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452769 Feb 08 18:16:18.495903 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:19.277700 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0f59324-46d8-4af0-9386-a911bb82d6e4 req-100ad431-2ec0-41cb-8e57-937c716ad686 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:19.279025 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f0f59324-46d8-4af0-9386-a911bb82d6e4 req-100ad431-2ec0-41cb-8e57-937c716ad686 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0519621 Feb 08 18:16:19.329898 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f0f59324-46d8-4af0-9386-a911bb82d6e4 req-67af0a5f-3568-4595-86e8-c7df27653c1c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450006 Feb 08 18:16:20.104062 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:20.450163 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b917f1fa-9308-4cf3-83f2-82833314385f req-78bec575-6080-48c2-a730-d3b1fbe84c17 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:20.451678 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b917f1fa-9308-4cf3-83f2-82833314385f req-78bec575-6080-48c2-a730-d3b1fbe84c17 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0538137 Feb 08 18:16:20.508922 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b917f1fa-9308-4cf3-83f2-82833314385f req-cea39e2f-0653-40e9-b581-15e956e99b19 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0488586 Feb 08 18:16:21.660780 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f3a4518-0121-433b-b064-de04639dca6d req-1db77ec7-903d-4041-9188-b7400a45876c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:21.662915 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-6f3a4518-0121-433b-b064-de04639dca6d req-1db77ec7-903d-4041-9188-b7400a45876c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0797858 Feb 08 18:16:21.672688 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:21.712223 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-6f3a4518-0121-433b-b064-de04639dca6d req-dc301c5a-07d8-4b36-9466-a1aa3725c062 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437274 Feb 08 18:16:21.979212 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:16:22.670937 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47a8e0a2-44bd-4bbb-9774-e11b1c5459d6 req-d76659e9-8ce1-4bfa-82d6-5ee5874e3a8e tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:22.672390 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-47a8e0a2-44bd-4bbb-9774-e11b1c5459d6 req-d76659e9-8ce1-4bfa-82d6-5ee5874e3a8e tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.109 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0570261 Feb 08 18:16:22.769836 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-47a8e0a2-44bd-4bbb-9774-e11b1c5459d6 req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Deleting port fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:16:22.770298 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-47a8e0a2-44bd-4bbb-9774-e11b1c5459d6 req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:22.831980 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db450755-cf2e-4384-974e-f06ceb013258 req-b87fb213-6030-479a-a555-70bbbef89d3a tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:22.833606 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-db450755-cf2e-4384-974e-f06ceb013258 req-b87fb213-6030-479a-a555-70bbbef89d3a tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 946 time: 0.0524735 Feb 08 18:16:22.867766 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-47a8e0a2-44bd-4bbb-9774-e11b1c5459d6 req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] For port fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb,segment=NetworkSegment(acdceaea-bf94-4e23-8e9f-0f5d9197e75f),segment_id=acdceaea-bf94-4e23-8e9f-0f5d9197e75f)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:16:22.868330 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-47a8e0a2-44bd-4bbb-9774-e11b1c5459d6 req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:22.888530 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-db450755-cf2e-4384-974e-f06ceb013258 req-b2fe1fa4-7a75-4b1c-8ec9-8219f1d9c3c2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=c2d6b890-d2af-425a-a791-9710f0f7e35e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0464821 Feb 08 18:16:23.040612 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-47a8e0a2-44bd-4bbb-9774-e11b1c5459d6 req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:23.041129 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-47a8e0a2-44bd-4bbb-9774-e11b1c5459d6 req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-560746'] for floatingip (6ff4a76f-ba78-4441-b8c0-8ae1abf97277), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:23.041577 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.l3_db [req-47a8e0a2-44bd-4bbb-9774-e11b1c5459d6 req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Floating IP 6ff4a76f-ba78-4441-b8c0-8ae1abf97277 disassociated. External IP: 172.27.1.121, port: fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb. Feb 08 18:16:23.041943 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-47a8e0a2-44bd-4bbb-9774-e11b1c5459d6 req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Calling delete_port for fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb owned by compute:nova {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:16:23.184049 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-47a8e0a2-44bd-4bbb-9774-e11b1c5459d6 req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:23.212255 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Pushing event deleted for resources: {'Port': ['ID=fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:23.223166 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:23.223517 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:23.223864 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:23.224198 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:23.224612 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:23.224948 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:23.225275 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:23.225602 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:23.225930 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:23.226253 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:23.226577 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:23.226938 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:23.227258 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:23.342587 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [req-47a8e0a2-44bd-4bbb-9774-e11b1c5459d6 req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:16:23.463573 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-47a8e0a2-44bd-4bbb-9774-e11b1c5459d6 req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:16:23.474716 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02c98dc1-e6c7-44fe-88dd-c625f64bf7af None None] Sync routers for ids ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:16:23.486493 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02c98dc1-e6c7-44fe-88dd-c625f64bf7af None None] Routers {'3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:16:23.487432 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-02c98dc1-e6c7-44fe-88dd-c625f64bf7af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:16:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:16:23.507485 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [req-47a8e0a2-44bd-4bbb-9774-e11b1c5459d6 req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] No DVR routers for this DVR port fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb on host hv-cinder-77398 {{(pid=102560) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:16:23.510288 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-47a8e0a2-44bd-4bbb-9774-e11b1c5459d6 req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:23.513959 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-47a8e0a2-44bd-4bbb-9774-e11b1c5459d6 req-eca0490e-ba52-4f54-9609-93a301663e35 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.109 "DELETE /v2.0/ports/fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb HTTP/1.1" status: 204 len: 173 time: 0.8359890 Feb 08 18:16:23.514428 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd6973742-7d30-4603-8075-2a02f14da9ea', 'name': 'network-vif-deleted', 'tag': 'fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:16:23.516669 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6fccba8c-df0c-4033-8814-1544aab22bfc" -d '{"events": [{"server_uuid": "d6973742-7d30-4603-8075-2a02f14da9ea", "name": "network-vif-deleted", "tag": "fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:16:23.560964 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:16:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0a3a99a6-f94c-4c53-a5a4-63daebbb4d07 x-openstack-request-id: req-0a3a99a6-f94c-4c53-a5a4-63daebbb4d07 {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:16:23.561249 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d6973742-7d30-4603-8075-2a02f14da9ea", "name": "network-vif-deleted", "tag": "fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:16:23.561490 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-0a3a99a6-f94c-4c53-a5a4-63daebbb4d07 {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:16:23.561892 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd6973742-7d30-4603-8075-2a02f14da9ea', 'name': 'network-vif-deleted', 'tag': 'fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb', 'status': 'completed', 'code': 200} Feb 08 18:16:23.605468 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-02c98dc1-e6c7-44fe-88dd-c625f64bf7af None None] Set router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:16:23.824368 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-02c98dc1-e6c7-44fe-88dd-c625f64bf7af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'name': 'tempest-AttachVolumeTestJSON-997005721-router', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77'}], 'enable_snat': True}, 'gw_port_id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:23Z', 'revision_number': 4, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'gw_port': {'id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ad:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'fe9dfbe9-83a8-472c-b3a3-9537d424939b', 'name': '', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'mac_address': 'fa:16:3e:dd:46:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:19Z', 'updated_at': '2022-02-08T18:12:34Z', 'revision_number': 5, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'subnets': [{'id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:16:23.852570 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02c98dc1-e6c7-44fe-88dd-c625f64bf7af None None] Checking router: 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:16:23.861712 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02c98dc1-e6c7-44fe-88dd-c625f64bf7af None None] Routers {'3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:16:23.862482 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-02c98dc1-e6c7-44fe-88dd-c625f64bf7af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:16:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:16:23.994417 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-02c98dc1-e6c7-44fe-88dd-c625f64bf7af None None] Set router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:16:24.010314 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-092c6e6d-4e80-41cd-be6d-89ae1e0c189a req-932c3c26-a9b0-4dd2-ac8c-1ad1040c343f tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=d6973742-7d30-4603-8075-2a02f14da9ea HTTP/1.1" status: 200 len: 210 time: 0.0301507 Feb 08 18:16:24.200152 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-02c98dc1-e6c7-44fe-88dd-c625f64bf7af None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'name': 'tempest-AttachVolumeTestJSON-997005721-router', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77'}], 'enable_snat': True}, 'gw_port_id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:23Z', 'revision_number': 4, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'gw_port': {'id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ad:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'fe9dfbe9-83a8-472c-b3a3-9537d424939b', 'name': '', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'mac_address': 'fa:16:3e:dd:46:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:19Z', 'updated_at': '2022-02-08T18:12:34Z', 'revision_number': 5, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'subnets': [{'id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:16:24.235369 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-02c98dc1-e6c7-44fe-88dd-c625f64bf7af None None] The sync data for ids ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'] in dv-cinder-773985-21-iscsi is: [{'id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'name': 'tempest-AttachVolumeTestJSON-997005721-router', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77'}], 'enable_snat': True}, 'gw_port_id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:23Z', 'revision_number': 4, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'gw_port': {'id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ad:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'fe9dfbe9-83a8-472c-b3a3-9537d424939b', 'name': '', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'mac_address': 'fa:16:3e:dd:46:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:19Z', 'updated_at': '2022-02-08T18:12:34Z', 'revision_number': 5, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'subnets': [{'id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:16:24.458461 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ea77d92b-03cb-4578-88d3-ca83f545d512 None None] New status for floating IP 6ff4a76f-ba78-4441-b8c0-8ae1abf97277: DOWN {{(pid=102562) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Feb 08 18:16:25.096109 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 41138) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:16:25.150526 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0cebc0a8-c5df-4455-a3da-9b75cddb3eb2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group (c2d6b890-d2af-425a-a791-9710f0f7e35e), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:25.173074 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0cebc0a8-c5df-4455-a3da-9b75cddb3eb2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group (c2d6b890-d2af-425a-a791-9710f0f7e35e), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:25.221342 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0cebc0a8-c5df-4455-a3da-9b75cddb3eb2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (c2d6b890-d2af-425a-a791-9710f0f7e35e), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:25.223955 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0cebc0a8-c5df-4455-a3da-9b75cddb3eb2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:25.225089 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-0cebc0a8-c5df-4455-a3da-9b75cddb3eb2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "DELETE /v2.0/security-groups/c2d6b890-d2af-425a-a791-9710f0f7e35e HTTP/1.1" status: 204 len: 168 time: 0.1279919 Feb 08 18:16:25.227995 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 41142) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:16:25.234118 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cebc0a8-c5df-4455-a3da-9b75cddb3eb2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=c2d6b890-d2af-425a-a791-9710f0f7e35e,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:25.241499 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cebc0a8-c5df-4455-a3da-9b75cddb3eb2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:25.241857 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cebc0a8-c5df-4455-a3da-9b75cddb3eb2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:25.242027 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.api.v2.resource [None req-abeb2965-445b-47aa-8136-be9cc1968fb1 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] show failed (client error): The resource could not be found. Feb 08 18:16:25.242184 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cebc0a8-c5df-4455-a3da-9b75cddb3eb2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:25.242546 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cebc0a8-c5df-4455-a3da-9b75cddb3eb2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:25.242957 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cebc0a8-c5df-4455-a3da-9b75cddb3eb2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:25.243102 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-abeb2965-445b-47aa-8136-be9cc1968fb1 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups/c2d6b890-d2af-425a-a791-9710f0f7e35e HTTP/1.1" status: 404 len: 347 time: 0.0139675 Feb 08 18:16:25.243304 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cebc0a8-c5df-4455-a3da-9b75cddb3eb2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:25.243608 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cebc0a8-c5df-4455-a3da-9b75cddb3eb2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:25.243963 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cebc0a8-c5df-4455-a3da-9b75cddb3eb2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:25.244262 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cebc0a8-c5df-4455-a3da-9b75cddb3eb2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:25.244613 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cebc0a8-c5df-4455-a3da-9b75cddb3eb2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:25.244938 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cebc0a8-c5df-4455-a3da-9b75cddb3eb2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:25.245254 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cebc0a8-c5df-4455-a3da-9b75cddb3eb2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:25.245573 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0cebc0a8-c5df-4455-a3da-9b75cddb3eb2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:16:25.246062 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 41144) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:16:25.370292 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-e880e33d-0d74-4b9d-ac1a-f82702984219 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Deleting port bc50087f-d187-4c22-8863-0b6b8ed2d365 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:16:25.370580 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e880e33d-0d74-4b9d-ac1a-f82702984219 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (bc50087f-d187-4c22-8863-0b6b8ed2d365), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:25.449164 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e880e33d-0d74-4b9d-ac1a-f82702984219 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (bc50087f-d187-4c22-8863-0b6b8ed2d365), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:25.449498 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e880e33d-0d74-4b9d-ac1a-f82702984219 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for floatingip (bc50087f-d187-4c22-8863-0b6b8ed2d365), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:25.461551 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-e880e33d-0d74-4b9d-ac1a-f82702984219 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Calling delete_port for bc50087f-d187-4c22-8863-0b6b8ed2d365 owned by network:floatingip {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:16:25.608225 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e880e33d-0d74-4b9d-ac1a-f82702984219 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (bc50087f-d187-4c22-8863-0b6b8ed2d365), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:25.633184 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e880e33d-0d74-4b9d-ac1a-f82702984219 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Pushing event deleted for resources: {'Port': ['ID=bc50087f-d187-4c22-8863-0b6b8ed2d365,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:25.706523 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e880e33d-0d74-4b9d-ac1a-f82702984219 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for floatingip (6ff4a76f-ba78-4441-b8c0-8ae1abf97277), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:25.710813 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e880e33d-0d74-4b9d-ac1a-f82702984219 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for floatingip (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:25.712360 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-e880e33d-0d74-4b9d-ac1a-f82702984219 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "DELETE /v2.0/floatingips/6ff4a76f-ba78-4441-b8c0-8ae1abf97277 HTTP/1.1" status: 204 len: 168 time: 0.4653378 Feb 08 18:16:26.053879 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 41162) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:16:26.058614 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-4eb1bcb5-0c53-427c-9f9c-c5519aa81cce tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Request body: {'security_group': {'name': 'tempest-securitygroup--844059405', 'description': 'tempest-description--1251388436'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:16:26.079904 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4eb1bcb5-0c53-427c-9f9c-c5519aa81cce tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:26.147930 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4eb1bcb5-0c53-427c-9f9c-c5519aa81cce tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group (4ead608b-09aa-4247-92a7-e3d23386c346), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:26.153475 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4eb1bcb5-0c53-427c-9f9c-c5519aa81cce tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (4ead608b-09aa-4247-92a7-e3d23386c346), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:26.183890 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4eb1bcb5-0c53-427c-9f9c-c5519aa81cce tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:26.185148 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-4eb1bcb5-0c53-427c-9f9c-c5519aa81cce tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.1301477 Feb 08 18:16:26.188079 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 41164) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:16:26.193295 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-c6bd34fd-1c65-41c3-86af-98d007169280 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Request body: {'security_group_rule': {'security_group_id': '4ead608b-09aa-4247-92a7-e3d23386c346', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:16:26.198246 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4eb1bcb5-0c53-427c-9f9c-c5519aa81cce tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4ead608b-09aa-4247-92a7-e3d23386c346,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:26.222578 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c6bd34fd-1c65-41c3-86af-98d007169280 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group_rule (41949df1-adbb-4573-9f31-63fd3521df3d), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:26.275792 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c6bd34fd-1c65-41c3-86af-98d007169280 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group_rule (41949df1-adbb-4573-9f31-63fd3521df3d), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:26.283477 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c6bd34fd-1c65-41c3-86af-98d007169280 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (41949df1-adbb-4573-9f31-63fd3521df3d), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:26.300615 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c6bd34fd-1c65-41c3-86af-98d007169280 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=41949df1-adbb-4573-9f31-63fd3521df3d,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:26.310163 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c6bd34fd-1c65-41c3-86af-98d007169280 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:26.311490 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-c6bd34fd-1c65-41c3-86af-98d007169280 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1225009 Feb 08 18:16:26.315204 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 41166) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:16:26.319540 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-57042a6d-f774-46ae-a8a9-d6b87b0c1e9f tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Request body: {'security_group_rule': {'security_group_id': '4ead608b-09aa-4247-92a7-e3d23386c346', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:16:26.352362 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-57042a6d-f774-46ae-a8a9-d6b87b0c1e9f tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group_rule (5ecbfee2-f9d9-4db6-a38b-865c52737008), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:26.410369 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-57042a6d-f774-46ae-a8a9-d6b87b0c1e9f tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group_rule (5ecbfee2-f9d9-4db6-a38b-865c52737008), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:26.415181 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-57042a6d-f774-46ae-a8a9-d6b87b0c1e9f tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (5ecbfee2-f9d9-4db6-a38b-865c52737008), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:26.435084 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57042a6d-f774-46ae-a8a9-d6b87b0c1e9f tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5ecbfee2-f9d9-4db6-a38b-865c52737008,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:26.440976 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-57042a6d-f774-46ae-a8a9-d6b87b0c1e9f tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:26.442162 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-57042a6d-f774-46ae-a8a9-d6b87b0c1e9f tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1260583 Feb 08 18:16:26.445374 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 41168) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:16:26.449603 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-f50e30e8-ab5c-4967-9190-7b9379dcad59 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Request body: {'floatingip': {'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:16:26.469596 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f50e30e8-ab5c-4967-9190-7b9379dcad59 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for floatingip (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:26.570285 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f50e30e8-ab5c-4967-9190-7b9379dcad59 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:26.673162 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [None req-f50e30e8-ab5c-4967-9190-7b9379dcad59 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Allocated IP 172.27.1.16 (77055816-7c88-403d-8f8a-9be2c1faa10d/18547c52-7b23-42cd-bb53-214663ed102b/6c07f56b-b602-41d3-b110-3008f5a53801) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:16:26.777780 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f50e30e8-ab5c-4967-9190-7b9379dcad59 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for port (6c07f56b-b602-41d3-b110-3008f5a53801), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:26.817116 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f50e30e8-ab5c-4967-9190-7b9379dcad59 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (6c07f56b-b602-41d3-b110-3008f5a53801), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:26.853166 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f50e30e8-ab5c-4967-9190-7b9379dcad59 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Network 77055816-7c88-403d-8f8a-9be2c1faa10d is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:16:26.858007 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-f50e30e8-ab5c-4967-9190-7b9379dcad59 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:16:26.861619 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f50e30e8-ab5c-4967-9190-7b9379dcad59 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:16:26.865108 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:16:26.891986 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] No Port match for: fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:16:26.892651 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device fe1f69fb-2f64-4b10-88ff-5010f9b2f0fb not bound to the agent host hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:16:26.894487 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f50e30e8-ab5c-4967-9190-7b9379dcad59 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Pushing event updated for resources: {'Port': ['ID=6c07f56b-b602-41d3-b110-3008f5a53801,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:26.966523 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f50e30e8-ab5c-4967-9190-7b9379dcad59 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for floatingip (0a8ed6c0-d363-4a2c-9628-d369a0abdf56), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:27.006275 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f50e30e8-ab5c-4967-9190-7b9379dcad59 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (6c07f56b-b602-41d3-b110-3008f5a53801), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:27.156719 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f50e30e8-ab5c-4967-9190-7b9379dcad59 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for port (6c07f56b-b602-41d3-b110-3008f5a53801), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:27.161955 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f50e30e8-ab5c-4967-9190-7b9379dcad59 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-63856478'] for port (6c07f56b-b602-41d3-b110-3008f5a53801), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:27.226836 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f50e30e8-ab5c-4967-9190-7b9379dcad59 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Pushing event updated for resources: {'Port': ['ID=6c07f56b-b602-41d3-b110-3008f5a53801,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:27.239669 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f50e30e8-ab5c-4967-9190-7b9379dcad59 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-560746'] for floatingip (0a8ed6c0-d363-4a2c-9628-d369a0abdf56), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:27.256997 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f50e30e8-ab5c-4967-9190-7b9379dcad59 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for floatingip (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:27.258214 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-f50e30e8-ab5c-4967-9190-7b9379dcad59 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 0.8119144 Feb 08 18:16:27.460014 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-27703a40-8216-4dbe-9a8a-c58f12adb117 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?name=tempest-securitygroup--844059405&fields=id&tenant_id=630172c388404c75bda3d0ba2d9d5834 HTTP/1.1" status: 200 len: 267 time: 0.0445521 Feb 08 18:16:27.567076 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-59bf1f91-1a48-48d1-85f5-c04f3a5f857c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:27.568551 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-59bf1f91-1a48-48d1-85f5-c04f3a5f857c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/networks?id=e430084e-9b28-426f-9937-61346814b135 HTTP/1.1" status: 200 len: 810 time: 0.1016428 Feb 08 18:16:27.582795 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-038e6bcd-4919-4ac6-b1e2-cec60eae8259 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/quotas/630172c388404c75bda3d0ba2d9d5834 HTTP/1.1" status: 200 len: 375 time: 0.0089374 Feb 08 18:16:27.636168 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-a5d3be31-83ad-485d-9655-817a9194f389 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?tenant_id=630172c388404c75bda3d0ba2d9d5834&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0486062 Feb 08 18:16:27.737027 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-5774efc5-5455-435b-96a0-d632581df8f4 service neutron] 10.222.0.118 "GET /v2.0/networks/e430084e-9b28-426f-9937-61346814b135?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0894523 Feb 08 18:16:27.825203 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-cc2fc300-2d4d-442e-8af4-5eaf1f2d2a2f service neutron] 10.222.0.118 "GET /v2.0/networks/e430084e-9b28-426f-9937-61346814b135?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0822704 Feb 08 18:16:28.006562 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4f0b9e3a-251e-4145-bbce-8836831680f6 req-805199ed-a2c6-4556-9f46-63243a356cea tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 210 time: 0.0289543 Feb 08 18:16:28.256279 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 41228) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:16:28.378399 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-40777436-fea5-40d7-8e61-8017f6ab03c2 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:28.485865 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-40777436-fea5-40d7-8e61-8017f6ab03c2 admin admin] Publish callbacks [] for security_group (4c359b8f-65c9-4b46-9795-48d26c27dd66), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:28.492329 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-40777436-fea5-40d7-8e61-8017f6ab03c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (4c359b8f-65c9-4b46-9795-48d26c27dd66), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:28.531888 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40777436-fea5-40d7-8e61-8017f6ab03c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4c359b8f-65c9-4b46-9795-48d26c27dd66,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:28.538152 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-40777436-fea5-40d7-8e61-8017f6ab03c2 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=42acbd7875f44d87bb038f1c73f3c7ed&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2805316 Feb 08 18:16:28.540863 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 41240) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:16:28.589909 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-addbd940-8132-4470-89db-bc017e12f098 admin admin] Publish callbacks [] for security_group (4c359b8f-65c9-4b46-9795-48d26c27dd66), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:28.612199 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-addbd940-8132-4470-89db-bc017e12f098 admin admin] Publish callbacks [] for security_group (4c359b8f-65c9-4b46-9795-48d26c27dd66), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:28.664587 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-addbd940-8132-4470-89db-bc017e12f098 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (4c359b8f-65c9-4b46-9795-48d26c27dd66), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:28.667333 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-addbd940-8132-4470-89db-bc017e12f098 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:28.668510 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-addbd940-8132-4470-89db-bc017e12f098 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/4c359b8f-65c9-4b46-9795-48d26c27dd66 HTTP/1.1" status: 204 len: 168 time: 0.1266901 Feb 08 18:16:28.677390 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-addbd940-8132-4470-89db-bc017e12f098 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4c359b8f-65c9-4b46-9795-48d26c27dd66,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:28.998723 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-7137e277-7ec9-41cf-8e28-4d517b9bbee5 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:29.000454 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-7137e277-7ec9-41cf-8e28-4d517b9bbee5 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.109 "GET /v2.0/networks?id=e430084e-9b28-426f-9937-61346814b135 HTTP/1.1" status: 200 len: 810 time: 0.1117606 Feb 08 18:16:29.070657 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-b368bcff-e02d-4e1f-9b08-0722d3d719e9 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.109 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=630172c388404c75bda3d0ba2d9d5834 HTTP/1.1" status: 200 len: 379 time: 0.0600927 Feb 08 18:16:29.087154 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-a89f328a-7edb-4b40-957d-197a206d15ea tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Request body: {'port': {'device_id': '93e9d398-2f45-4bba-8f28-35d32a92af5b', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'admin_state_up': True, 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'security_groups': ['4ead608b-09aa-4247-92a7-e3d23386c346']}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:16:29.127334 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d86bf57e-0711-41b3-8e1f-aa6d1e9cc098 req-6fa41ad1-b51c-4219-91af-055cc1554dde tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 210 time: 0.0354211 Feb 08 18:16:29.205654 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-a89f328a-7edb-4b40-957d-197a206d15ea tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Made reservation on behalf of 630172c388404c75bda3d0ba2d9d5834 for: {'port': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:16:29.209508 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-a89f328a-7edb-4b40-957d-197a206d15ea tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:29.336182 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_common [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-a89f328a-7edb-4b40-957d-197a206d15ea tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Allocated IP 172.20.0.10 (e430084e-9b28-426f-9937-61346814b135/86592955-e7d0-4e8a-9490-976e17240d7c/b77bffb2-0403-4c4d-b0c9-4de454874429) {{(pid=102560) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:16:29.479917 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-a89f328a-7edb-4b40-957d-197a206d15ea tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for port (b77bffb2-0403-4c4d-b0c9-4de454874429), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:29.514374 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-a89f328a-7edb-4b40-957d-197a206d15ea tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (b77bffb2-0403-4c4d-b0c9-4de454874429), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:29.559581 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-a89f328a-7edb-4b40-957d-197a206d15ea tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Network e430084e-9b28-426f-9937-61346814b135 is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:16:29.561282 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-a89f328a-7edb-4b40-957d-197a206d15ea tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:16:29.567088 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-a89f328a-7edb-4b40-957d-197a206d15ea tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Received port after_create {{(pid=102560) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:16:29.600034 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a89f328a-7edb-4b40-957d-197a206d15ea tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Pushing event updated for resources: {'Port': ['ID=b77bffb2-0403-4c4d-b0c9-4de454874429,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:29.644593 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-a89f328a-7edb-4b40-957d-197a206d15ea tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:29.645441 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-a89f328a-7edb-4b40-957d-197a206d15ea tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:29.667298 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-a89f328a-7edb-4b40-957d-197a206d15ea tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.109 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5875006 Feb 08 18:16:29.682752 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] Request body: {'port': {'device_id': '93e9d398-2f45-4bba-8f28-35d32a92af5b', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77398'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:16:29.758286 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (b77bffb2-0403-4c4d-b0c9-4de454874429), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:29.821155 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-e0e1636b-f91f-4a33-81ce-5be32e9c3c91 None None] Provisioning complete for port b77bffb2-0403-4c4d-b0c9-4de454874429 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:16:29.821638 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-e0e1636b-f91f-4a33-81ce-5be32e9c3c91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (b77bffb2-0403-4c4d-b0c9-4de454874429), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:29.892122 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-e0e1636b-f91f-4a33-81ce-5be32e9c3c91 None None] Port b77bffb2-0403-4c4d-b0c9-4de454874429 cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:16:30.075276 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b77bffb2-0403-4c4d-b0c9-4de454874429 {{(pid=102560) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:16:30.083214 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] Publish callbacks [] for port (b77bffb2-0403-4c4d-b0c9-4de454874429), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:30.097566 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 41300) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:16:30.105420 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.provisioning_blocks [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] Transition to ACTIVE for port object b77bffb2-0403-4c4d-b0c9-4de454874429 will not be triggered until provisioned by entity L2. {{(pid=102560) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Feb 08 18:16:30.108647 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-64531588'] for port (b77bffb2-0403-4c4d-b0c9-4de454874429), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:30.162030 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] Pushing event updated for resources: {'Port': ['ID=b77bffb2-0403-4c4d-b0c9-4de454874429,revision_number=2']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:30.268473 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-394e6d22-4b1b-4f10-8048-d8274fe5b76d admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:30.288622 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] Attempting to bind port b77bffb2-0403-4c4d-b0c9-4de454874429 on host hv-cinder-77398 for vnic_type normal with profile {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:16:30.288965 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] Attempting to bind port b77bffb2-0403-4c4d-b0c9-4de454874429 by drivers openvswitch,hyperv on host hv-cinder-77398 at level 0 using segments [{'id': 'acdceaea-bf94-4e23-8e9f-0f5d9197e75f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1082, 'network_id': 'e430084e-9b28-426f-9937-61346814b135'}] {{(pid=102560) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:16:30.289288 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] Attempting to bind port b77bffb2-0403-4c4d-b0c9-4de454874429 on network e430084e-9b28-426f-9937-61346814b135 {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:16:30.301286 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] Port b77bffb2-0403-4c4d-b0c9-4de454874429 on network e430084e-9b28-426f-9937-61346814b135 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77398 {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Feb 08 18:16:30.301610 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] Attempting to bind port b77bffb2-0403-4c4d-b0c9-4de454874429 on network e430084e-9b28-426f-9937-61346814b135 {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:16:30.312868 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10209891-fbec-45d5-b774-1aeec8e6558f req-633d754d-37fe-4d3a-9029-d926ac9ec693 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:30.314353 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-10209891-fbec-45d5-b774-1aeec8e6558f req-633d754d-37fe-4d3a-9029-d926ac9ec693 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 944 time: 0.1054628 Feb 08 18:16:30.324138 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] Checking agent: {'id': '045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77398', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'started_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 16, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:16:30.324547 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] Checking segment: {'id': 'acdceaea-bf94-4e23-8e9f-0f5d9197e75f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1082, 'network_id': 'e430084e-9b28-426f-9937-61346814b135'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102560) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:16:30.324876 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] Bound using segment: {'id': 'acdceaea-bf94-4e23-8e9f-0f5d9197e75f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1082, 'network_id': 'e430084e-9b28-426f-9937-61346814b135'} {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:16:30.325425 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] Bound port: b77bffb2-0403-4c4d-b0c9-4de454874429, host: hv-cinder-77398, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'acdceaea-bf94-4e23-8e9f-0f5d9197e75f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1082, 'network_id': 'e430084e-9b28-426f-9937-61346814b135'}}] {{(pid=102560) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:16:30.325775 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (b77bffb2-0403-4c4d-b0c9-4de454874429), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:30.441140 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-10209891-fbec-45d5-b774-1aeec8e6558f req-ebb5cb39-e0c1-4e5f-86bb-d211d6f652e7 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=4ead608b-09aa-4247-92a7-e3d23386c346&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1196692 Feb 08 18:16:30.462408 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] For port b77bffb2-0403-4c4d-b0c9-4de454874429, host hv-cinder-77398, cleared binding levels {{(pid=102560) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:16:30.477550 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-394e6d22-4b1b-4f10-8048-d8274fe5b76d admin admin] Publish callbacks [] for security_group (5dbca588-fd1d-4378-af12-e2b8625d1588), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:30.481391 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] For port b77bffb2-0403-4c4d-b0c9-4de454874429, host hv-cinder-77398, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=b77bffb2-0403-4c4d-b0c9-4de454874429,segment=NetworkSegment(acdceaea-bf94-4e23-8e9f-0f5d9197e75f),segment_id=acdceaea-bf94-4e23-8e9f-0f5d9197e75f)] {{(pid=102560) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:16:30.484154 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-394e6d22-4b1b-4f10-8048-d8274fe5b76d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (5dbca588-fd1d-4378-af12-e2b8625d1588), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:30.490691 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-64531588'] for port (b77bffb2-0403-4c4d-b0c9-4de454874429), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:30.558596 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:30.559222 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:30.560598 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] 10.222.0.109 "PUT /v2.0/ports/b77bffb2-0403-4c4d-b0c9-4de454874429 HTTP/1.1" status: 200 len: 1094 time: 0.8823442 Feb 08 18:16:30.561968 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '93e9d398-2f45-4bba-8f28-35d32a92af5b', 'tag': 'b77bffb2-0403-4c4d-b0c9-4de454874429'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:16:30.564230 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-82895b01-3ca4-4dd0-9504-8755f1d92109" -d '{"events": [{"name": "network-changed", "server_uuid": "93e9d398-2f45-4bba-8f28-35d32a92af5b", "tag": "b77bffb2-0403-4c4d-b0c9-4de454874429"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:16:30.566735 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-394e6d22-4b1b-4f10-8048-d8274fe5b76d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5dbca588-fd1d-4378-af12-e2b8625d1588,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:30.573875 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-394e6d22-4b1b-4f10-8048-d8274fe5b76d admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=6b78c30da7d242cf982b762718f5cdf1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4751461 Feb 08 18:16:30.577698 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 41308) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:16:30.623003 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77720b5c-48f4-4ab4-8709-791a0f82bca9 service neutron] Pushing event updated for resources: {'Port': ['ID=b77bffb2-0403-4c4d-b0c9-4de454874429,revision_number=3']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:30.642437 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:16:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f272a534-b275-4c8e-828f-df655f8ad86f x-openstack-request-id: req-f272a534-b275-4c8e-828f-df655f8ad86f {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:16:30.643194 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "93e9d398-2f45-4bba-8f28-35d32a92af5b", "tag": "b77bffb2-0403-4c4d-b0c9-4de454874429", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:16:30.643455 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-f272a534-b275-4c8e-828f-df655f8ad86f {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:16:30.643848 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '93e9d398-2f45-4bba-8f28-35d32a92af5b', 'tag': 'b77bffb2-0403-4c4d-b0c9-4de454874429', 'status': 'completed', 'code': 200} Feb 08 18:16:30.646368 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f85a0a17-406c-48a9-b902-70352f9fb1c7 admin admin] Publish callbacks [] for security_group (5dbca588-fd1d-4378-af12-e2b8625d1588), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:30.664041 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-3cf68f86-c704-404d-8911-be252016a504 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:30.665549 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-3cf68f86-c704-404d-8911-be252016a504 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=630172c388404c75bda3d0ba2d9d5834&device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 1128 time: 0.0550346 Feb 08 18:16:30.673939 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f85a0a17-406c-48a9-b902-70352f9fb1c7 admin admin] Publish callbacks [] for security_group (5dbca588-fd1d-4378-af12-e2b8625d1588), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:30.714211 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-d47fb1ae-3856-43d0-97cd-eb3a4b685f7b service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=b77bffb2-0403-4c4d-b0c9-4de454874429 HTTP/1.1" status: 200 len: 217 time: 0.0408463 Feb 08 18:16:30.723518 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f85a0a17-406c-48a9-b902-70352f9fb1c7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (5dbca588-fd1d-4378-af12-e2b8625d1588), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:30.726888 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f85a0a17-406c-48a9-b902-70352f9fb1c7 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:30.730588 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-f85a0a17-406c-48a9-b902-70352f9fb1c7 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/5dbca588-fd1d-4378-af12-e2b8625d1588 HTTP/1.1" status: 204 len: 168 time: 0.1480403 Feb 08 18:16:30.738252 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f85a0a17-406c-48a9-b902-70352f9fb1c7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5dbca588-fd1d-4378-af12-e2b8625d1588,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:30.785929 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-370431fe-d052-42e2-8205-bbd77b6e80f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:30.787645 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-370431fe-d052-42e2-8205-bbd77b6e80f7 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=86592955-e7d0-4e8a-9490-976e17240d7c HTTP/1.1" status: 200 len: 849 time: 0.0666037 Feb 08 18:16:30.854531 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-57157b77-12c5-493c-bafb-f6e4ce074e6a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:30.856123 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-57157b77-12c5-493c-bafb-f6e4ce074e6a service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=e430084e-9b28-426f-9937-61346814b135&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0553906 Feb 08 18:16:31.040878 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 41322) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:16:31.055591 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-35bfc84e-ac1b-4645-bdbc-fc586eedd377 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:31.139579 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-35bfc84e-ac1b-4645-bdbc-fc586eedd377 admin admin] Publish callbacks [] for security_group (708f359b-52b4-4e03-88b1-69bf5ed69a26), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:31.145431 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-35bfc84e-ac1b-4645-bdbc-fc586eedd377 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (708f359b-52b4-4e03-88b1-69bf5ed69a26), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:31.184354 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35bfc84e-ac1b-4645-bdbc-fc586eedd377 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=708f359b-52b4-4e03-88b1-69bf5ed69a26,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:31.191543 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-35bfc84e-ac1b-4645-bdbc-fc586eedd377 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=936ef661a97a47c08369df288aa0f4ae&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1493802 Feb 08 18:16:31.192634 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 41328) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:16:31.217024 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-52980051-5cba-4832-a9ff-39d2e0d2f038 service neutron] 10.222.0.109 "GET /v2.0/networks/e430084e-9b28-426f-9937-61346814b135?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3541353 Feb 08 18:16:31.245706 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c68e60cd-df33-4a6d-b4a7-8f67639a7536 admin admin] Publish callbacks [] for security_group (708f359b-52b4-4e03-88b1-69bf5ed69a26), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:31.268365 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c68e60cd-df33-4a6d-b4a7-8f67639a7536 admin admin] Publish callbacks [] for security_group (708f359b-52b4-4e03-88b1-69bf5ed69a26), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:31.310638 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a6ed8f8c-acd7-455b-9a83-d7bb69f0d24a req-ddc1fd62-9c13-43eb-b079-a82ac667e6ff service neutron] 10.222.0.109 "GET /v2.0/networks/e430084e-9b28-426f-9937-61346814b135?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0864108 Feb 08 18:16:31.321006 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c68e60cd-df33-4a6d-b4a7-8f67639a7536 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (708f359b-52b4-4e03-88b1-69bf5ed69a26), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:31.323983 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c68e60cd-df33-4a6d-b4a7-8f67639a7536 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:31.327565 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-c68e60cd-df33-4a6d-b4a7-8f67639a7536 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/708f359b-52b4-4e03-88b1-69bf5ed69a26 HTTP/1.1" status: 204 len: 168 time: 0.1316476 Feb 08 18:16:31.333676 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c68e60cd-df33-4a6d-b4a7-8f67639a7536 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=708f359b-52b4-4e03-88b1-69bf5ed69a26,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:31.415996 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82895b01-3ca4-4dd0-9504-8755f1d92109 req-79b67471-3231-404c-8843-f35f663050c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:31.417770 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-82895b01-3ca4-4dd0-9504-8755f1d92109 req-79b67471-3231-404c-8843-f35f663050c4 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=630172c388404c75bda3d0ba2d9d5834&device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 1128 time: 0.0529602 Feb 08 18:16:31.555522 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82895b01-3ca4-4dd0-9504-8755f1d92109 req-a3d4b7b8-c935-4e56-9bc0-193f7a9f7fd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:31.557011 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-82895b01-3ca4-4dd0-9504-8755f1d92109 req-a3d4b7b8-c935-4e56-9bc0-193f7a9f7fd3 service neutron] 10.222.0.109 "GET /v2.0/networks?id=e430084e-9b28-426f-9937-61346814b135 HTTP/1.1" status: 200 len: 912 time: 0.1320307 Feb 08 18:16:31.611808 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-82895b01-3ca4-4dd0-9504-8755f1d92109 req-26f32265-6f22-416a-b063-7c060ed7d5ea service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=b77bffb2-0403-4c4d-b0c9-4de454874429 HTTP/1.1" status: 200 len: 217 time: 0.0469108 Feb 08 18:16:31.618791 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48a07c83-2d04-465e-a35e-e08441e96099 req-a1ab0742-9305-4d03-a1af-973ced6b72d5 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:31.620387 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-48a07c83-2d04-465e-a35e-e08441e96099 req-a1ab0742-9305-4d03-a1af-973ced6b72d5 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 944 time: 0.1056023 Feb 08 18:16:31.688897 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82895b01-3ca4-4dd0-9504-8755f1d92109 req-d51432d4-4f55-4109-b0af-aafe1345301c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:31.690386 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-82895b01-3ca4-4dd0-9504-8755f1d92109 req-d51432d4-4f55-4109-b0af-aafe1345301c service neutron] 10.222.0.109 "GET /v2.0/subnets?id=86592955-e7d0-4e8a-9490-976e17240d7c HTTP/1.1" status: 200 len: 849 time: 0.0691228 Feb 08 18:16:31.710401 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-48a07c83-2d04-465e-a35e-e08441e96099 req-df98f76d-8e2a-40a3-b5a5-3feb81d35d62 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=4ead608b-09aa-4247-92a7-e3d23386c346&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0807478 Feb 08 18:16:31.747784 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82895b01-3ca4-4dd0-9504-8755f1d92109 req-c33f9279-42b0-44dc-8542-bf8b4c1fb387 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:31.749273 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-82895b01-3ca4-4dd0-9504-8755f1d92109 req-c33f9279-42b0-44dc-8542-bf8b4c1fb387 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=e430084e-9b28-426f-9937-61346814b135&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0514600 Feb 08 18:16:31.840222 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-82895b01-3ca4-4dd0-9504-8755f1d92109 req-ad1fac89-195f-4eef-a4fb-78543954b8f7 service neutron] 10.222.0.109 "GET /v2.0/networks/e430084e-9b28-426f-9937-61346814b135?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842690 Feb 08 18:16:31.930371 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-82895b01-3ca4-4dd0-9504-8755f1d92109 req-74e27888-367e-4832-8b4a-e651b5c2a99f service neutron] 10.222.0.109 "GET /v2.0/networks/e430084e-9b28-426f-9937-61346814b135?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0815513 Feb 08 18:16:32.836856 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00ae5658-a9d0-459c-8ffc-7a8db953f2d2 req-36490998-4d42-471f-9a70-a7bafa007342 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:32.838379 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-00ae5658-a9d0-459c-8ffc-7a8db953f2d2 req-36490998-4d42-471f-9a70-a7bafa007342 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 944 time: 0.0565059 Feb 08 18:16:32.886454 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-00ae5658-a9d0-459c-8ffc-7a8db953f2d2 req-146dc61f-2c54-4908-9d53-6132921b2c70 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=4ead608b-09aa-4247-92a7-e3d23386c346&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418077 Feb 08 18:16:34.013561 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2288150f-70c2-412f-8de7-a83524af433c req-acd57ab2-ef27-4542-81f3-7159f0a0820b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:34.015098 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-2288150f-70c2-412f-8de7-a83524af433c req-acd57ab2-ef27-4542-81f3-7159f0a0820b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 944 time: 0.0593998 Feb 08 18:16:34.065721 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-2288150f-70c2-412f-8de7-a83524af433c req-37a96f8e-ef53-45cb-a424-ff06f2587cab tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=4ead608b-09aa-4247-92a7-e3d23386c346&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448515 Feb 08 18:16:35.186949 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43899a7b-3de9-41fa-b559-f37bf8fe3f27 req-47db9f80-3750-4de3-a5d9-b6e329294d46 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:35.188433 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-43899a7b-3de9-41fa-b559-f37bf8fe3f27 req-47db9f80-3750-4de3-a5d9-b6e329294d46 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 944 time: 0.0517457 Feb 08 18:16:35.235722 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-43899a7b-3de9-41fa-b559-f37bf8fe3f27 req-fce85833-67e0-423e-a058-df47783eb16a tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=4ead608b-09aa-4247-92a7-e3d23386c346&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415537 Feb 08 18:16:35.373129 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device b77bffb2-0403-4c4d-b0c9-4de454874429 details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:16:35.469525 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port b77bffb2-0403-4c4d-b0c9-4de454874429, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=b77bffb2-0403-4c4d-b0c9-4de454874429,segment=NetworkSegment(acdceaea-bf94-4e23-8e9f-0f5d9197e75f),segment_id=acdceaea-bf94-4e23-8e9f-0f5d9197e75f)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:16:35.480904 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': 'b77bffb2-0403-4c4d-b0c9-4de454874429', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'port_id': 'b77bffb2-0403-4c4d-b0c9-4de454874429', 'mac_address': 'fa:16:3e:f3:ee:f6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1082, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:16:35.516937 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port b77bffb2-0403-4c4d-b0c9-4de454874429 is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:16:35.517315 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (b77bffb2-0403-4c4d-b0c9-4de454874429), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:35.530957 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b77bffb2-0403-4c4d-b0c9-4de454874429 {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:16:35.550807 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port b77bffb2-0403-4c4d-b0c9-4de454874429, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=b77bffb2-0403-4c4d-b0c9-4de454874429,segment=NetworkSegment(acdceaea-bf94-4e23-8e9f-0f5d9197e75f),segment_id=acdceaea-bf94-4e23-8e9f-0f5d9197e75f)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:16:35.558471 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (b77bffb2-0403-4c4d-b0c9-4de454874429), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:35.609209 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=b77bffb2-0403-4c4d-b0c9-4de454874429,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:36.368567 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5165742c-a861-4e74-bc0b-ae19467c0d5f req-6e0540c9-6fd4-4609-acf2-68a98e90103b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:36.370044 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5165742c-a861-4e74-bc0b-ae19467c0d5f req-6e0540c9-6fd4-4609-acf2-68a98e90103b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 945 time: 0.0538683 Feb 08 18:16:36.416611 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5165742c-a861-4e74-bc0b-ae19467c0d5f req-4d603d7d-ca70-462a-9e28-cdde8604e302 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=4ead608b-09aa-4247-92a7-e3d23386c346&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0410135 Feb 08 18:16:37.324658 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['b77bffb2-0403-4c4d-b0c9-4de454874429'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:16:37.542318 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64d8bf59-348f-4aff-be7c-4bafe5e63d09 req-19e70903-0cca-4637-834b-245cecbcd3ee tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:37.543801 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-64d8bf59-348f-4aff-be7c-4bafe5e63d09 req-19e70903-0cca-4637-834b-245cecbcd3ee tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 945 time: 0.0590122 Feb 08 18:16:37.590870 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-64d8bf59-348f-4aff-be7c-4bafe5e63d09 req-3baf0596-5eee-41f0-899f-e71d1470c2bb tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=4ead608b-09aa-4247-92a7-e3d23386c346&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407910 Feb 08 18:16:38.714998 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fb3c038-2d3d-4d47-ab51-bf03b2ab5ea2 req-de3b2965-f930-4a0a-8151-d4e793ab5bc8 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:38.716805 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-6fb3c038-2d3d-4d47-ab51-bf03b2ab5ea2 req-de3b2965-f930-4a0a-8151-d4e793ab5bc8 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 945 time: 0.0537312 Feb 08 18:16:38.768198 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-6fb3c038-2d3d-4d47-ab51-bf03b2ab5ea2 req-df52ac62-c000-4e4e-a676-807df18d434d tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=4ead608b-09aa-4247-92a7-e3d23386c346&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435264 Feb 08 18:16:39.732376 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device b77bffb2-0403-4c4d-b0c9-4de454874429 up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:16:39.792989 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning for port b77bffb2-0403-4c4d-b0c9-4de454874429 completed by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Feb 08 18:16:39.797126 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port b77bffb2-0403-4c4d-b0c9-4de454874429 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:16:39.797494 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (b77bffb2-0403-4c4d-b0c9-4de454874429), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:39.893510 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc5195c8-4d9a-4be5-9215-e1176e67e72d req-550d84e4-530c-4b9f-8dc5-6eba79db5024 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:39.895113 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-bc5195c8-4d9a-4be5-9215-e1176e67e72d req-550d84e4-530c-4b9f-8dc5-6eba79db5024 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 945 time: 0.0548251 Feb 08 18:16:39.954152 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-bc5195c8-4d9a-4be5-9215-e1176e67e72d req-00fd8eb2-dcb3-4ee4-b725-7ebae0a3b10d tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=4ead608b-09aa-4247-92a7-e3d23386c346&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0528691 Feb 08 18:16:40.011939 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port b77bffb2-0403-4c4d-b0c9-4de454874429 is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:16:40.012322 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (b77bffb2-0403-4c4d-b0c9-4de454874429), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:40.036498 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '93e9d398-2f45-4bba-8f28-35d32a92af5b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b77bffb2-0403-4c4d-b0c9-4de454874429'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:16:40.038786 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b4624fff-034c-4295-92cf-72e53fcf2aee" -d '{"events": [{"server_uuid": "93e9d398-2f45-4bba-8f28-35d32a92af5b", "name": "network-vif-plugged", "status": "completed", "tag": "b77bffb2-0403-4c4d-b0c9-4de454874429"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:16:40.050856 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port b77bffb2-0403-4c4d-b0c9-4de454874429, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=b77bffb2-0403-4c4d-b0c9-4de454874429,segment=NetworkSegment(acdceaea-bf94-4e23-8e9f-0f5d9197e75f),segment_id=acdceaea-bf94-4e23-8e9f-0f5d9197e75f)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:16:40.056598 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (b77bffb2-0403-4c4d-b0c9-4de454874429), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:40.081621 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:16:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b42ca7b7-adc0-49db-a4af-2a0bec24ea03 x-openstack-request-id: req-b42ca7b7-adc0-49db-a4af-2a0bec24ea03 {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:16:40.081934 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "93e9d398-2f45-4bba-8f28-35d32a92af5b", "name": "network-vif-plugged", "status": "completed", "tag": "b77bffb2-0403-4c4d-b0c9-4de454874429", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:16:40.082183 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-b42ca7b7-adc0-49db-a4af-2a0bec24ea03 {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:16:40.082557 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '93e9d398-2f45-4bba-8f28-35d32a92af5b', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b77bffb2-0403-4c4d-b0c9-4de454874429', 'code': 200} Feb 08 18:16:40.107846 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=b77bffb2-0403-4c4d-b0c9-4de454874429,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:40.866105 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1922ecff-c3f4-43ab-8298-4a0d96546c7a req-7a3b4ca1-8cb9-4216-afaf-a0e2e1a8334b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:40.867646 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1922ecff-c3f4-43ab-8298-4a0d96546c7a req-7a3b4ca1-8cb9-4216-afaf-a0e2e1a8334b service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 1130 time: 0.0453162 Feb 08 18:16:40.914522 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1922ecff-c3f4-43ab-8298-4a0d96546c7a req-a458236b-022b-42cd-8b3c-67a1775f03b2 service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=4ead608b-09aa-4247-92a7-e3d23386c346&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0383537 Feb 08 18:16:41.082604 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0264f94c-016b-4819-a83b-5d55874d17b5 req-66271629-8498-4048-80f0-fb2adf1bdddb tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:41.084347 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0264f94c-016b-4819-a83b-5d55874d17b5 req-66271629-8498-4048-80f0-fb2adf1bdddb tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 946 time: 0.0550790 Feb 08 18:16:41.145348 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0264f94c-016b-4819-a83b-5d55874d17b5 req-99b43e26-1a6d-4694-8289-abde5b04ba10 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=4ead608b-09aa-4247-92a7-e3d23386c346&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0549288 Feb 08 18:16:42.278621 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10942b9c-266e-46de-9c67-99678cd46c7c req-ea04acb1-2d78-499d-b9a8-c9e6dfff0c97 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:42.282803 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-10942b9c-266e-46de-9c67-99678cd46c7c req-ea04acb1-2d78-499d-b9a8-c9e6dfff0c97 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 946 time: 0.0529706 Feb 08 18:16:42.327391 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-10942b9c-266e-46de-9c67-99678cd46c7c req-3fb46880-6f29-408a-b206-4fc1702718f3 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=4ead608b-09aa-4247-92a7-e3d23386c346&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415409 Feb 08 18:16:43.467911 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22f5fc9b-7252-4fce-bf2e-6279f38bab08 req-29502df0-c74e-48da-a331-0244a6908fee tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:43.469374 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-22f5fc9b-7252-4fce-bf2e-6279f38bab08 req-29502df0-c74e-48da-a331-0244a6908fee tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 946 time: 0.0634758 Feb 08 18:16:43.517278 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-22f5fc9b-7252-4fce-bf2e-6279f38bab08 req-48212d3d-cf2d-4c13-a96c-cfb2c87e65fa tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=4ead608b-09aa-4247-92a7-e3d23386c346&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0403361 Feb 08 18:16:44.655299 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-786cddac-a3f9-4e54-90c1-eaa28100e543 req-4ff4650f-c3e4-4d89-93e6-1c17e5b329dc tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:44.656837 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-786cddac-a3f9-4e54-90c1-eaa28100e543 req-4ff4650f-c3e4-4d89-93e6-1c17e5b329dc tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 946 time: 0.0719724 Feb 08 18:16:44.705500 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-786cddac-a3f9-4e54-90c1-eaa28100e543 req-38cb36a7-5104-4e97-9bd1-32fc26a7dd2e tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=4ead608b-09aa-4247-92a7-e3d23386c346&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428145 Feb 08 18:16:45.371023 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-33ef21ee-58f1-448b-bf06-a64990dcb899 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:45.832467 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-441c03ef-d69e-448f-860e-eda72dd6b5e1 req-102105a7-b9fb-4a70-a7ef-327cb9f6aa52 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:45.833948 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-441c03ef-d69e-448f-860e-eda72dd6b5e1 req-102105a7-b9fb-4a70-a7ef-327cb9f6aa52 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 946 time: 0.0570633 Feb 08 18:16:45.881493 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-441c03ef-d69e-448f-860e-eda72dd6b5e1 req-18ce740e-eaa8-4513-b464-e3030327f896 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=4ead608b-09aa-4247-92a7-e3d23386c346&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418520 Feb 08 18:16:46.003998 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-792d09e6-cf96-4e0d-995d-98b13ba3536c req-1e3a31fb-04e7-4fd6-92f9-789fa37b67ff tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:46.005443 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-792d09e6-cf96-4e0d-995d-98b13ba3536c req-1e3a31fb-04e7-4fd6-92f9-789fa37b67ff tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 946 time: 0.0592923 Feb 08 18:16:46.014081 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 41526) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:16:46.018440 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-83389029-82aa-4cf1-905f-01ba19d79570 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Request body: {'floatingip': {'port_id': 'b77bffb2-0403-4c4d-b0c9-4de454874429'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:16:46.059113 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-83389029-82aa-4cf1-905f-01ba19d79570 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for floatingip (0a8ed6c0-d363-4a2c-9628-d369a0abdf56), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:46.475296 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-83389029-82aa-4cf1-905f-01ba19d79570 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:46.480832 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-83389029-82aa-4cf1-905f-01ba19d79570 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-560746'] for floatingip (0a8ed6c0-d363-4a2c-9628-d369a0abdf56), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:46.581547 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.l3_db [None req-83389029-82aa-4cf1-905f-01ba19d79570 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Floating IP 0a8ed6c0-d363-4a2c-9628-d369a0abdf56 associated. External IP: 172.27.1.16, port: b77bffb2-0403-4c4d-b0c9-4de454874429. Feb 08 18:16:46.793120 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-83389029-82aa-4cf1-905f-01ba19d79570 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:16:46.906170 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-83389029-82aa-4cf1-905f-01ba19d79570 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:16:46.911640 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-83389029-82aa-4cf1-905f-01ba19d79570 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for floatingip (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:46.916346 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-faf5acf4-f465-412b-853a-dde4efd2eb04 None None] Sync routers for ids ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:16:46.927732 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-faf5acf4-f465-412b-853a-dde4efd2eb04 None None] Routers {'3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:16:46.928332 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-faf5acf4-f465-412b-853a-dde4efd2eb04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:16:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:16:46.940758 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-83389029-82aa-4cf1-905f-01ba19d79570 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "PUT /v2.0/floatingips/0a8ed6c0-d363-4a2c-9628-d369a0abdf56 HTTP/1.1" status: 200 len: 991 time: 0.9256916 Feb 08 18:16:46.941322 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '93e9d398-2f45-4bba-8f28-35d32a92af5b', 'tag': 'b77bffb2-0403-4c4d-b0c9-4de454874429'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:16:46.943578 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-04bf3092-3d85-4d89-bb7e-440cd626dcd4" -d '{"events": [{"name": "network-changed", "server_uuid": "93e9d398-2f45-4bba-8f28-35d32a92af5b", "tag": "b77bffb2-0403-4c4d-b0c9-4de454874429"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:16:46.982562 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:16:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1e32e3b2-5794-408e-8169-c06b965e5a7b x-openstack-request-id: req-1e32e3b2-5794-408e-8169-c06b965e5a7b {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:16:46.982861 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "93e9d398-2f45-4bba-8f28-35d32a92af5b", "tag": "b77bffb2-0403-4c4d-b0c9-4de454874429", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:16:46.983808 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-1e32e3b2-5794-408e-8169-c06b965e5a7b {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:16:46.983808 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '93e9d398-2f45-4bba-8f28-35d32a92af5b', 'tag': 'b77bffb2-0403-4c4d-b0c9-4de454874429', 'status': 'completed', 'code': 200} Feb 08 18:16:47.035851 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-faf5acf4-f465-412b-853a-dde4efd2eb04 None None] Set router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:16:47.054401 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-705c8a6b-3400-4183-bd2a-d71368c76e24 req-932257b8-4187-42fd-96d9-b732af028652 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:47.055846 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-705c8a6b-3400-4183-bd2a-d71368c76e24 req-932257b8-4187-42fd-96d9-b732af028652 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 946 time: 0.0563571 Feb 08 18:16:47.101431 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-705c8a6b-3400-4183-bd2a-d71368c76e24 req-37d5416b-75d6-4ff4-967e-40c20018c934 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=4ead608b-09aa-4247-92a7-e3d23386c346&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0399568 Feb 08 18:16:47.259107 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-faf5acf4-f465-412b-853a-dde4efd2eb04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'name': 'tempest-AttachVolumeTestJSON-997005721-router', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77'}], 'enable_snat': True}, 'gw_port_id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:23Z', 'revision_number': 4, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'gw_port': {'id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ad:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '0a8ed6c0-d363-4a2c-9628-d369a0abdf56', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'floating_ip_address': '172.27.1.16', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'port_id': 'b77bffb2-0403-4c4d-b0c9-4de454874429', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 468, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'mac_address': 'fa:16:3e:f3:ee:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93e9d398-2f45-4bba-8f28-35d32a92af5b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:16:26Z', 'updated_at': '2022-02-08T18:16:46Z', 'revision_number': 1, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fe9dfbe9-83a8-472c-b3a3-9537d424939b', 'name': '', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'mac_address': 'fa:16:3e:dd:46:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:19Z', 'updated_at': '2022-02-08T18:12:34Z', 'revision_number': 5, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'subnets': [{'id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:16:47.289264 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-faf5acf4-f465-412b-853a-dde4efd2eb04 None None] Checking router: 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:16:47.290457 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04bf3092-3d85-4d89-bb7e-440cd626dcd4 req-41ed0921-40e4-447a-80a1-3cc7d021a218 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:47.292007 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-04bf3092-3d85-4d89-bb7e-440cd626dcd4 req-41ed0921-40e4-447a-80a1-3cc7d021a218 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=630172c388404c75bda3d0ba2d9d5834&device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 1130 time: 0.0447149 Feb 08 18:16:47.298041 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-faf5acf4-f465-412b-853a-dde4efd2eb04 None None] Routers {'3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:16:47.298999 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-faf5acf4-f465-412b-853a-dde4efd2eb04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:16:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:16:47.388319 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04bf3092-3d85-4d89-bb7e-440cd626dcd4 req-05038f07-3626-4fd5-9213-fbe1a6abb49f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:47.389823 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-04bf3092-3d85-4d89-bb7e-440cd626dcd4 req-05038f07-3626-4fd5-9213-fbe1a6abb49f service neutron] 10.222.0.109 "GET /v2.0/networks?id=e430084e-9b28-426f-9937-61346814b135 HTTP/1.1" status: 200 len: 912 time: 0.0893724 Feb 08 18:16:47.406433 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-faf5acf4-f465-412b-853a-dde4efd2eb04 None None] Set router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:16:47.457005 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-04bf3092-3d85-4d89-bb7e-440cd626dcd4 req-94658b51-ff92-4399-867e-48f11a50a4b9 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=b77bffb2-0403-4c4d-b0c9-4de454874429 HTTP/1.1" status: 200 len: 999 time: 0.0597081 Feb 08 18:16:47.507128 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04bf3092-3d85-4d89-bb7e-440cd626dcd4 req-e99e996e-234f-47ca-8895-5659684f76c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:47.508939 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-04bf3092-3d85-4d89-bb7e-440cd626dcd4 req-e99e996e-234f-47ca-8895-5659684f76c9 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=86592955-e7d0-4e8a-9490-976e17240d7c HTTP/1.1" status: 200 len: 849 time: 0.0455029 Feb 08 18:16:47.561889 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04bf3092-3d85-4d89-bb7e-440cd626dcd4 req-90518772-9d0d-4826-9629-825ba02c2e5f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:47.563438 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-04bf3092-3d85-4d89-bb7e-440cd626dcd4 req-90518772-9d0d-4826-9629-825ba02c2e5f service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=e430084e-9b28-426f-9937-61346814b135&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0480797 Feb 08 18:16:47.633472 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-faf5acf4-f465-412b-853a-dde4efd2eb04 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'name': 'tempest-AttachVolumeTestJSON-997005721-router', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77'}], 'enable_snat': True}, 'gw_port_id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:23Z', 'revision_number': 4, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'gw_port': {'id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ad:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '0a8ed6c0-d363-4a2c-9628-d369a0abdf56', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'floating_ip_address': '172.27.1.16', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'port_id': 'b77bffb2-0403-4c4d-b0c9-4de454874429', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 468, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'mac_address': 'fa:16:3e:f3:ee:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93e9d398-2f45-4bba-8f28-35d32a92af5b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:16:26Z', 'updated_at': '2022-02-08T18:16:46Z', 'revision_number': 1, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fe9dfbe9-83a8-472c-b3a3-9537d424939b', 'name': '', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'mac_address': 'fa:16:3e:dd:46:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:19Z', 'updated_at': '2022-02-08T18:12:34Z', 'revision_number': 5, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'subnets': [{'id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:16:47.652364 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-04bf3092-3d85-4d89-bb7e-440cd626dcd4 req-10ef55c8-6316-4de1-b057-bf6ce8431a77 service neutron] 10.222.0.109 "GET /v2.0/networks/e430084e-9b28-426f-9937-61346814b135?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0816619 Feb 08 18:16:47.663057 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-faf5acf4-f465-412b-853a-dde4efd2eb04 None None] The sync data for ids ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'] in dv-cinder-773985-21-iscsi is: [{'id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'name': 'tempest-AttachVolumeTestJSON-997005721-router', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77'}], 'enable_snat': True}, 'gw_port_id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:23Z', 'revision_number': 4, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'gw_port': {'id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ad:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '0a8ed6c0-d363-4a2c-9628-d369a0abdf56', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'floating_ip_address': '172.27.1.16', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'port_id': 'b77bffb2-0403-4c4d-b0c9-4de454874429', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 468, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'mac_address': 'fa:16:3e:f3:ee:f6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93e9d398-2f45-4bba-8f28-35d32a92af5b', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:16:26Z', 'updated_at': '2022-02-08T18:16:46Z', 'revision_number': 1, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fe9dfbe9-83a8-472c-b3a3-9537d424939b', 'name': '', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'mac_address': 'fa:16:3e:dd:46:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:19Z', 'updated_at': '2022-02-08T18:12:34Z', 'revision_number': 5, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'subnets': [{'id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:16:47.750290 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-04bf3092-3d85-4d89-bb7e-440cd626dcd4 req-3ab61caf-658d-41ae-9b25-b5326cd34779 service neutron] 10.222.0.109 "GET /v2.0/networks/e430084e-9b28-426f-9937-61346814b135?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0899732 Feb 08 18:16:47.825027 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-e35497ec-947f-43e1-8952-8206057cbd5b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:47.853520 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80fe99e3-9018-4b57-94c5-1af9cfa884b4 None None] New status for floating IP 0a8ed6c0-d363-4a2c-9628-d369a0abdf56: ACTIVE {{(pid=102562) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Feb 08 18:16:47.978966 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:48.229358 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6345afb7-c5e5-42da-bafa-47eee6004f7c req-22cbb832-58c4-45fc-9521-f3e68e0d8dea tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:48.230806 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-6345afb7-c5e5-42da-bafa-47eee6004f7c req-22cbb832-58c4-45fc-9521-f3e68e0d8dea tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 946 time: 0.0541079 Feb 08 18:16:48.279157 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-6345afb7-c5e5-42da-bafa-47eee6004f7c req-7a3635dd-9fde-432a-80b0-9308a70683fa tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=4ead608b-09aa-4247-92a7-e3d23386c346&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400183 Feb 08 18:16:48.498787 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:50.104929 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:51.670803 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:54.780186 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-996b5abb-0e99-4d82-8a68-742454c73f1c req-b6d0dc64-68c3-4aca-b847-4c0960d351cb tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:54.781826 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-996b5abb-0e99-4d82-8a68-742454c73f1c req-b6d0dc64-68c3-4aca-b847-4c0960d351cb tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 946 time: 0.0582912 Feb 08 18:16:54.837437 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-996b5abb-0e99-4d82-8a68-742454c73f1c req-ebde8d6b-3c6d-448c-a832-8cbe1b6b1b30 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482888 Feb 08 18:16:55.982903 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-510fd478-7201-414e-bdb7-44d207891362 req-a0adbb29-2dd7-434f-9f37-a7641cb489a0 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:55.984441 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-510fd478-7201-414e-bdb7-44d207891362 req-a0adbb29-2dd7-434f-9f37-a7641cb489a0 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 946 time: 0.0677385 Feb 08 18:16:56.038347 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-510fd478-7201-414e-bdb7-44d207891362 req-b2556741-5508-4aa3-9cea-2a669a8d93e6 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453513 Feb 08 18:16:57.168498 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6667b0a5-f14c-431b-bebe-3260d1df310d req-08c1d4d9-0333-441d-96d6-1c83980bea93 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:57.169981 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-6667b0a5-f14c-431b-bebe-3260d1df310d req-08c1d4d9-0333-441d-96d6-1c83980bea93 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 946 time: 0.0608778 Feb 08 18:16:57.220051 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-6667b0a5-f14c-431b-bebe-3260d1df310d req-de69f3c9-ea4c-4043-954f-b3e4bea016ee tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0439060 Feb 08 18:16:58.358039 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ab2c373-cedf-4de3-bef1-52546ce63b94 req-16000a5d-34b0-4afc-9138-c79e9e4874e6 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:58.359634 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5ab2c373-cedf-4de3-bef1-52546ce63b94 req-16000a5d-34b0-4afc-9138-c79e9e4874e6 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 946 time: 0.0564127 Feb 08 18:16:58.408009 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5ab2c373-cedf-4de3-bef1-52546ce63b94 req-a2b572d3-d587-4c0a-9a5f-25ee3bac20a5 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427909 Feb 08 18:16:58.684450 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2fd9e60-9a4c-4f16-9c41-f61916352ef6 req-14786b94-56b8-408f-9365-2410f72626ab tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:16:58.686126 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e2fd9e60-9a4c-4f16-9c41-f61916352ef6 req-14786b94-56b8-408f-9365-2410f72626ab tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.109 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 946 time: 0.0566187 Feb 08 18:16:58.798588 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-e2fd9e60-9a4c-4f16-9c41-f61916352ef6 req-ec7b8a95-e4ca-4af5-9129-7ac81abe401d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Deleting port feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:16:58.798905 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-e2fd9e60-9a4c-4f16-9c41-f61916352ef6 req-ec7b8a95-e4ca-4af5-9129-7ac81abe401d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:58.889812 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-e2fd9e60-9a4c-4f16-9c41-f61916352ef6 req-ec7b8a95-e4ca-4af5-9129-7ac81abe401d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] For port feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8,segment=NetworkSegment(fc5ec9ee-df90-46f3-bddf-aef0221d9066),segment_id=fc5ec9ee-df90-46f3-bddf-aef0221d9066)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:16:58.890291 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-e2fd9e60-9a4c-4f16-9c41-f61916352ef6 req-ec7b8a95-e4ca-4af5-9129-7ac81abe401d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:58.979272 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:16:59.078804 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-e2fd9e60-9a4c-4f16-9c41-f61916352ef6 req-ec7b8a95-e4ca-4af5-9129-7ac81abe401d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:59.079177 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-e2fd9e60-9a4c-4f16-9c41-f61916352ef6 req-ec7b8a95-e4ca-4af5-9129-7ac81abe401d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-560746'] for floatingip (00651317-6b63-457e-ae80-8fd5622d070a), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:59.079534 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.l3_db [req-e2fd9e60-9a4c-4f16-9c41-f61916352ef6 req-ec7b8a95-e4ca-4af5-9129-7ac81abe401d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Floating IP 00651317-6b63-457e-ae80-8fd5622d070a disassociated. External IP: 172.27.1.5, port: feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8. Feb 08 18:16:59.079924 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-e2fd9e60-9a4c-4f16-9c41-f61916352ef6 req-ec7b8a95-e4ca-4af5-9129-7ac81abe401d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Calling delete_port for feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 owned by compute:nova {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:16:59.212937 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-e2fd9e60-9a4c-4f16-9c41-f61916352ef6 req-ec7b8a95-e4ca-4af5-9129-7ac81abe401d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:59.243632 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec7b8a95-e4ca-4af5-9129-7ac81abe401d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Pushing event deleted for resources: {'Port': ['ID=feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:16:59.355118 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [req-e2fd9e60-9a4c-4f16-9c41-f61916352ef6 req-ec7b8a95-e4ca-4af5-9129-7ac81abe401d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Router 72b4fd56-6775-4076-9195-fe85693f53aa has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:16:59.467867 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-e2fd9e60-9a4c-4f16-9c41-f61916352ef6 req-ec7b8a95-e4ca-4af5-9129-7ac81abe401d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:16:59.480908 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1aab41fe-9345-40f8-b069-24c5af4b9fce None None] Sync routers for ids ['72b4fd56-6775-4076-9195-fe85693f53aa'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:16:59.494360 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1aab41fe-9345-40f8-b069-24c5af4b9fce None None] Routers {'72b4fd56-6775-4076-9195-fe85693f53aa'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:16:59.495043 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-1aab41fe-9345-40f8-b069-24c5af4b9fce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:16:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['72b4fd56-6775-4076-9195-fe85693f53aa'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:16:59.533644 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [req-e2fd9e60-9a4c-4f16-9c41-f61916352ef6 req-ec7b8a95-e4ca-4af5-9129-7ac81abe401d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] No DVR routers for this DVR port feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 on host hv-cinder-77398 {{(pid=102560) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:16:59.537080 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-e2fd9e60-9a4c-4f16-9c41-f61916352ef6 req-ec7b8a95-e4ca-4af5-9129-7ac81abe401d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:16:59.540886 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e2fd9e60-9a4c-4f16-9c41-f61916352ef6 req-ec7b8a95-e4ca-4af5-9129-7ac81abe401d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.109 "DELETE /v2.0/ports/feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 HTTP/1.1" status: 204 len: 173 time: 0.8463893 Feb 08 18:16:59.557813 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '276ac338-a990-44da-a077-251beabd094d', 'name': 'network-vif-deleted', 'tag': 'feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:16:59.560159 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f9e4791a-2a23-47fa-a8e6-8510cdf14242" -d '{"events": [{"server_uuid": "276ac338-a990-44da-a077-251beabd094d", "name": "network-vif-deleted", "tag": "feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:16:59.564490 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-29bd6a97-bfc9-452c-8ff2-e139954c4668 req-050f23eb-ebe0-4ee4-967a-04d1935d47d0 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=276ac338-a990-44da-a077-251beabd094d HTTP/1.1" status: 200 len: 210 time: 0.0636961 Feb 08 18:16:59.635589 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-1aab41fe-9345-40f8-b069-24c5af4b9fce None None] Set router 72b4fd56-6775-4076-9195-fe85693f53aa gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:16:59.663900 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:16:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f9f75ca0-85a0-451a-a283-cc669849e766 x-openstack-request-id: req-f9f75ca0-85a0-451a-a283-cc669849e766 {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:16:59.664185 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "276ac338-a990-44da-a077-251beabd094d", "name": "network-vif-deleted", "tag": "feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:16:59.664730 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-f9f75ca0-85a0-451a-a283-cc669849e766 {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:16:59.665071 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '276ac338-a990-44da-a077-251beabd094d', 'name': 'network-vif-deleted', 'tag': 'feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8', 'status': 'completed', 'code': 200} Feb 08 18:16:59.895006 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-1aab41fe-9345-40f8-b069-24c5af4b9fce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 4, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '13fcfd03-fc49-4bba-8574-ec74e795e2bd', 'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'mac_address': 'fa:16:3e:4b:7b:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:44Z', 'updated_at': '2022-02-08T18:13:51Z', 'revision_number': 5, 'project_id': '768f50510c57419e8a49ed0988014174', 'subnets': [{'id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:16:59.923641 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1aab41fe-9345-40f8-b069-24c5af4b9fce None None] Checking router: 72b4fd56-6775-4076-9195-fe85693f53aa for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:16:59.937100 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1aab41fe-9345-40f8-b069-24c5af4b9fce None None] Routers {'72b4fd56-6775-4076-9195-fe85693f53aa'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:16:59.937100 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-1aab41fe-9345-40f8-b069-24c5af4b9fce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:16:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['72b4fd56-6775-4076-9195-fe85693f53aa'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:00.048001 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-1aab41fe-9345-40f8-b069-24c5af4b9fce None None] Set router 72b4fd56-6775-4076-9195-fe85693f53aa gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:17:00.439920 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-1aab41fe-9345-40f8-b069-24c5af4b9fce None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 4, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '13fcfd03-fc49-4bba-8574-ec74e795e2bd', 'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'mac_address': 'fa:16:3e:4b:7b:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:44Z', 'updated_at': '2022-02-08T18:13:51Z', 'revision_number': 5, 'project_id': '768f50510c57419e8a49ed0988014174', 'subnets': [{'id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:00.470537 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1aab41fe-9345-40f8-b069-24c5af4b9fce None None] The sync data for ids ['72b4fd56-6775-4076-9195-fe85693f53aa'] in dv-cinder-773985-21-iscsi is: [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 4, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '13fcfd03-fc49-4bba-8574-ec74e795e2bd', 'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'mac_address': 'fa:16:3e:4b:7b:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:44Z', 'updated_at': '2022-02-08T18:13:51Z', 'revision_number': 5, 'project_id': '768f50510c57419e8a49ed0988014174', 'subnets': [{'id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:17:00.709931 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e819d0a7-a371-4d98-a67d-d554f2a8dd9d None None] New status for floating IP 00651317-6b63-457e-ae80-8fd5622d070a: DOWN {{(pid=102562) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Feb 08 18:17:00.851564 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-014c79c4-022b-4ece-8e06-7227217eae36 req-881035f6-2004-44f0-8a28-c001575f0edb tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1840993501&fields=id&tenant_id=768f50510c57419e8a49ed0988014174 HTTP/1.1" status: 200 len: 267 time: 0.0504308 Feb 08 18:17:00.965185 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-014c79c4-022b-4ece-8e06-7227217eae36 req-4dfcc29d-6cf8-4438-9ea6-52c8501a1be2 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:00.966882 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-014c79c4-022b-4ece-8e06-7227217eae36 req-4dfcc29d-6cf8-4438-9ea6-52c8501a1be2 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/networks?id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 HTTP/1.1" status: 200 len: 811 time: 0.1078062 Feb 08 18:17:00.986796 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-014c79c4-022b-4ece-8e06-7227217eae36 req-be405a46-81f5-45d0-b646-70610d028b10 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/quotas/768f50510c57419e8a49ed0988014174 HTTP/1.1" status: 200 len: 375 time: 0.0140746 Feb 08 18:17:01.060542 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-014c79c4-022b-4ece-8e06-7227217eae36 req-b92df7a8-98b3-4c84-85d2-b8fa2917ae2f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?tenant_id=768f50510c57419e8a49ed0988014174&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0653825 Feb 08 18:17:01.161793 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-014c79c4-022b-4ece-8e06-7227217eae36 req-1648ae51-c0ea-4537-abf5-231e57fa466f service neutron] 10.222.0.118 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0887256 Feb 08 18:17:01.262481 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-014c79c4-022b-4ece-8e06-7227217eae36 req-0e53bbec-629a-4241-aeec-88f0359ead18 service neutron] 10.222.0.118 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0947521 Feb 08 18:17:01.577160 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e4655df3-df8f-4ce7-abda-cfa5f7dabce9 req-11ef9ea6-a540-4dd5-b39b-4d14b1e4d4d4 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 210 time: 0.0309989 Feb 08 18:17:02.612145 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-014c79c4-022b-4ece-8e06-7227217eae36 req-c72b2015-1ae4-4b95-a85b-5889dc3f6599 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:02.613517 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-014c79c4-022b-4ece-8e06-7227217eae36 req-c72b2015-1ae4-4b95-a85b-5889dc3f6599 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.109 "GET /v2.0/networks?id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 HTTP/1.1" status: 200 len: 811 time: 0.1015327 Feb 08 18:17:02.691813 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-33d25ea9-15e0-4f46-94ed-49cb218248c2 req-48d89ce1-784a-46c5-956b-4d8ee8e019d6 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 210 time: 0.0321631 Feb 08 18:17:02.694872 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-014c79c4-022b-4ece-8e06-7227217eae36 req-7cd09abf-9af2-4c42-a845-7862de005d06 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.109 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=768f50510c57419e8a49ed0988014174 HTTP/1.1" status: 200 len: 380 time: 0.0663753 Feb 08 18:17:02.710409 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [req-014c79c4-022b-4ece-8e06-7227217eae36 req-40da1166-14e6-4d25-aad4-1785bca4fed8 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Request body: {'port': {'device_id': '7b68b868-44af-459b-8cc4-7ec714415497', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'admin_state_up': True, 'tenant_id': '768f50510c57419e8a49ed0988014174', 'security_groups': ['2d4a2503-75cd-4739-b472-f29476744b67']}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:17:02.817335 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-014c79c4-022b-4ece-8e06-7227217eae36 req-40da1166-14e6-4d25-aad4-1785bca4fed8 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Made reservation on behalf of 768f50510c57419e8a49ed0988014174 for: {'port': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:17:02.820862 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-014c79c4-022b-4ece-8e06-7227217eae36 req-40da1166-14e6-4d25-aad4-1785bca4fed8 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:02.955415 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_common [req-014c79c4-022b-4ece-8e06-7227217eae36 req-40da1166-14e6-4d25-aad4-1785bca4fed8 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Allocated IP 172.20.0.3 (2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74/7b1e16de-d9af-4f50-86d7-ee22c9e14b1b/8f5b70dd-2b98-47c5-9288-4dabd9ca45e6) {{(pid=102560) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:17:02.999282 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 41848) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:03.108751 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da7a40e9-5932-404c-ac50-f92a8b541fe3 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:03.109671 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-014c79c4-022b-4ece-8e06-7227217eae36 req-40da1166-14e6-4d25-aad4-1785bca4fed8 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for port (8f5b70dd-2b98-47c5-9288-4dabd9ca45e6), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:03.116973 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:17:03.137836 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] No Port match for: feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:17:03.138497 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device feb7d5f5-5b8e-4566-8d6b-66a8154ca3d8 not bound to the agent host hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:17:03.152912 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-014c79c4-022b-4ece-8e06-7227217eae36 req-40da1166-14e6-4d25-aad4-1785bca4fed8 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (8f5b70dd-2b98-47c5-9288-4dabd9ca45e6), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:03.185862 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da7a40e9-5932-404c-ac50-f92a8b541fe3 admin admin] Publish callbacks [] for security_group (4f2c99ee-1b83-4e34-a1d8-c8ef291b4881), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:03.192187 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da7a40e9-5932-404c-ac50-f92a8b541fe3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (4f2c99ee-1b83-4e34-a1d8-c8ef291b4881), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:03.193809 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-014c79c4-022b-4ece-8e06-7227217eae36 req-40da1166-14e6-4d25-aad4-1785bca4fed8 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Network 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:17:03.196946 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [req-014c79c4-022b-4ece-8e06-7227217eae36 req-40da1166-14e6-4d25-aad4-1785bca4fed8 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:17:03.199441 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [req-014c79c4-022b-4ece-8e06-7227217eae36 req-40da1166-14e6-4d25-aad4-1785bca4fed8 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Received port after_create {{(pid=102560) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:17:03.233931 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40da1166-14e6-4d25-aad4-1785bca4fed8 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Pushing event updated for resources: {'Port': ['ID=8f5b70dd-2b98-47c5-9288-4dabd9ca45e6,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:03.235520 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-da7a40e9-5932-404c-ac50-f92a8b541fe3 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=fb5e2a38a30c4e7591753b529cd4a7b2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2351665 Feb 08 18:17:03.236971 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da7a40e9-5932-404c-ac50-f92a8b541fe3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4f2c99ee-1b83-4e34-a1d8-c8ef291b4881,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:03.239609 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 41852) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:03.262194 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-014c79c4-022b-4ece-8e06-7227217eae36 req-40da1166-14e6-4d25-aad4-1785bca4fed8 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:03.262851 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-014c79c4-022b-4ece-8e06-7227217eae36 req-40da1166-14e6-4d25-aad4-1785bca4fed8 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:03.281013 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-014c79c4-022b-4ece-8e06-7227217eae36 req-40da1166-14e6-4d25-aad4-1785bca4fed8 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.109 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5747323 Feb 08 18:17:03.296232 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d2e18d78-39b8-4914-894d-4f1d7bb2064b admin admin] Publish callbacks [] for security_group (4f2c99ee-1b83-4e34-a1d8-c8ef291b4881), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:03.296774 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [req-014c79c4-022b-4ece-8e06-7227217eae36 req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] Request body: {'port': {'device_id': '7b68b868-44af-459b-8cc4-7ec714415497', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77398'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:17:03.320838 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d2e18d78-39b8-4914-894d-4f1d7bb2064b admin admin] Publish callbacks [] for security_group (4f2c99ee-1b83-4e34-a1d8-c8ef291b4881), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:03.373327 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-014c79c4-022b-4ece-8e06-7227217eae36 req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (8f5b70dd-2b98-47c5-9288-4dabd9ca45e6), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:03.382982 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d2e18d78-39b8-4914-894d-4f1d7bb2064b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (4f2c99ee-1b83-4e34-a1d8-c8ef291b4881), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:03.385660 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d2e18d78-39b8-4914-894d-4f1d7bb2064b admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:03.386889 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-d2e18d78-39b8-4914-894d-4f1d7bb2064b admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/4f2c99ee-1b83-4e34-a1d8-c8ef291b4881 HTTP/1.1" status: 204 len: 168 time: 0.1459911 Feb 08 18:17:03.395432 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2e18d78-39b8-4914-894d-4f1d7bb2064b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4f2c99ee-1b83-4e34-a1d8-c8ef291b4881,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:03.493721 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-c3ba728f-0eeb-4f73-a7eb-bb30703446ad None None] Provisioning complete for port 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:03.494327 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-c3ba728f-0eeb-4f73-a7eb-bb30703446ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (8f5b70dd-2b98-47c5-9288-4dabd9ca45e6), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:03.532583 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-c3ba728f-0eeb-4f73-a7eb-bb30703446ad None None] Port 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:17:03.695629 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 41858) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:03.709742 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-16e5d904-1656-428b-aea7-e74c8a56d4b1 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:03.811255 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-16e5d904-1656-428b-aea7-e74c8a56d4b1 admin admin] Publish callbacks [] for security_group (f500901e-1cbd-456c-a57f-e43945366c9f), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:03.816706 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-16e5d904-1656-428b-aea7-e74c8a56d4b1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (f500901e-1cbd-456c-a57f-e43945366c9f), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:03.864071 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-16e5d904-1656-428b-aea7-e74c8a56d4b1 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=6e3e3c45319344689bf24e686db29697&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1673214 Feb 08 18:17:03.865395 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16e5d904-1656-428b-aea7-e74c8a56d4b1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f500901e-1cbd-456c-a57f-e43945366c9f,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:03.867941 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 41864) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:03.900595 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80999efa-52b9-43a9-ba04-c577d1c48f37 req-91ee1a2d-3588-4601-b1c6-f7ab1cf2f3b8 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:03.901969 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-80999efa-52b9-43a9-ba04-c577d1c48f37 req-91ee1a2d-3588-4601-b1c6-f7ab1cf2f3b8 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 931 time: 0.0781767 Feb 08 18:17:03.921614 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-dc05db69-87a7-486a-82ce-b0e940fda83a admin admin] Publish callbacks [] for security_group (f500901e-1cbd-456c-a57f-e43945366c9f), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:03.943778 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-dc05db69-87a7-486a-82ce-b0e940fda83a admin admin] Publish callbacks [] for security_group (f500901e-1cbd-456c-a57f-e43945366c9f), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:03.988509 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-80999efa-52b9-43a9-ba04-c577d1c48f37 req-6fbfebae-a5db-4b3d-b4a4-aef794a0b195 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0805669 Feb 08 18:17:04.004897 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [req-014c79c4-022b-4ece-8e06-7227217eae36 req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 {{(pid=102560) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:17:04.006328 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-dc05db69-87a7-486a-82ce-b0e940fda83a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (f500901e-1cbd-456c-a57f-e43945366c9f), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:04.009071 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-dc05db69-87a7-486a-82ce-b0e940fda83a admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:04.010349 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-dc05db69-87a7-486a-82ce-b0e940fda83a admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/f500901e-1cbd-456c-a57f-e43945366c9f HTTP/1.1" status: 204 len: 168 time: 0.1414404 Feb 08 18:17:04.018262 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-014c79c4-022b-4ece-8e06-7227217eae36 req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] Publish callbacks [] for port (8f5b70dd-2b98-47c5-9288-4dabd9ca45e6), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:04.027656 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc05db69-87a7-486a-82ce-b0e940fda83a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f500901e-1cbd-456c-a57f-e43945366c9f,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:04.032815 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.provisioning_blocks [req-014c79c4-022b-4ece-8e06-7227217eae36 req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] Transition to ACTIVE for port object 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 will not be triggered until provisioned by entity L2. {{(pid=102560) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Feb 08 18:17:04.039917 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-014c79c4-022b-4ece-8e06-7227217eae36 req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-64531588'] for port (8f5b70dd-2b98-47c5-9288-4dabd9ca45e6), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:04.114624 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] Pushing event updated for resources: {'Port': ['ID=8f5b70dd-2b98-47c5-9288-4dabd9ca45e6,revision_number=2']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:04.168952 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-014c79c4-022b-4ece-8e06-7227217eae36 req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] Attempting to bind port 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 on host hv-cinder-77398 for vnic_type normal with profile {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:17:04.169317 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-014c79c4-022b-4ece-8e06-7227217eae36 req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] Attempting to bind port 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 by drivers openvswitch,hyperv on host hv-cinder-77398 at level 0 using segments [{'id': 'fc5ec9ee-df90-46f3-bddf-aef0221d9066', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1066, 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74'}] {{(pid=102560) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:17:04.173882 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-014c79c4-022b-4ece-8e06-7227217eae36 req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] Attempting to bind port 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 on network 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:17:04.178996 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-014c79c4-022b-4ece-8e06-7227217eae36 req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] Port 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 on network 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77398 {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Feb 08 18:17:04.179318 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-014c79c4-022b-4ece-8e06-7227217eae36 req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] Attempting to bind port 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 on network 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:17:04.184495 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-014c79c4-022b-4ece-8e06-7227217eae36 req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] Checking agent: {'id': '045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77398', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'started_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 16, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:17:04.184758 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-014c79c4-022b-4ece-8e06-7227217eae36 req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] Checking segment: {'id': 'fc5ec9ee-df90-46f3-bddf-aef0221d9066', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1066, 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102560) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:17:04.185136 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-014c79c4-022b-4ece-8e06-7227217eae36 req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] Bound using segment: {'id': 'fc5ec9ee-df90-46f3-bddf-aef0221d9066', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1066, 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74'} {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:17:04.185669 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-014c79c4-022b-4ece-8e06-7227217eae36 req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] Bound port: 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6, host: hv-cinder-77398, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fc5ec9ee-df90-46f3-bddf-aef0221d9066', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1066, 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74'}}] {{(pid=102560) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:17:04.185910 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-014c79c4-022b-4ece-8e06-7227217eae36 req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (8f5b70dd-2b98-47c5-9288-4dabd9ca45e6), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:04.258162 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-014c79c4-022b-4ece-8e06-7227217eae36 req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] For port 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6, host hv-cinder-77398, cleared binding levels {{(pid=102560) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:17:04.261684 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-014c79c4-022b-4ece-8e06-7227217eae36 req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] For port 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6, host hv-cinder-77398, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=8f5b70dd-2b98-47c5-9288-4dabd9ca45e6,segment=NetworkSegment(fc5ec9ee-df90-46f3-bddf-aef0221d9066),segment_id=fc5ec9ee-df90-46f3-bddf-aef0221d9066)] {{(pid=102560) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:17:04.268413 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-014c79c4-022b-4ece-8e06-7227217eae36 req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-64531588'] for port (8f5b70dd-2b98-47c5-9288-4dabd9ca45e6), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:04.302340 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-014c79c4-022b-4ece-8e06-7227217eae36 req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:04.302990 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-014c79c4-022b-4ece-8e06-7227217eae36 req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:04.304457 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-014c79c4-022b-4ece-8e06-7227217eae36 req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] 10.222.0.109 "PUT /v2.0/ports/8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 HTTP/1.1" status: 200 len: 1093 time: 1.0121417 Feb 08 18:17:04.304900 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7b68b868-44af-459b-8cc4-7ec714415497', 'tag': '8f5b70dd-2b98-47c5-9288-4dabd9ca45e6'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:17:04.307178 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eec8d221-2fc6-4c47-95a4-76a4e26dd4bc" -d '{"events": [{"name": "network-changed", "server_uuid": "7b68b868-44af-459b-8cc4-7ec714415497", "tag": "8f5b70dd-2b98-47c5-9288-4dabd9ca45e6"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:17:04.347188 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41683d8f-d872-419c-8a33-b3bfeb60f8bc service neutron] Pushing event updated for resources: {'Port': ['ID=8f5b70dd-2b98-47c5-9288-4dabd9ca45e6,revision_number=3']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:04.353390 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:17:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0e8b86f8-936c-464f-91d2-0786a7b09a94 x-openstack-request-id: req-0e8b86f8-936c-464f-91d2-0786a7b09a94 {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:17:04.353720 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7b68b868-44af-459b-8cc4-7ec714415497", "tag": "8f5b70dd-2b98-47c5-9288-4dabd9ca45e6", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:17:04.353983 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-0e8b86f8-936c-464f-91d2-0786a7b09a94 {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:17:04.354408 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7b68b868-44af-459b-8cc4-7ec714415497', 'tag': '8f5b70dd-2b98-47c5-9288-4dabd9ca45e6', 'status': 'completed', 'code': 200} Feb 08 18:17:04.404069 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-014c79c4-022b-4ece-8e06-7227217eae36 req-5608da61-411d-4db4-a93e-3bdc220a8c18 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:04.405659 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-014c79c4-022b-4ece-8e06-7227217eae36 req-5608da61-411d-4db4-a93e-3bdc220a8c18 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=768f50510c57419e8a49ed0988014174&device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 1127 time: 0.0495026 Feb 08 18:17:04.457127 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-014c79c4-022b-4ece-8e06-7227217eae36 req-b837d9a6-b917-490e-9e18-5e88410bfc96 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 HTTP/1.1" status: 200 len: 217 time: 0.0403645 Feb 08 18:17:04.509904 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-014c79c4-022b-4ece-8e06-7227217eae36 req-5b03235e-8856-4696-a7ab-04a252a8c67c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:04.511570 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-014c79c4-022b-4ece-8e06-7227217eae36 req-5b03235e-8856-4696-a7ab-04a252a8c67c service neutron] 10.222.0.109 "GET /v2.0/subnets?id=7b1e16de-d9af-4f50-86d7-ee22c9e14b1b HTTP/1.1" status: 200 len: 850 time: 0.0466664 Feb 08 18:17:04.572113 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-014c79c4-022b-4ece-8e06-7227217eae36 req-4ae5aca4-33b4-4cfc-9477-90189da1fa70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:04.573623 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-014c79c4-022b-4ece-8e06-7227217eae36 req-4ae5aca4-33b4-4cfc-9477-90189da1fa70 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0464692 Feb 08 18:17:04.670236 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-014c79c4-022b-4ece-8e06-7227217eae36 req-dd96bcbe-8fb1-426d-b8dc-2b315465e407 service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0877213 Feb 08 18:17:04.761753 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-014c79c4-022b-4ece-8e06-7227217eae36 req-42c4b480-9476-480a-b0df-fdfb6af7e5d1 service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0851393 Feb 08 18:17:04.852355 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eec8d221-2fc6-4c47-95a4-76a4e26dd4bc req-ecf6c6a9-06c7-4de0-9939-2de80d34b912 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:04.853833 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-eec8d221-2fc6-4c47-95a4-76a4e26dd4bc req-ecf6c6a9-06c7-4de0-9939-2de80d34b912 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=768f50510c57419e8a49ed0988014174&device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 1127 time: 0.0463266 Feb 08 18:17:04.950099 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eec8d221-2fc6-4c47-95a4-76a4e26dd4bc req-3003ada4-4ec3-45a1-b1bc-5c7fa568f8f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:04.951625 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-eec8d221-2fc6-4c47-95a4-76a4e26dd4bc req-3003ada4-4ec3-45a1-b1bc-5c7fa568f8f4 service neutron] 10.222.0.109 "GET /v2.0/networks?id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 HTTP/1.1" status: 200 len: 913 time: 0.0907218 Feb 08 18:17:04.994939 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-eec8d221-2fc6-4c47-95a4-76a4e26dd4bc req-8bdd81b3-c6bc-4e09-9eac-d3bca45b6f64 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 HTTP/1.1" status: 200 len: 217 time: 0.0341842 Feb 08 18:17:05.046675 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eec8d221-2fc6-4c47-95a4-76a4e26dd4bc req-e2e854fd-dcbf-466b-b2d0-fa48c2cb1fc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:05.048954 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-eec8d221-2fc6-4c47-95a4-76a4e26dd4bc req-e2e854fd-dcbf-466b-b2d0-fa48c2cb1fc3 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=7b1e16de-d9af-4f50-86d7-ee22c9e14b1b HTTP/1.1" status: 200 len: 850 time: 0.0466018 Feb 08 18:17:05.151631 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eec8d221-2fc6-4c47-95a4-76a4e26dd4bc req-b043f3f8-5b14-41e4-8f16-d6c8f24aee9a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:05.153235 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-eec8d221-2fc6-4c47-95a4-76a4e26dd4bc req-b043f3f8-5b14-41e4-8f16-d6c8f24aee9a service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0934482 Feb 08 18:17:05.161683 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7976fec6-5357-428d-986f-e3e4be4499b2 req-89d7f841-f23d-46b2-9c96-583e3a407dfa tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:05.163282 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-7976fec6-5357-428d-986f-e3e4be4499b2 req-89d7f841-f23d-46b2-9c96-583e3a407dfa tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 943 time: 0.0936072 Feb 08 18:17:05.269819 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-7976fec6-5357-428d-986f-e3e4be4499b2 req-a44533a7-0e98-46ad-8bbe-ffa5cc247bc7 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0977461 Feb 08 18:17:05.290626 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-eec8d221-2fc6-4c47-95a4-76a4e26dd4bc req-18bb3508-a152-4b73-8393-dece2f1a985f service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1263943 Feb 08 18:17:05.385291 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-eec8d221-2fc6-4c47-95a4-76a4e26dd4bc req-bcad21be-ebeb-414b-975f-48b5a4caf58e service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0874836 Feb 08 18:17:06.393859 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da87f78e-d95b-4406-add8-f92d28ae968f req-0d4de8f0-890e-49f1-9103-4047be0646a0 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:06.395389 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-da87f78e-d95b-4406-add8-f92d28ae968f req-0d4de8f0-890e-49f1-9103-4047be0646a0 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 943 time: 0.0568290 Feb 08 18:17:06.446089 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-da87f78e-d95b-4406-add8-f92d28ae968f req-f084210a-550e-45e8-a054-7f7d367f62dd tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442052 Feb 08 18:17:07.570400 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c077c212-79e9-47bb-85a0-4430a82b11fb req-bbe76e76-a5e9-4ed1-bb58-d6cda1df1a13 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:07.571874 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c077c212-79e9-47bb-85a0-4430a82b11fb req-bbe76e76-a5e9-4ed1-bb58-d6cda1df1a13 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 943 time: 0.0558250 Feb 08 18:17:07.628281 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c077c212-79e9-47bb-85a0-4430a82b11fb req-6638cb90-17de-4e72-ada4-6b6dbb2af0a9 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0484688 Feb 08 18:17:08.748369 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b206b5c1-258f-4670-a69d-6d0861084277 req-3b220a92-44fe-448c-99b3-d438e8dc9b6f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:08.749846 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b206b5c1-258f-4670-a69d-6d0861084277 req-3b220a92-44fe-448c-99b3-d438e8dc9b6f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 943 time: 0.0540226 Feb 08 18:17:08.808090 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b206b5c1-258f-4670-a69d-6d0861084277 req-9e716281-c97c-448c-849e-2a15f0432032 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0518332 Feb 08 18:17:09.949837 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ea37dcd-989c-47f4-854a-ea1b5ff1b146 req-1ed69527-f188-4810-ab1c-8fb2b8e51b8d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:09.951345 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9ea37dcd-989c-47f4-854a-ea1b5ff1b146 req-1ed69527-f188-4810-ab1c-8fb2b8e51b8d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 943 time: 0.0647905 Feb 08 18:17:10.001865 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9ea37dcd-989c-47f4-854a-ea1b5ff1b146 req-5b01f69e-5d52-4e69-8013-58fa04332655 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446091 Feb 08 18:17:10.604726 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 42050) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:10.710066 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4aab2733-632b-4d61-9939-1be5e07d2c9c admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:10.789133 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4aab2733-632b-4d61-9939-1be5e07d2c9c admin admin] Publish callbacks [] for security_group (3e776d3e-1493-4e76-b4c9-ce509faeed34), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:10.794364 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4aab2733-632b-4d61-9939-1be5e07d2c9c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (3e776d3e-1493-4e76-b4c9-ce509faeed34), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:10.832031 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4aab2733-632b-4d61-9939-1be5e07d2c9c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3e776d3e-1493-4e76-b4c9-ce509faeed34,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:10.839216 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 42056) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:10.846455 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-4aab2733-632b-4d61-9939-1be5e07d2c9c admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=4e47cd5227824808a2bf81dfbe4cbb5a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2394748 Feb 08 18:17:10.887471 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d0940600-785e-465c-a146-d56050405c72 admin admin] Publish callbacks [] for security_group (3e776d3e-1493-4e76-b4c9-ce509faeed34), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:10.908362 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d0940600-785e-465c-a146-d56050405c72 admin admin] Publish callbacks [] for security_group (3e776d3e-1493-4e76-b4c9-ce509faeed34), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:10.955876 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d0940600-785e-465c-a146-d56050405c72 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (3e776d3e-1493-4e76-b4c9-ce509faeed34), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:10.958652 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d0940600-785e-465c-a146-d56050405c72 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:10.959895 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-d0940600-785e-465c-a146-d56050405c72 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/3e776d3e-1493-4e76-b4c9-ce509faeed34 HTTP/1.1" status: 204 len: 168 time: 0.1196353 Feb 08 18:17:10.969852 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0940600-785e-465c-a146-d56050405c72 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3e776d3e-1493-4e76-b4c9-ce509faeed34,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:11.227976 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 42068) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:11.244667 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-17bd4b91-1afd-42c0-a92d-5062b637ac6a admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:11.276945 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e45406d-89f7-4cf2-bc30-82f1f0f521c1 req-3ddb9102-8d78-4f6b-8097-fa8ce6d66647 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:11.278557 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-9e45406d-89f7-4cf2-bc30-82f1f0f521c1 req-3ddb9102-8d78-4f6b-8097-fa8ce6d66647 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 943 time: 0.2091649 Feb 08 18:17:11.320613 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-17bd4b91-1afd-42c0-a92d-5062b637ac6a admin admin] Publish callbacks [] for security_group (b6ae9c1a-3fe3-4aad-8d22-19d234d52acb), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:11.325888 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-17bd4b91-1afd-42c0-a92d-5062b637ac6a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (b6ae9c1a-3fe3-4aad-8d22-19d234d52acb), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:11.328565 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-9e45406d-89f7-4cf2-bc30-82f1f0f521c1 req-6cdc695a-6f62-4de8-bd30-a51565f79784 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436769 Feb 08 18:17:11.363952 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-17bd4b91-1afd-42c0-a92d-5062b637ac6a admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=f7ed9fb4d4ce4a4d8823a293784f1002&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1348202 Feb 08 18:17:11.364769 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17bd4b91-1afd-42c0-a92d-5062b637ac6a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b6ae9c1a-3fe3-4aad-8d22-19d234d52acb,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:11.367223 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 42070) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:11.413690 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-2fe96b0a-18a7-4c9e-8b28-cdb33f1e09eb admin admin] Publish callbacks [] for security_group (b6ae9c1a-3fe3-4aad-8d22-19d234d52acb), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:11.434752 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-2fe96b0a-18a7-4c9e-8b28-cdb33f1e09eb admin admin] Publish callbacks [] for security_group (b6ae9c1a-3fe3-4aad-8d22-19d234d52acb), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:11.483301 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-2fe96b0a-18a7-4c9e-8b28-cdb33f1e09eb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (b6ae9c1a-3fe3-4aad-8d22-19d234d52acb), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:11.485836 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-2fe96b0a-18a7-4c9e-8b28-cdb33f1e09eb admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:11.487019 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-2fe96b0a-18a7-4c9e-8b28-cdb33f1e09eb admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/b6ae9c1a-3fe3-4aad-8d22-19d234d52acb HTTP/1.1" status: 204 len: 168 time: 0.1188631 Feb 08 18:17:11.494644 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fe96b0a-18a7-4c9e-8b28-cdb33f1e09eb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b6ae9c1a-3fe3-4aad-8d22-19d234d52acb,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:12.599065 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 42120) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:12.618757 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f460d94b-0bae-47c8-859e-74c774850b68 req-eb1fa785-acec-4b33-ad9b-23ed44751280 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:12.620327 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f460d94b-0bae-47c8-859e-74c774850b68 req-eb1fa785-acec-4b33-ad9b-23ed44751280 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 943 time: 0.2199683 Feb 08 18:17:12.669186 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f460d94b-0bae-47c8-859e-74c774850b68 req-bb21b626-714f-4962-9808-d2b713f6cb71 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432923 Feb 08 18:17:12.705580 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-acd2c57c-3afc-4fe5-8647-e9767cdfa263 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:12.789190 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-acd2c57c-3afc-4fe5-8647-e9767cdfa263 admin admin] Publish callbacks [] for security_group (863ddaf6-ff93-476b-afca-2590d3b8439c), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:12.794057 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-acd2c57c-3afc-4fe5-8647-e9767cdfa263 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (863ddaf6-ff93-476b-afca-2590d3b8439c), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:12.831389 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-acd2c57c-3afc-4fe5-8647-e9767cdfa263 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=863261ffc4e04666b1b873667623233b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2311869 Feb 08 18:17:12.832229 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acd2c57c-3afc-4fe5-8647-e9767cdfa263 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=863ddaf6-ff93-476b-afca-2590d3b8439c,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:12.834365 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 42124) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:12.882263 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a5adee26-76c4-426c-a958-fb656818a5e7 admin admin] Publish callbacks [] for security_group (863ddaf6-ff93-476b-afca-2590d3b8439c), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:12.902397 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a5adee26-76c4-426c-a958-fb656818a5e7 admin admin] Publish callbacks [] for security_group (863ddaf6-ff93-476b-afca-2590d3b8439c), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:12.949791 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a5adee26-76c4-426c-a958-fb656818a5e7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (863ddaf6-ff93-476b-afca-2590d3b8439c), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:12.952329 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a5adee26-76c4-426c-a958-fb656818a5e7 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:12.953456 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-a5adee26-76c4-426c-a958-fb656818a5e7 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/863ddaf6-ff93-476b-afca-2590d3b8439c HTTP/1.1" status: 204 len: 168 time: 0.1180346 Feb 08 18:17:12.961381 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5adee26-76c4-426c-a958-fb656818a5e7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=863ddaf6-ff93-476b-afca-2590d3b8439c,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:13.731675 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 42154) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:13.789726 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0206c3e7-83b2-41f3-ae42-04ba2e51b0e2 req-66077339-0059-405c-97ec-fb2f191fdede tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:13.791230 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0206c3e7-83b2-41f3-ae42-04ba2e51b0e2 req-66077339-0059-405c-97ec-fb2f191fdede tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 943 time: 0.0524070 Feb 08 18:17:13.829854 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-f2129e9d-9b60-494e-8c55-78ef5091a93f admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1763644147-network', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:17:13.840476 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0206c3e7-83b2-41f3-ae42-04ba2e51b0e2 req-d49a0899-483c-4629-8af1-d43db655e1a7 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431719 Feb 08 18:17:13.848747 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f2129e9d-9b60-494e-8c55-78ef5091a93f admin admin] Made reservation on behalf of c504038b02a545d8a8b1873a4dfee655 for: {'network': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:17:13.852097 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f2129e9d-9b60-494e-8c55-78ef5091a93f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for network (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:13.860034 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f2129e9d-9b60-494e-8c55-78ef5091a93f admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:13.930516 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f2129e9d-9b60-494e-8c55-78ef5091a93f admin admin] Publish callbacks [] for security_group (d2fbba51-d721-41f8-8b10-cad418a2f1e9), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:13.935056 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f2129e9d-9b60-494e-8c55-78ef5091a93f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (d2fbba51-d721-41f8-8b10-cad418a2f1e9), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:13.962496 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f2129e9d-9b60-494e-8c55-78ef5091a93f admin admin] vlan segment allocate from pool success with {'vlan_id': 1065, 'physical_network': 'physnet1'} {{(pid=102559) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Feb 08 18:17:13.972358 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2129e9d-9b60-494e-8c55-78ef5091a93f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d2fbba51-d721-41f8-8b10-cad418a2f1e9,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:13.977359 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f2129e9d-9b60-494e-8c55-78ef5091a93f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (2daf4609-3228-47d5-8b2b-536e57ae3977), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:13.977702 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.db.segments_db [None req-f2129e9d-9b60-494e-8c55-78ef5091a93f admin admin] Added segment 2daf4609-3228-47d5-8b2b-536e57ae3977 of type vlan for network ad3e14dd-35bd-4c6d-8d94-5b851458e927 Feb 08 18:17:14.016481 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f2129e9d-9b60-494e-8c55-78ef5091a93f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8770558521384'] for network (ad3e14dd-35bd-4c6d-8d94-5b851458e927), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:14.041607 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f2129e9d-9b60-494e-8c55-78ef5091a93f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for network (ad3e14dd-35bd-4c6d-8d94-5b851458e927), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:14.042647 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f2129e9d-9b60-494e-8c55-78ef5091a93f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:14.044036 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f2129e9d-9b60-494e-8c55-78ef5091a93f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:14.098250 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-f2129e9d-9b60-494e-8c55-78ef5091a93f admin admin] 10.222.0.118 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.3654428 Feb 08 18:17:14.101289 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 42166) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:14.106050 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2129e9d-9b60-494e-8c55-78ef5091a93f admin admin] Pushing event updated for resources: {'Network': ['ID=ad3e14dd-35bd-4c6d-8d94-5b851458e927,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:14.106562 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-ee878e9c-f2af-4fb3-9684-b84bf290e1a6 admin admin] Request body: {'subnet': {'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1763644147-subnet', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'ip_version': 4}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:17:14.117184 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Network ad3e14dd-35bd-4c6d-8d94-5b851458e927 details requested by agent ovs-agent-dv-cinder-773985-21-iscsi with host dv-cinder-773985-21-iscsi {{(pid=102561) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Feb 08 18:17:14.127941 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ee878e9c-f2af-4fb3-9684-b84bf290e1a6 admin admin] Made reservation on behalf of c504038b02a545d8a8b1873a4dfee655 for: {'subnet': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:17:14.130454 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ee878e9c-f2af-4fb3-9684-b84bf290e1a6 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-64597491'] for subnet (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:14.315334 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ee878e9c-f2af-4fb3-9684-b84bf290e1a6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-64531473', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-64597453'] for subnet (58f829ef-859d-415d-b810-791456a616fc), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:14.405751 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee878e9c-f2af-4fb3-9684-b84bf290e1a6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=58f829ef-859d-415d-b810-791456a616fc,revision_number=0']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:14.417114 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ee878e9c-f2af-4fb3-9684-b84bf290e1a6 admin admin] Checking segment: {'id': '2daf4609-3228-47d5-8b2b-536e57ae3977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102560) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:17:14.417466 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee878e9c-f2af-4fb3-9684-b84bf290e1a6 admin admin] Network hostable DHCP agents. Network: ad3e14dd-35bd-4c6d-8d94-5b851458e927, hostable agents: ['006b5388-ac7d-4794-a124-14bb8e5d8fec'], hosted agents: [] {{(pid=102560) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Feb 08 18:17:14.429807 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3022c203-4a70-4bd9-afcb-2326bdf884e9 req-8ec4cbe7-73a1-4f3b-9129-214c720423b2 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:14.431302 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-3022c203-4a70-4bd9-afcb-2326bdf884e9 req-8ec4cbe7-73a1-4f3b-9129-214c720423b2 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0901177 Feb 08 18:17:14.460481 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ee878e9c-f2af-4fb3-9684-b84bf290e1a6 admin admin] Network ad3e14dd-35bd-4c6d-8d94-5b851458e927 is scheduled to be hosted by DHCP agent 006b5388-ac7d-4794-a124-14bb8e5d8fec with binding_index 1 {{(pid=102560) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Feb 08 18:17:14.483679 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-ee878e9c-f2af-4fb3-9684-b84bf290e1a6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773985-21-iscsi, ad3e14dd-35bd-4c6d-8d94-5b851458e927) {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:17:14.488278 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee878e9c-f2af-4fb3-9684-b84bf290e1a6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:14.488862 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ee878e9c-f2af-4fb3-9684-b84bf290e1a6 admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:14.497372 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7d3d9123-7bba-4e70-91b3-62c95cdafb3b None None] Network ad3e14dd-35bd-4c6d-8d94-5b851458e927 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:17:14.502153 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-3022c203-4a70-4bd9-afcb-2326bdf884e9 req-52066022-369c-4e04-a850-69152061a26b tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0650525 Feb 08 18:17:14.513969 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-ee878e9c-f2af-4fb3-9684-b84bf290e1a6 admin admin] 10.222.0.118 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.4113383 Feb 08 18:17:14.516777 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 42180) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:14.521067 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-efa0b121-b369-4a33-9ae4-92548840eaf2 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1763644147-router', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:17:14.547203 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-efa0b121-b369-4a33-9ae4-92548840eaf2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-557369', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6968'] for router (ca0e41d8-de98-4af8-80f4-29c2c72d8f6c), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:14.548581 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-efa0b121-b369-4a33-9ae4-92548840eaf2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-557389', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-560615', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-578936', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6961'] for router (ca0e41d8-de98-4af8-80f4-29c2c72d8f6c), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:14.604734 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-efa0b121-b369-4a33-9ae4-92548840eaf2 admin admin] Publish callbacks [] for router_controller (ca0e41d8-de98-4af8-80f4-29c2c72d8f6c), precommit_add_association {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:14.606947 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp7dd4f88d-be07-54f7-888b-e9d2dcd2237c-ad3e14dd-35bd-4c6d-8d94-5b851458e927', 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927', 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'fixed_ips': [{'subnet_id': '58f829ef-859d-415d-b810-791456a616fc'}]}} from dv-cinder-773985-21-iscsi. {{(pid=102561) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Feb 08 18:17:14.607869 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:14.743419 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-efa0b121-b369-4a33-9ae4-92548840eaf2 admin admin] Publish callbacks [] for router_gateway (ca0e41d8-de98-4af8-80f4-29c2c72d8f6c), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:14.745521 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.db_base_plugin_common [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Allocated IP 172.20.0.2 (ad3e14dd-35bd-4c6d-8d94-5b851458e927/58f829ef-859d-415d-b810-791456a616fc/0e006909-da82-4ae1-b4b6-dd81c746ef8f) {{(pid=102561) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:17:14.907264 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Publish callbacks [] for port (0e006909-da82-4ae1-b4b6-dd81c746ef8f), precommit_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:14.915389 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (0e006909-da82-4ae1-b4b6-dd81c746ef8f), after_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:14.949964 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-efa0b121-b369-4a33-9ae4-92548840eaf2 admin admin] Publish callbacks [] for router_gateway (ca0e41d8-de98-4af8-80f4-29c2c72d8f6c), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:14.957791 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Network ad3e14dd-35bd-4c6d-8d94-5b851458e927 is already hosted by enough agents. {{(pid=102561) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:17:14.963309 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.scheduler.base_scheduler [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Resources bound (agent type, host, resource id): {{(pid=102561) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:17:14.965734 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Pushing event updated for resources: {'Port': ['ID=0e006909-da82-4ae1-b4b6-dd81c746ef8f,revision_number=1']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:14.968108 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Received port after_create {{(pid=102561) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:17:14.972285 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-efa0b121-b369-4a33-9ae4-92548840eaf2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:14.972910 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0fe6d76-6c20-4a7f-a3e7-d333aa011d0e req-cf412633-06d2-47e6-8a4c-fe142ca19c8c tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:14.974674 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f0fe6d76-6c20-4a7f-a3e7-d333aa011d0e req-cf412633-06d2-47e6-8a4c-fe142ca19c8c tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 943 time: 0.0569546 Feb 08 18:17:14.979092 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:14.979465 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:14.979812 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:14.980147 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:14.980476 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:14.980783 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:14.981110 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:14.981436 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:14.981754 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:14.982074 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:14.982392 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:14.982705 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:14.983054 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:15.038970 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f0fe6d76-6c20-4a7f-a3e7-d333aa011d0e req-6f7a3d8a-191f-4a92-aa69-815610894bd2 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0549886 Feb 08 18:17:15.043818 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Attempting to bind port 0e006909-da82-4ae1-b4b6-dd81c746ef8f on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:17:15.044203 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Attempting to bind port 0e006909-da82-4ae1-b4b6-dd81c746ef8f by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': '2daf4609-3228-47d5-8b2b-536e57ae3977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927'}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:17:15.044581 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Attempting to bind port 0e006909-da82-4ae1-b4b6-dd81c746ef8f on network ad3e14dd-35bd-4c6d-8d94-5b851458e927 {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:17:15.050325 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 16, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:17:15.050816 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Checking segment: {'id': '2daf4609-3228-47d5-8b2b-536e57ae3977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102561) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:17:15.051255 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:15.051681 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Bound using segment: {'id': '2daf4609-3228-47d5-8b2b-536e57ae3977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927'} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:17:15.052110 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Bound port: 0e006909-da82-4ae1-b4b6-dd81c746ef8f, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2daf4609-3228-47d5-8b2b-536e57ae3977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927'}}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:17:15.052485 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (0e006909-da82-4ae1-b4b6-dd81c746ef8f), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:15.093982 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_common [None req-efa0b121-b369-4a33-9ae4-92548840eaf2 admin admin] Allocated IP 172.27.1.121 (77055816-7c88-403d-8f8a-9be2c1faa10d/18547c52-7b23-42cd-bb53-214663ed102b/b23f7769-8791-432a-ad36-c1022d3e09a4) {{(pid=102560) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:17:15.114321 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] For port 0e006909-da82-4ae1-b4b6-dd81c746ef8f, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102561) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:17:15.117615 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] For port 0e006909-da82-4ae1-b4b6-dd81c746ef8f, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=0e006909-da82-4ae1-b4b6-dd81c746ef8f,segment=NetworkSegment(2daf4609-3228-47d5-8b2b-536e57ae3977),segment_id=2daf4609-3228-47d5-8b2b-536e57ae3977)] {{(pid=102561) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:17:15.125303 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (0e006909-da82-4ae1-b4b6-dd81c746ef8f), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:15.191794 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6a295bb-940d-41a8-9134-88f71547041e None None] Pushing event updated for resources: {'Port': ['ID=0e006909-da82-4ae1-b4b6-dd81c746ef8f,revision_number=2']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:15.212393 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-efa0b121-b369-4a33-9ae4-92548840eaf2 admin admin] Publish callbacks [] for port (b23f7769-8791-432a-ad36-c1022d3e09a4), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:15.247750 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-efa0b121-b369-4a33-9ae4-92548840eaf2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (b23f7769-8791-432a-ad36-c1022d3e09a4), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:15.289089 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-efa0b121-b369-4a33-9ae4-92548840eaf2 admin admin] Network 77055816-7c88-403d-8f8a-9be2c1faa10d is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:17:15.292034 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-efa0b121-b369-4a33-9ae4-92548840eaf2 admin admin] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:17:15.296286 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [None req-efa0b121-b369-4a33-9ae4-92548840eaf2 admin admin] Received port after_create {{(pid=102560) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:17:15.299879 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-efa0b121-b369-4a33-9ae4-92548840eaf2 admin admin] Pushing event updated for resources: {'Port': ['ID=b23f7769-8791-432a-ad36-c1022d3e09a4,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:15.387569 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-6e6b14ff-8778-44ce-8e4f-feb5e20b9b93 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:15.585246 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-efa0b121-b369-4a33-9ae4-92548840eaf2 admin admin] Publish callbacks [] for router_gateway (ca0e41d8-de98-4af8-80f4-29c2c72d8f6c), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:15.624300 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 42194) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:15.709859 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1b9b02a-fde8-4da9-848f-b1c9bc3db605 req-4bd88e10-f484-4d67-8ee5-9a6c8aba11c4 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:15.711261 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e1b9b02a-fde8-4da9-848f-b1c9bc3db605 req-4bd88e10-f484-4d67-8ee5-9a6c8aba11c4 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.1225190 Feb 08 18:17:15.755724 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5059b96f-fb5a-4858-9d12-405374a34712 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:15.774583 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 0e006909-da82-4ae1-b4b6-dd81c746ef8f up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:17:15.837298 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 0e006909-da82-4ae1-b4b6-dd81c746ef8f triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:15.838993 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (0e006909-da82-4ae1-b4b6-dd81c746ef8f), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:15.840742 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5059b96f-fb5a-4858-9d12-405374a34712 admin admin] Publish callbacks [] for security_group (9a222a09-66d7-4fe1-897b-41cf678674d2), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:15.844231 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e1b9b02a-fde8-4da9-848f-b1c9bc3db605 req-698f4814-08ac-494e-95fc-f7ccaeac9248 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1258638 Feb 08 18:17:15.857505 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5059b96f-fb5a-4858-9d12-405374a34712 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (9a222a09-66d7-4fe1-897b-41cf678674d2), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:15.869194 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-efa0b121-b369-4a33-9ae4-92548840eaf2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-557494', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-560688'] for router (ca0e41d8-de98-4af8-80f4-29c2c72d8f6c), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:15.908694 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-5059b96f-fb5a-4858-9d12-405374a34712 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=caace0b2dc1843db8dd1b3ffd2a95ec6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2832427 Feb 08 18:17:15.910048 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 42198) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:15.910889 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5059b96f-fb5a-4858-9d12-405374a34712 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a222a09-66d7-4fe1-897b-41cf678674d2,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:15.943299 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 0e006909-da82-4ae1-b4b6-dd81c746ef8f is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:15.944350 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (0e006909-da82-4ae1-b4b6-dd81c746ef8f), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:15.982866 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d877e006-c4b5-48a1-aced-23d3e4bc143d admin admin] Publish callbacks [] for security_group (9a222a09-66d7-4fe1-897b-41cf678674d2), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:15.990747 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] For port 0e006909-da82-4ae1-b4b6-dd81c746ef8f, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=0e006909-da82-4ae1-b4b6-dd81c746ef8f,segment=NetworkSegment(2daf4609-3228-47d5-8b2b-536e57ae3977),segment_id=2daf4609-3228-47d5-8b2b-536e57ae3977)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:17:16.004007 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (0e006909-da82-4ae1-b4b6-dd81c746ef8f), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:16.019041 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d877e006-c4b5-48a1-aced-23d3e4bc143d admin admin] Publish callbacks [] for security_group (9a222a09-66d7-4fe1-897b-41cf678674d2), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:16.027023 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-efa0b121-b369-4a33-9ae4-92548840eaf2 admin admin] Router ca0e41d8-de98-4af8-80f4-29c2c72d8f6c is scheduled to L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 with binding_index 1 {{(pid=102560) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Feb 08 18:17:16.081283 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Pushing event updated for resources: {'Port': ['ID=0e006909-da82-4ae1-b4b6-dd81c746ef8f,revision_number=3']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:16.086549 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d877e006-c4b5-48a1-aced-23d3e4bc143d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (9a222a09-66d7-4fe1-897b-41cf678674d2), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:16.089717 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d877e006-c4b5-48a1-aced-23d3e4bc143d admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:16.090951 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-d877e006-c4b5-48a1-aced-23d3e4bc143d admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/9a222a09-66d7-4fe1-897b-41cf678674d2 HTTP/1.1" status: 204 len: 168 time: 0.1768682 Feb 08 18:17:16.100334 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d877e006-c4b5-48a1-aced-23d3e4bc143d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a222a09-66d7-4fe1-897b-41cf678674d2,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:16.190402 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-efa0b121-b369-4a33-9ae4-92548840eaf2 admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:17:16.201062 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] Sync routers for ids ['ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:17:16.209775 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-efa0b121-b369-4a33-9ae4-92548840eaf2 admin admin] Publish callbacks [] for router (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:16.211833 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-efa0b121-b369-4a33-9ae4-92548840eaf2 admin admin] 10.222.0.118 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 1.6941495 Feb 08 18:17:16.214493 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] Routers {'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:17:16.214635 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 42204) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:16.215200 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:16:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:16.218751 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebad865a-8231-4733-b1ca-0cf5c341c02f req-ad2a46d0-e983-466c-b549-d0613ce9b832 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:16.224918 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ebad865a-8231-4733-b1ca-0cf5c341c02f req-ad2a46d0-e983-466c-b549-d0613ce9b832 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 943 time: 0.0834587 Feb 08 18:17:16.288406 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ebad865a-8231-4733-b1ca-0cf5c341c02f req-44749254-c2ec-4b23-b2ef-254c398a8f38 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0586543 Feb 08 18:17:16.291940 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-25e0e719-27cd-4f02-af67-f40a985808ba None None] Network ad3e14dd-35bd-4c6d-8d94-5b851458e927 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:17:16.377427 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-b7751621-59d3-4cda-9908-59fedf81c374 None None] Provisioning complete for port 0e006909-da82-4ae1-b4b6-dd81c746ef8f triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:16.377800 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b7751621-59d3-4cda-9908-59fedf81c374 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (0e006909-da82-4ae1-b4b6-dd81c746ef8f), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:16.441203 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] Set router ca0e41d8-de98-4af8-80f4-29c2c72d8f6c gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:17:16.644711 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-b7751621-59d3-4cda-9908-59fedf81c374 None None] Current status of the port 0e006909-da82-4ae1-b4b6-dd81c746ef8f is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:16.710160 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'name': 'tempest-TestShelveInstance-1763644147-router', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:15Z', 'revision_number': 3, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'gw_port': {'id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:9d:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:15Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:16.742401 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] Checking router: ca0e41d8-de98-4af8-80f4-29c2c72d8f6c for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:17:16.742936 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] Updating router ca0e41d8-de98-4af8-80f4-29c2c72d8f6c port b23f7769-8791-432a-ad36-c1022d3e09a4 binding host dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Feb 08 18:17:16.778755 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (b23f7769-8791-432a-ad36-c1022d3e09a4), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:16.992937 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-32fb8ebc-f14d-45b1-b683-51568a499663 None None] Provisioning complete for port 0e006909-da82-4ae1-b4b6-dd81c746ef8f triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:16.993393 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-32fb8ebc-f14d-45b1-b683-51568a499663 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (0e006909-da82-4ae1-b4b6-dd81c746ef8f), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:17.004051 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-9c6c1dac-716a-4f72-8ff7-cf80ecfd676d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:17.044681 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02e5ec68-ca4d-4281-abca-e71bd6c8d2c4 req-6132a9e4-3d61-48cc-990e-1e82a97e7eef tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:17.046175 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-02e5ec68-ca4d-4281-abca-e71bd6c8d2c4 req-6132a9e4-3d61-48cc-990e-1e82a97e7eef tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0951152 Feb 08 18:17:17.095713 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] Publish callbacks [] for port (b23f7769-8791-432a-ad36-c1022d3e09a4), precommit_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:17.129984 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (b23f7769-8791-432a-ad36-c1022d3e09a4), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:17.160775 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-32fb8ebc-f14d-45b1-b683-51568a499663 None None] Current status of the port 0e006909-da82-4ae1-b4b6-dd81c746ef8f is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:17.185556 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-02e5ec68-ca4d-4281-abca-e71bd6c8d2c4 req-655d8c25-6b51-4edb-9430-4c9dfa363ec6 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1067445 Feb 08 18:17:17.190807 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4384e038-f5d2-4c24-86c0-5e410628e0f8 None None] Pushing event updated for resources: {'Port': ['ID=b23f7769-8791-432a-ad36-c1022d3e09a4,revision_number=2']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:17.194460 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] Attempting to bind port b23f7769-8791-432a-ad36-c1022d3e09a4 on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:17:17.195045 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] Attempting to bind port b23f7769-8791-432a-ad36-c1022d3e09a4 by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:17:17.195422 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] Attempting to bind port b23f7769-8791-432a-ad36-c1022d3e09a4 on network 77055816-7c88-403d-8f8a-9be2c1faa10d {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:17:17.200539 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:17:17.217188 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 16, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:17:17.217843 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] Checking segment: {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102561) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:17:17.218498 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:17.218893 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] Bound using segment: {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:17:17.219844 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] Bound port: b23f7769-8791-432a-ad36-c1022d3e09a4, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:17:17.220070 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (b23f7769-8791-432a-ad36-c1022d3e09a4), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:17.226807 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_common [None req-9c6c1dac-716a-4f72-8ff7-cf80ecfd676d admin admin] Allocated IP 172.20.0.1 (ad3e14dd-35bd-4c6d-8d94-5b851458e927/58f829ef-859d-415d-b810-791456a616fc/fcd6795b-c979-4a72-b6dc-55c74ed312f1) {{(pid=102560) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:17:17.354898 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-9c6c1dac-716a-4f72-8ff7-cf80ecfd676d admin admin] Publish callbacks [] for port (fcd6795b-c979-4a72-b6dc-55c74ed312f1), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:17.395464 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-9c6c1dac-716a-4f72-8ff7-cf80ecfd676d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (fcd6795b-c979-4a72-b6dc-55c74ed312f1), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:17.404534 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.db.resource_extend [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] It took 0.18 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Feb 08 18:17:17.431414 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c6c1dac-716a-4f72-8ff7-cf80ecfd676d admin admin] Network ad3e14dd-35bd-4c6d-8d94-5b851458e927 is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:17:17.435998 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-9c6c1dac-716a-4f72-8ff7-cf80ecfd676d admin admin] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:17:17.439067 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-caf9068a-c4c3-4b24-9740-da7538d0307e req-c5f784b4-6e26-4e66-a953-0e1134cd2a14 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:17.439804 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9c6c1dac-716a-4f72-8ff7-cf80ecfd676d admin admin] Received port after_create {{(pid=102560) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:17:17.449055 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-caf9068a-c4c3-4b24-9740-da7538d0307e req-c5f784b4-6e26-4e66-a953-0e1134cd2a14 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 943 time: 0.0746233 Feb 08 18:17:17.476242 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] For port b23f7769-8791-432a-ad36-c1022d3e09a4, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102561) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:17:17.479589 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c6c1dac-716a-4f72-8ff7-cf80ecfd676d admin admin] Pushing event updated for resources: {'Port': ['ID=fcd6795b-c979-4a72-b6dc-55c74ed312f1,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:17.480798 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] For port b23f7769-8791-432a-ad36-c1022d3e09a4, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=b23f7769-8791-432a-ad36-c1022d3e09a4,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102561) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:17:17.491812 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-9c6c1dac-716a-4f72-8ff7-cf80ecfd676d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-560871'] for router_interface (ca0e41d8-de98-4af8-80f4-29c2c72d8f6c), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:17.494664 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (b23f7769-8791-432a-ad36-c1022d3e09a4), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:17.532383 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-caf9068a-c4c3-4b24-9740-da7538d0307e req-6c934168-8745-4e32-be12-fe016daeb368 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0822005 Feb 08 18:17:17.602994 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=8f5b70dd-2b98-47c5-9288-4dabd9ca45e6,segment=NetworkSegment(fc5ec9ee-df90-46f3-bddf-aef0221d9066),segment_id=fc5ec9ee-df90-46f3-bddf-aef0221d9066)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:17:17.620754 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] Routers {'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:17:17.621406 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:16:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:17.628182 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': '8f5b70dd-2b98-47c5-9288-4dabd9ca45e6', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'port_id': '8f5b70dd-2b98-47c5-9288-4dabd9ca45e6', 'mac_address': 'fa:16:3e:61:f1:63', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1066, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:17:17.650100 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 42236) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:17.651145 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-9c6c1dac-716a-4f72-8ff7-cf80ecfd676d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (fcd6795b-c979-4a72-b6dc-55c74ed312f1), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:17.666413 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4384e038-f5d2-4c24-86c0-5e410628e0f8 None None] Pushing event updated for resources: {'Port': ['ID=b23f7769-8791-432a-ad36-c1022d3e09a4,revision_number=3']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:17.755925 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:17.756844 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (8f5b70dd-2b98-47c5-9288-4dabd9ca45e6), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:17.779129 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 0e006909-da82-4ae1-b4b6-dd81c746ef8f up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:17:17.806703 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-150d56b6-0490-460c-b754-9d458c72fd22 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:17.809173 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:17:17.870159 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-8346e47d-0f17-4d4e-ae8c-d329d5aee29a None None] Provisioning complete for port fcd6795b-c979-4a72-b6dc-55c74ed312f1 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:17.870539 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-8346e47d-0f17-4d4e-ae8c-d329d5aee29a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (fcd6795b-c979-4a72-b6dc-55c74ed312f1), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:17.873329 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=8f5b70dd-2b98-47c5-9288-4dabd9ca45e6,segment=NetworkSegment(fc5ec9ee-df90-46f3-bddf-aef0221d9066),segment_id=fc5ec9ee-df90-46f3-bddf-aef0221d9066)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:17:17.875916 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-9c6c1dac-716a-4f72-8ff7-cf80ecfd676d admin admin] Publish callbacks [] for port (fcd6795b-c979-4a72-b6dc-55c74ed312f1), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:17.881325 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-9c6c1dac-716a-4f72-8ff7-cf80ecfd676d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-64531588'] for port (fcd6795b-c979-4a72-b6dc-55c74ed312f1), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:17.889336 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-150d56b6-0490-460c-b754-9d458c72fd22 admin admin] Publish callbacks [] for security_group (c78d218f-d8f1-4f93-a708-8aa27695ab76), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:17.894529 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-150d56b6-0490-460c-b754-9d458c72fd22 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (c78d218f-d8f1-4f93-a708-8aa27695ab76), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:17.899276 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-aad5a596-2105-474e-a4bf-3a7e8b71c6e3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:17.907812 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (8f5b70dd-2b98-47c5-9288-4dabd9ca45e6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:17.910815 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] Set router ca0e41d8-de98-4af8-80f4-29c2c72d8f6c gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:17:17.936513 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-150d56b6-0490-460c-b754-9d458c72fd22 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c78d218f-d8f1-4f93-a708-8aa27695ab76,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:17.949733 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 42240) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:17.950045 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-150d56b6-0490-460c-b754-9d458c72fd22 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=c2a7b2c4f4374b47b1b2890e67d3ee60&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2985480 Feb 08 18:17:17.958184 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c6c1dac-716a-4f72-8ff7-cf80ecfd676d admin admin] Pushing event updated for resources: {'Port': ['ID=fcd6795b-c979-4a72-b6dc-55c74ed312f1,revision_number=2']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:17.967518 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-9c6c1dac-716a-4f72-8ff7-cf80ecfd676d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-631683', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-559991'] for router_interface (ca0e41d8-de98-4af8-80f4-29c2c72d8f6c), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:18.000865 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-8346e47d-0f17-4d4e-ae8c-d329d5aee29a None None] Port fcd6795b-c979-4a72-b6dc-55c74ed312f1 cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:17:18.047782 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:18.052937 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 0e006909-da82-4ae1-b4b6-dd81c746ef8f triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:18.053335 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (0e006909-da82-4ae1-b4b6-dd81c746ef8f), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:18.054968 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f0d84e8d-1dba-4005-9916-e859809eb167 admin admin] Publish callbacks [] for security_group (c78d218f-d8f1-4f93-a708-8aa27695ab76), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:18.067252 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=8f5b70dd-2b98-47c5-9288-4dabd9ca45e6,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:18.093896 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f0d84e8d-1dba-4005-9916-e859809eb167 admin admin] Publish callbacks [] for security_group (c78d218f-d8f1-4f93-a708-8aa27695ab76), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:18.122785 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c6c1dac-716a-4f72-8ff7-cf80ecfd676d admin admin] Network ad3e14dd-35bd-4c6d-8d94-5b851458e927 is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:17:18.129576 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-9c6c1dac-716a-4f72-8ff7-cf80ecfd676d admin admin] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:17:18.219777 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['8f5b70dd-2b98-47c5-9288-4dabd9ca45e6'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:17:18.241330 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f0d84e8d-1dba-4005-9916-e859809eb167 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (c78d218f-d8f1-4f93-a708-8aa27695ab76), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:18.244258 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f0d84e8d-1dba-4005-9916-e859809eb167 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:18.248267 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-f0d84e8d-1dba-4005-9916-e859809eb167 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/c78d218f-d8f1-4f93-a708-8aa27695ab76 HTTP/1.1" status: 204 len: 168 time: 0.2949097 Feb 08 18:17:18.271475 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 0e006909-da82-4ae1-b4b6-dd81c746ef8f is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:18.290424 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0d84e8d-1dba-4005-9916-e859809eb167 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c78d218f-d8f1-4f93-a708-8aa27695ab76,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:18.335648 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'name': 'tempest-TestShelveInstance-1763644147-router', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:17Z', 'revision_number': 4, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'gw_port': {'id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:9d:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'fcd6795b-c979-4a72-b6dc-55c74ed312f1', 'name': '', 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'mac_address': 'fa:16:3e:3a:92:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': '58f829ef-859d-415d-b810-791456a616fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:17Z', 'updated_at': '2022-02-08T18:17:17Z', 'revision_number': 1, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'subnets': [{'id': '58f829ef-859d-415d-b810-791456a616fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:18.349107 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9c6c1dac-716a-4f72-8ff7-cf80ecfd676d admin admin] Router ca0e41d8-de98-4af8-80f4-29c2c72d8f6c has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:17:18.379443 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b5465b97-bb00-4006-8991-c4d0d10ee059 None None] The sync data for ids ['ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'] in dv-cinder-773985-21-iscsi is: [{'id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'name': 'tempest-TestShelveInstance-1763644147-router', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:17Z', 'revision_number': 4, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'gw_port': {'id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:9d:0b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'fcd6795b-c979-4a72-b6dc-55c74ed312f1', 'name': '', 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'mac_address': 'fa:16:3e:3a:92:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': '58f829ef-859d-415d-b810-791456a616fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:17Z', 'updated_at': '2022-02-08T18:17:17Z', 'revision_number': 1, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'subnets': [{'id': '58f829ef-859d-415d-b810-791456a616fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:17:18.379645 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d61d77e4-36d4-4e82-9ef7-ec92f50554bd req-015bf0c9-56e8-41bd-b0f5-9321e116380f tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:18.381154 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d61d77e4-36d4-4e82-9ef7-ec92f50554bd req-015bf0c9-56e8-41bd-b0f5-9321e116380f tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0947728 Feb 08 18:17:18.511842 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d61d77e4-36d4-4e82-9ef7-ec92f50554bd req-323979d3-6349-41f1-a0c9-025481371cc8 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0960732 Feb 08 18:17:18.535908 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9c6c1dac-716a-4f72-8ff7-cf80ecfd676d admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:17:18.537289 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:18.542511 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-9c6c1dac-716a-4f72-8ff7-cf80ecfd676d admin admin] 10.222.0.118 "PUT /v2.0/routers/ca0e41d8-de98-4af8-80f4-29c2c72d8f6c/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3268113 Feb 08 18:17:18.579354 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-4b208683-f1a0-4890-8591-79b5e133616c None None] Provisioning complete for port fcd6795b-c979-4a72-b6dc-55c74ed312f1 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:18.580012 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-4b208683-f1a0-4890-8591-79b5e133616c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (fcd6795b-c979-4a72-b6dc-55c74ed312f1), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:18.650947 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-4b208683-f1a0-4890-8591-79b5e133616c None None] Port fcd6795b-c979-4a72-b6dc-55c74ed312f1 cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:17:18.707525 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90f02b37-a922-415c-8744-91ab9a4f8c83 req-b6ad78a8-065b-426b-903d-2ac4c070a0f5 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:18.709621 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-90f02b37-a922-415c-8744-91ab9a4f8c83 req-b6ad78a8-065b-426b-903d-2ac4c070a0f5 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 944 time: 0.0634804 Feb 08 18:17:18.799494 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-90f02b37-a922-415c-8744-91ab9a4f8c83 req-3052fd3a-a3a1-4c4a-a55c-1158081fb352 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0779769 Feb 08 18:17:19.204719 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 42262) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:19.209835 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-c5fc9a63-ac6e-4bcd-b55b-c376eacaf2d1 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-467833778-network', 'tenant_id': '0bc4208466064655a0a4f4a9ff97f5fe'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:17:19.213605 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:17:19.230043 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-c5fc9a63-ac6e-4bcd-b55b-c376eacaf2d1 admin admin] Made reservation on behalf of 0bc4208466064655a0a4f4a9ff97f5fe for: {'network': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:17:19.232547 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c5fc9a63-ac6e-4bcd-b55b-c376eacaf2d1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for network (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:19.242155 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c5fc9a63-ac6e-4bcd-b55b-c376eacaf2d1 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:19.265266 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning for port 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 completed by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Feb 08 18:17:19.269457 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:19.269857 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (8f5b70dd-2b98-47c5-9288-4dabd9ca45e6), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:19.331009 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c5fc9a63-ac6e-4bcd-b55b-c376eacaf2d1 admin admin] Publish callbacks [] for security_group (9494e7a5-5595-46d6-a3e8-c6b850394409), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:19.336280 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c5fc9a63-ac6e-4bcd-b55b-c376eacaf2d1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (9494e7a5-5595-46d6-a3e8-c6b850394409), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:19.360461 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:19.361005 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (8f5b70dd-2b98-47c5-9288-4dabd9ca45e6), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:19.362350 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-c5fc9a63-ac6e-4bcd-b55b-c376eacaf2d1 admin admin] vlan segment allocate from pool success with {'vlan_id': 1086, 'physical_network': 'physnet1'} {{(pid=102560) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Feb 08 18:17:19.372913 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5fc9a63-ac6e-4bcd-b55b-c376eacaf2d1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9494e7a5-5595-46d6-a3e8-c6b850394409,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:19.378336 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c5fc9a63-ac6e-4bcd-b55b-c376eacaf2d1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (c2af1e5f-fa31-4573-977c-86e6f81f6ce5), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:19.378693 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.segments_db [None req-c5fc9a63-ac6e-4bcd-b55b-c376eacaf2d1 admin admin] Added segment c2af1e5f-fa31-4573-977c-86e6f81f6ce5 of type vlan for network 104cc343-bac7-4e28-b431-8f5c486a990b Feb 08 18:17:19.386817 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7b68b868-44af-459b-8cc4-7ec714415497', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8f5b70dd-2b98-47c5-9288-4dabd9ca45e6'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:17:19.390022 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d95aa474-6bf7-4ab8-9fa7-a21953f507b3" -d '{"events": [{"server_uuid": "7b68b868-44af-459b-8cc4-7ec714415497", "name": "network-vif-plugged", "status": "completed", "tag": "8f5b70dd-2b98-47c5-9288-4dabd9ca45e6"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:17:19.403763 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=8f5b70dd-2b98-47c5-9288-4dabd9ca45e6,segment=NetworkSegment(fc5ec9ee-df90-46f3-bddf-aef0221d9066),segment_id=fc5ec9ee-df90-46f3-bddf-aef0221d9066)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:17:19.411299 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (8f5b70dd-2b98-47c5-9288-4dabd9ca45e6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:19.429366 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c5fc9a63-ac6e-4bcd-b55b-c376eacaf2d1 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8770558521384'] for network (104cc343-bac7-4e28-b431-8f5c486a990b), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:19.456605 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:17:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-252cdd08-936b-43ac-ad41-9ff664cb6d57 x-openstack-request-id: req-252cdd08-936b-43ac-ad41-9ff664cb6d57 {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:17:19.456897 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7b68b868-44af-459b-8cc4-7ec714415497", "name": "network-vif-plugged", "status": "completed", "tag": "8f5b70dd-2b98-47c5-9288-4dabd9ca45e6", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:17:19.457133 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-252cdd08-936b-43ac-ad41-9ff664cb6d57 {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:17:19.457527 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7b68b868-44af-459b-8cc4-7ec714415497', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8f5b70dd-2b98-47c5-9288-4dabd9ca45e6', 'code': 200} Feb 08 18:17:19.460532 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c5fc9a63-ac6e-4bcd-b55b-c376eacaf2d1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for network (104cc343-bac7-4e28-b431-8f5c486a990b), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:19.461884 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c5fc9a63-ac6e-4bcd-b55b-c376eacaf2d1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:19.462760 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c5fc9a63-ac6e-4bcd-b55b-c376eacaf2d1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:19.469757 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=8f5b70dd-2b98-47c5-9288-4dabd9ca45e6,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:19.530253 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-c5fc9a63-ac6e-4bcd-b55b-c376eacaf2d1 admin admin] 10.222.0.118 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.3243840 Feb 08 18:17:19.533034 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 42266) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:19.539633 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-899fd5b3-01b5-48cc-9ff5-fa1daae6bd56 admin admin] Request body: {'subnet': {'network_id': '104cc343-bac7-4e28-b431-8f5c486a990b', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-467833778-subnet', 'tenant_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'ip_version': 4}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:17:19.545946 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5fc9a63-ac6e-4bcd-b55b-c376eacaf2d1 admin admin] Pushing event updated for resources: {'Network': ['ID=104cc343-bac7-4e28-b431-8f5c486a990b,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:19.556462 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Network 104cc343-bac7-4e28-b431-8f5c486a990b details requested by agent ovs-agent-dv-cinder-773985-21-iscsi with host dv-cinder-773985-21-iscsi {{(pid=102561) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Feb 08 18:17:19.572205 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-899fd5b3-01b5-48cc-9ff5-fa1daae6bd56 admin admin] Made reservation on behalf of 0bc4208466064655a0a4f4a9ff97f5fe for: {'subnet': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:17:19.574788 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-899fd5b3-01b5-48cc-9ff5-fa1daae6bd56 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-64597491'] for subnet (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:19.682700 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdf61bd9-d888-4431-844f-063c407aa23f req-b9e2c88e-5363-4efe-96a0-3968ad5a9670 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:19.684714 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-fdf61bd9-d888-4431-844f-063c407aa23f req-b9e2c88e-5363-4efe-96a0-3968ad5a9670 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0648785 Feb 08 18:17:19.760156 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-fdf61bd9-d888-4431-844f-063c407aa23f req-52756b9b-95ef-42fb-957c-7ed4e5a25450 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0657170 Feb 08 18:17:19.785047 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4be2b79f-19f3-44c8-a637-9a35a9245d72 req-95928a57-21c4-48ae-99e5-b117a59ce08f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:19.786816 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4be2b79f-19f3-44c8-a637-9a35a9245d72 req-95928a57-21c4-48ae-99e5-b117a59ce08f service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 1129 time: 0.1205122 Feb 08 18:17:19.789554 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device b23f7769-8791-432a-ad36-c1022d3e09a4 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:17:19.841358 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port b23f7769-8791-432a-ad36-c1022d3e09a4 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:19.841741 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (b23f7769-8791-432a-ad36-c1022d3e09a4), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:19.901360 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4be2b79f-19f3-44c8-a637-9a35a9245d72 req-8cead808-7b29-4ab7-a371-6187a3ef5841 service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1079323 Feb 08 18:17:19.915808 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-899fd5b3-01b5-48cc-9ff5-fa1daae6bd56 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-64531473', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-64597453'] for subnet (a8821dcf-aec5-40f7-bf52-57ca331a164a), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:19.933759 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port b23f7769-8791-432a-ad36-c1022d3e09a4 is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:19.934233 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (b23f7769-8791-432a-ad36-c1022d3e09a4), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:19.956919 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] For port b23f7769-8791-432a-ad36-c1022d3e09a4, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=b23f7769-8791-432a-ad36-c1022d3e09a4,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:17:19.962857 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (b23f7769-8791-432a-ad36-c1022d3e09a4), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:19.989727 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-899fd5b3-01b5-48cc-9ff5-fa1daae6bd56 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a8821dcf-aec5-40f7-bf52-57ca331a164a,revision_number=0']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:20.000550 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8469562d-4494-4736-8af2-6629cf5c0332 req-8fcca40f-8201-489d-b6c9-30916799077b tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:20.002064 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8469562d-4494-4736-8af2-6629cf5c0332 req-8fcca40f-8201-489d-b6c9-30916799077b tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 945 time: 0.1160944 Feb 08 18:17:20.009846 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-899fd5b3-01b5-48cc-9ff5-fa1daae6bd56 admin admin] Checking segment: {'id': 'c2af1e5f-fa31-4573-977c-86e6f81f6ce5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1086, 'network_id': '104cc343-bac7-4e28-b431-8f5c486a990b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102560) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:17:20.010202 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-899fd5b3-01b5-48cc-9ff5-fa1daae6bd56 admin admin] Network hostable DHCP agents. Network: 104cc343-bac7-4e28-b431-8f5c486a990b, hostable agents: ['006b5388-ac7d-4794-a124-14bb8e5d8fec'], hosted agents: [] {{(pid=102560) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Feb 08 18:17:20.011279 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Pushing event updated for resources: {'Port': ['ID=b23f7769-8791-432a-ad36-c1022d3e09a4,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:20.058592 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-899fd5b3-01b5-48cc-9ff5-fa1daae6bd56 admin admin] Network 104cc343-bac7-4e28-b431-8f5c486a990b is scheduled to be hosted by DHCP agent 006b5388-ac7d-4794-a124-14bb8e5d8fec with binding_index 1 {{(pid=102560) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Feb 08 18:17:20.065917 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8469562d-4494-4736-8af2-6629cf5c0332 req-d7588b39-2ca9-4417-a95c-4256573d7f8c tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0574892 Feb 08 18:17:20.072966 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-899fd5b3-01b5-48cc-9ff5-fa1daae6bd56 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773985-21-iscsi, 104cc343-bac7-4e28-b431-8f5c486a990b) {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:17:20.080030 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-899fd5b3-01b5-48cc-9ff5-fa1daae6bd56 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:20.080599 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-899fd5b3-01b5-48cc-9ff5-fa1daae6bd56 admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:20.084125 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-751afdfe-c790-49cf-b45e-59b900b4d3e2 None None] Network 104cc343-bac7-4e28-b431-8f5c486a990b requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:17:20.101499 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-899fd5b3-01b5-48cc-9ff5-fa1daae6bd56 admin admin] 10.222.0.118 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 0.5673771 Feb 08 18:17:20.104232 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 42272) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:20.108707 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-b24e9fbc-c212-4cfb-878f-a00ceea81c6d admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-467833778-router', 'tenant_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:17:20.136127 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-b24e9fbc-c212-4cfb-878f-a00ceea81c6d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-557369', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6968'] for router (dd95d872-66ab-4182-bf88-5307b4f94217), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:20.137487 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-b24e9fbc-c212-4cfb-878f-a00ceea81c6d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-557389', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-560615', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-578936', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6961'] for router (dd95d872-66ab-4182-bf88-5307b4f94217), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:20.195802 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-b24e9fbc-c212-4cfb-878f-a00ceea81c6d admin admin] Publish callbacks [] for router_controller (dd95d872-66ab-4182-bf88-5307b4f94217), precommit_add_association {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:20.280334 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:20.338017 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-64a4aa84-e55b-4534-9230-01172cdaeff2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp7dd4f88d-be07-54f7-888b-e9d2dcd2237c-104cc343-bac7-4e28-b431-8f5c486a990b', 'network_id': '104cc343-bac7-4e28-b431-8f5c486a990b', 'project_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'fixed_ips': [{'subnet_id': 'a8821dcf-aec5-40f7-bf52-57ca331a164a'}]}} from dv-cinder-773985-21-iscsi. {{(pid=102561) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Feb 08 18:17:20.338932 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-64a4aa84-e55b-4534-9230-01172cdaeff2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:20.345699 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-b24e9fbc-c212-4cfb-878f-a00ceea81c6d admin admin] Publish callbacks [] for router_gateway (dd95d872-66ab-4182-bf88-5307b4f94217), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:20.495170 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.db_base_plugin_common [None req-64a4aa84-e55b-4534-9230-01172cdaeff2 None None] Allocated IP 172.20.0.2 (104cc343-bac7-4e28-b431-8f5c486a990b/a8821dcf-aec5-40f7-bf52-57ca331a164a/5fea208c-37b9-4fd9-8f82-1ff18d46f399) {{(pid=102561) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:17:20.536282 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf118772-83d3-488d-963d-7b4538dde9bd req-0e0e053f-4214-49b1-ae4b-0360a30323a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:20.538490 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-bf118772-83d3-488d-963d-7b4538dde9bd req-0e0e053f-4214-49b1-ae4b-0360a30323a2 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=357dab3d3db74ef9a8ee50fdd8a8bdcd&device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 1129 time: 0.0588021 Feb 08 18:17:20.561545 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-b24e9fbc-c212-4cfb-878f-a00ceea81c6d admin admin] Publish callbacks [] for router_gateway (dd95d872-66ab-4182-bf88-5307b4f94217), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:20.584409 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-b24e9fbc-c212-4cfb-878f-a00ceea81c6d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:20.648569 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-64a4aa84-e55b-4534-9230-01172cdaeff2 None None] Publish callbacks [] for port (5fea208c-37b9-4fd9-8f82-1ff18d46f399), precommit_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:20.656373 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-64a4aa84-e55b-4534-9230-01172cdaeff2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (5fea208c-37b9-4fd9-8f82-1ff18d46f399), after_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:20.658854 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf118772-83d3-488d-963d-7b4538dde9bd req-17338f1c-65e3-489f-980a-23b79ebfcfe5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:20.660568 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-bf118772-83d3-488d-963d-7b4538dde9bd req-17338f1c-65e3-489f-980a-23b79ebfcfe5 service neutron] 10.222.0.109 "GET /v2.0/networks?id=7a854399-3ce6-42bd-bfc4-061132ecb9c2 HTTP/1.1" status: 200 len: 918 time: 0.0989027 Feb 08 18:17:20.705297 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-64a4aa84-e55b-4534-9230-01172cdaeff2 None None] Network 104cc343-bac7-4e28-b431-8f5c486a990b is already hosted by enough agents. {{(pid=102561) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:17:20.708487 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.scheduler.base_scheduler [None req-64a4aa84-e55b-4534-9230-01172cdaeff2 None None] Resources bound (agent type, host, resource id): {{(pid=102561) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:17:20.713240 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-64a4aa84-e55b-4534-9230-01172cdaeff2 None None] Received port after_create {{(pid=102561) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:17:20.716975 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a4aa84-e55b-4534-9230-01172cdaeff2 None None] Pushing event updated for resources: {'Port': ['ID=5fea208c-37b9-4fd9-8f82-1ff18d46f399,revision_number=1']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:20.745320 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] Sync routers for ids ['ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'] in dv-cinder-773985-21-iscsi {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:17:20.759180 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-bf118772-83d3-488d-963d-7b4538dde9bd req-140e494f-e751-458b-ad1c-cf6f608406cf service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=50b2e85d-5914-4f54-9939-14603e53f04e HTTP/1.1" status: 200 len: 1000 time: 0.0826626 Feb 08 18:17:20.763422 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] Routers {'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:17:20.764151 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:17:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:20.781804 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-64a4aa84-e55b-4534-9230-01172cdaeff2 None None] Attempting to bind port 5fea208c-37b9-4fd9-8f82-1ff18d46f399 on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:17:20.782178 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-64a4aa84-e55b-4534-9230-01172cdaeff2 None None] Attempting to bind port 5fea208c-37b9-4fd9-8f82-1ff18d46f399 by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': 'c2af1e5f-fa31-4573-977c-86e6f81f6ce5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1086, 'network_id': '104cc343-bac7-4e28-b431-8f5c486a990b'}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:17:20.782534 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64a4aa84-e55b-4534-9230-01172cdaeff2 None None] Attempting to bind port 5fea208c-37b9-4fd9-8f82-1ff18d46f399 on network 104cc343-bac7-4e28-b431-8f5c486a990b {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:17:20.791760 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64a4aa84-e55b-4534-9230-01172cdaeff2 None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 16, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:17:20.792134 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64a4aa84-e55b-4534-9230-01172cdaeff2 None None] Checking segment: {'id': 'c2af1e5f-fa31-4573-977c-86e6f81f6ce5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1086, 'network_id': '104cc343-bac7-4e28-b431-8f5c486a990b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102561) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:17:20.792535 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-64a4aa84-e55b-4534-9230-01172cdaeff2 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:20.792920 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-64a4aa84-e55b-4534-9230-01172cdaeff2 None None] Bound using segment: {'id': 'c2af1e5f-fa31-4573-977c-86e6f81f6ce5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1086, 'network_id': '104cc343-bac7-4e28-b431-8f5c486a990b'} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:17:20.793380 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-64a4aa84-e55b-4534-9230-01172cdaeff2 None None] Bound port: 5fea208c-37b9-4fd9-8f82-1ff18d46f399, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c2af1e5f-fa31-4573-977c-86e6f81f6ce5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1086, 'network_id': '104cc343-bac7-4e28-b431-8f5c486a990b'}}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:17:20.793760 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-64a4aa84-e55b-4534-9230-01172cdaeff2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (5fea208c-37b9-4fd9-8f82-1ff18d46f399), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:20.843066 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf118772-83d3-488d-963d-7b4538dde9bd req-76fe8340-f8e8-4e45-8643-f4ede2af02e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:20.844529 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-bf118772-83d3-488d-963d-7b4538dde9bd req-76fe8340-f8e8-4e45-8643-f4ede2af02e0 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=73de7865-d87d-4a2a-a702-160c400f145f HTTP/1.1" status: 200 len: 855 time: 0.0691042 Feb 08 18:17:20.873314 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-64a4aa84-e55b-4534-9230-01172cdaeff2 None None] For port 5fea208c-37b9-4fd9-8f82-1ff18d46f399, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102561) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:17:20.876648 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-64a4aa84-e55b-4534-9230-01172cdaeff2 None None] For port 5fea208c-37b9-4fd9-8f82-1ff18d46f399, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=5fea208c-37b9-4fd9-8f82-1ff18d46f399,segment=NetworkSegment(c2af1e5f-fa31-4573-977c-86e6f81f6ce5),segment_id=c2af1e5f-fa31-4573-977c-86e6f81f6ce5)] {{(pid=102561) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:17:20.901233 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-64a4aa84-e55b-4534-9230-01172cdaeff2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (5fea208c-37b9-4fd9-8f82-1ff18d46f399), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:20.923257 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf118772-83d3-488d-963d-7b4538dde9bd req-947ce617-03b9-4a64-a923-a9d2deaafd7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:20.924787 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-bf118772-83d3-488d-963d-7b4538dde9bd req-947ce617-03b9-4a64-a923-a9d2deaafd7b service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=7a854399-3ce6-42bd-bfc4-061132ecb9c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0691576 Feb 08 18:17:20.984368 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-64a4aa84-e55b-4534-9230-01172cdaeff2 None None] Pushing event updated for resources: {'Port': ['ID=5fea208c-37b9-4fd9-8f82-1ff18d46f399,revision_number=2']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:20.998436 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-336809cb-5a82-475d-a494-270b639a8401 req-dfe78394-0df0-49f3-86b8-db1fffc8d42e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:21.002311 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-336809cb-5a82-475d-a494-270b639a8401 req-dfe78394-0df0-49f3-86b8-db1fffc8d42e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.1205134 Feb 08 18:17:21.021015 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] Set router ca0e41d8-de98-4af8-80f4-29c2c72d8f6c gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:17:21.026482 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [None req-b24e9fbc-c212-4cfb-878f-a00ceea81c6d admin admin] Allocated IP 172.27.1.189 (77055816-7c88-403d-8f8a-9be2c1faa10d/18547c52-7b23-42cd-bb53-214663ed102b/00808ea1-d214-41c7-a14f-da57ed86d9c4) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:17:21.090062 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-bf118772-83d3-488d-963d-7b4538dde9bd req-7aa2d2cb-8e08-4d3a-871d-af93365e9772 service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1573379 Feb 08 18:17:21.160036 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-336809cb-5a82-475d-a494-270b639a8401 req-8084bf2e-b59e-4689-aa11-33fcc07d11fe tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1133382 Feb 08 18:17:21.221085 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-b24e9fbc-c212-4cfb-878f-a00ceea81c6d admin admin] Publish callbacks [] for port (00808ea1-d214-41c7-a14f-da57ed86d9c4), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:21.269070 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-b24e9fbc-c212-4cfb-878f-a00ceea81c6d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (00808ea1-d214-41c7-a14f-da57ed86d9c4), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:21.320644 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b24e9fbc-c212-4cfb-878f-a00ceea81c6d admin admin] Network 77055816-7c88-403d-8f8a-9be2c1faa10d is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:17:21.323171 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f594c176-9212-431c-abd6-4eb5186fa7c9 req-266de070-959a-4b04-8b7d-672e9c544a9a tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:21.327193 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f594c176-9212-431c-abd6-4eb5186fa7c9 req-266de070-959a-4b04-8b7d-672e9c544a9a tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 945 time: 0.1314545 Feb 08 18:17:21.327457 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-b24e9fbc-c212-4cfb-878f-a00ceea81c6d admin admin] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:17:21.331777 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b24e9fbc-c212-4cfb-878f-a00ceea81c6d admin admin] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:17:21.333733 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-bf118772-83d3-488d-963d-7b4538dde9bd req-d03563d2-3c66-49f7-b792-73307e46eed6 service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2333734 Feb 08 18:17:21.368810 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'name': 'tempest-TestShelveInstance-1763644147-router', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:17Z', 'revision_number': 4, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'gw_port': {'id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:9d:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'fcd6795b-c979-4a72-b6dc-55c74ed312f1', 'name': '', 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'mac_address': 'fa:16:3e:3a:92:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': '58f829ef-859d-415d-b810-791456a616fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:17Z', 'updated_at': '2022-02-08T18:17:17Z', 'revision_number': 2, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'subnets': [{'id': '58f829ef-859d-415d-b810-791456a616fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:21.389278 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f594c176-9212-431c-abd6-4eb5186fa7c9 req-d6868b70-e3cf-4241-917f-adb4fdcf5ccc tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0545621 Feb 08 18:17:21.398270 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b24e9fbc-c212-4cfb-878f-a00ceea81c6d admin admin] Pushing event updated for resources: {'Port': ['ID=00808ea1-d214-41c7-a14f-da57ed86d9c4,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:21.403373 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] Checking router: ca0e41d8-de98-4af8-80f4-29c2c72d8f6c for host: dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:17:21.406334 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] Updating router ca0e41d8-de98-4af8-80f4-29c2c72d8f6c port fcd6795b-c979-4a72-b6dc-55c74ed312f1 binding host dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Feb 08 18:17:21.438829 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (fcd6795b-c979-4a72-b6dc-55c74ed312f1), before_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:21.621097 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-b24e9fbc-c212-4cfb-878f-a00ceea81c6d admin admin] Publish callbacks [] for router_gateway (dd95d872-66ab-4182-bf88-5307b4f94217), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:21.702044 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:21.709797 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] Publish callbacks [] for port (fcd6795b-c979-4a72-b6dc-55c74ed312f1), precommit_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:21.718223 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (fcd6795b-c979-4a72-b6dc-55c74ed312f1), after_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:21.841714 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24ac67d0-39d2-4f9f-b3ba-714b4369442f None None] Pushing event updated for resources: {'Port': ['ID=fcd6795b-c979-4a72-b6dc-55c74ed312f1,revision_number=3']} {{(pid=102562) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:21.858389 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24ac67d0-39d2-4f9f-b3ba-714b4369442f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:21.859038 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24ac67d0-39d2-4f9f-b3ba-714b4369442f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:21.859554 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24ac67d0-39d2-4f9f-b3ba-714b4369442f None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:21.859931 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24ac67d0-39d2-4f9f-b3ba-714b4369442f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:21.860243 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24ac67d0-39d2-4f9f-b3ba-714b4369442f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:21.860740 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24ac67d0-39d2-4f9f-b3ba-714b4369442f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:21.861084 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24ac67d0-39d2-4f9f-b3ba-714b4369442f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:21.861411 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24ac67d0-39d2-4f9f-b3ba-714b4369442f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:21.861732 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24ac67d0-39d2-4f9f-b3ba-714b4369442f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:21.862224 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24ac67d0-39d2-4f9f-b3ba-714b4369442f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:21.862547 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24ac67d0-39d2-4f9f-b3ba-714b4369442f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:21.862955 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24ac67d0-39d2-4f9f-b3ba-714b4369442f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:21.863275 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-24ac67d0-39d2-4f9f-b3ba-714b4369442f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:21.896258 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 5fea208c-37b9-4fd9-8f82-1ff18d46f399 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:17:21.912993 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-b24e9fbc-c212-4cfb-878f-a00ceea81c6d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-557494', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-560688'] for router (dd95d872-66ab-4182-bf88-5307b4f94217), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:21.923023 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] Attempting to bind port fcd6795b-c979-4a72-b6dc-55c74ed312f1 on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:17:21.923396 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] Attempting to bind port fcd6795b-c979-4a72-b6dc-55c74ed312f1 by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': '2daf4609-3228-47d5-8b2b-536e57ae3977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927'}] {{(pid=102562) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:17:21.923755 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] Attempting to bind port fcd6795b-c979-4a72-b6dc-55c74ed312f1 on network ad3e14dd-35bd-4c6d-8d94-5b851458e927 {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:17:21.934672 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 17, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:17:21.935072 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] Checking segment: {'id': '2daf4609-3228-47d5-8b2b-536e57ae3977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102562) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:17:21.935745 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:21.936286 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] Bound using segment: {'id': '2daf4609-3228-47d5-8b2b-536e57ae3977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927'} {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:17:21.936921 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] Bound port: fcd6795b-c979-4a72-b6dc-55c74ed312f1, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '2daf4609-3228-47d5-8b2b-536e57ae3977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927'}}] {{(pid=102562) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:17:21.937577 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (fcd6795b-c979-4a72-b6dc-55c74ed312f1), before_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:21.973507 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 5fea208c-37b9-4fd9-8f82-1ff18d46f399 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:21.973972 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (5fea208c-37b9-4fd9-8f82-1ff18d46f399), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:22.043336 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.db [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] For port fcd6795b-c979-4a72-b6dc-55c74ed312f1, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102562) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:17:22.048659 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.db [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] For port fcd6795b-c979-4a72-b6dc-55c74ed312f1, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=fcd6795b-c979-4a72-b6dc-55c74ed312f1,segment=NetworkSegment(2daf4609-3228-47d5-8b2b-536e57ae3977),segment_id=2daf4609-3228-47d5-8b2b-536e57ae3977)] {{(pid=102562) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:17:22.059039 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (fcd6795b-c979-4a72-b6dc-55c74ed312f1), after_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:22.096276 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 5fea208c-37b9-4fd9-8f82-1ff18d46f399 is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:22.096923 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (5fea208c-37b9-4fd9-8f82-1ff18d46f399), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:22.110893 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b24e9fbc-c212-4cfb-878f-a00ceea81c6d admin admin] Router dd95d872-66ab-4182-bf88-5307b4f94217 is scheduled to L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 with binding_index 1 {{(pid=102559) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Feb 08 18:17:22.137992 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24ac67d0-39d2-4f9f-b3ba-714b4369442f None None] Pushing event updated for resources: {'Port': ['ID=fcd6795b-c979-4a72-b6dc-55c74ed312f1,revision_number=4']} {{(pid=102562) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:22.145747 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] Routers {'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:17:22.146648 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:17:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:22.158416 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-03ee3eab-2524-49db-b4cd-02d92865feeb None None] Provisioning complete for port fcd6795b-c979-4a72-b6dc-55c74ed312f1 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:22.158920 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-03ee3eab-2524-49db-b4cd-02d92865feeb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (fcd6795b-c979-4a72-b6dc-55c74ed312f1), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:22.161805 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] For port 5fea208c-37b9-4fd9-8f82-1ff18d46f399, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=5fea208c-37b9-4fd9-8f82-1ff18d46f399,segment=NetworkSegment(c2af1e5f-fa31-4573-977c-86e6f81f6ce5),segment_id=c2af1e5f-fa31-4573-977c-86e6f81f6ce5)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:17:22.218017 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (5fea208c-37b9-4fd9-8f82-1ff18d46f399), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:22.218847 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device b23f7769-8791-432a-ad36-c1022d3e09a4 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:17:22.272896 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b24e9fbc-c212-4cfb-878f-a00ceea81c6d admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102559) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:17:22.290238 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] Set router ca0e41d8-de98-4af8-80f4-29c2c72d8f6c gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:17:22.315993 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] Sync routers for ids ['dd95d872-66ab-4182-bf88-5307b4f94217'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:17:22.369603 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-b24e9fbc-c212-4cfb-878f-a00ceea81c6d admin admin] Publish callbacks [] for router (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:22.370892 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-b24e9fbc-c212-4cfb-878f-a00ceea81c6d admin admin] 10.222.0.118 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 2.2655380 Feb 08 18:17:22.373660 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 42282) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:22.388375 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] Routers {'dd95d872-66ab-4182-bf88-5307b4f94217'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:17:22.389189 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:17:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['dd95d872-66ab-4182-bf88-5307b4f94217'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:22.393407 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Pushing event updated for resources: {'Port': ['ID=5fea208c-37b9-4fd9-8f82-1ff18d46f399,revision_number=3']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:22.459459 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c17354b-0bb7-4830-8002-ef38c683653c req-11077a71-1e0b-44d9-b02a-92ab15be36dd tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:22.460876 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0c17354b-0bb7-4830-8002-ef38c683653c req-11077a71-1e0b-44d9-b02a-92ab15be36dd tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.1776285 Feb 08 18:17:22.512930 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-189f895a-660d-4ba3-9df7-2e7b61534b44 None None] Network 104cc343-bac7-4e28-b431-8f5c486a990b requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:17:22.528131 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8585f3b-82a5-450a-b2c7-0e4ff3e815d2 req-e1a1c2a8-87e8-47f9-8de0-8be60db637c4 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:22.530119 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a8585f3b-82a5-450a-b2c7-0e4ff3e815d2 req-e1a1c2a8-87e8-47f9-8de0-8be60db637c4 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 945 time: 0.0606918 Feb 08 18:17:22.531436 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0c17354b-0bb7-4830-8002-ef38c683653c req-a4071276-47ed-4d7f-9ecf-fef37bb204f1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0617959 Feb 08 18:17:22.538081 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'name': 'tempest-TestShelveInstance-1763644147-router', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:17Z', 'revision_number': 4, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'gw_port': {'id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:9d:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'fcd6795b-c979-4a72-b6dc-55c74ed312f1', 'name': '', 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'mac_address': 'fa:16:3e:3a:92:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': '58f829ef-859d-415d-b810-791456a616fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:17Z', 'updated_at': '2022-02-08T18:17:22Z', 'revision_number': 4, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'subnets': [{'id': '58f829ef-859d-415d-b810-791456a616fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:22.573479 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4fa44237-7a82-47d5-b6d2-7c14a6c8055d None None] The sync data for ids ['ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'] in dv-cinder-773985-21-iscsi is: [{'id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'name': 'tempest-TestShelveInstance-1763644147-router', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:17Z', 'revision_number': 4, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'gw_port': {'id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:9d:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'fcd6795b-c979-4a72-b6dc-55c74ed312f1', 'name': '', 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'mac_address': 'fa:16:3e:3a:92:a2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': '58f829ef-859d-415d-b810-791456a616fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:17Z', 'updated_at': '2022-02-08T18:17:22Z', 'revision_number': 4, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'subnets': [{'id': '58f829ef-859d-415d-b810-791456a616fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:17:22.609548 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a8585f3b-82a5-450a-b2c7-0e4ff3e815d2 req-487f6f11-f078-4aed-9ff5-501145bf2c02 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0643902 Feb 08 18:17:22.665149 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port b23f7769-8791-432a-ad36-c1022d3e09a4 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:22.665519 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (b23f7769-8791-432a-ad36-c1022d3e09a4), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:22.714150 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-03ee3eab-2524-49db-b4cd-02d92865feeb None None] Current status of the port fcd6795b-c979-4a72-b6dc-55c74ed312f1 is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:22.714987 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-03ee3eab-2524-49db-b4cd-02d92865feeb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (fcd6795b-c979-4a72-b6dc-55c74ed312f1), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:22.721977 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] Set router dd95d872-66ab-4182-bf88-5307b4f94217 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:17:22.810595 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a005a9e-2871-4aa8-905c-556c3d416c61 req-94526ee0-e25d-4847-8f0f-7c57b84ced47 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:22.812968 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5a005a9e-2871-4aa8-905c-556c3d416c61 req-94526ee0-e25d-4847-8f0f-7c57b84ced47 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 945 time: 0.1212723 Feb 08 18:17:22.890109 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-03ee3eab-2524-49db-b4cd-02d92865feeb None None] For port fcd6795b-c979-4a72-b6dc-55c74ed312f1, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=fcd6795b-c979-4a72-b6dc-55c74ed312f1,segment=NetworkSegment(2daf4609-3228-47d5-8b2b-536e57ae3977),segment_id=2daf4609-3228-47d5-8b2b-536e57ae3977)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:17:22.899578 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5a005a9e-2871-4aa8-905c-556c3d416c61 req-838ebad1-44f2-4341-98e1-311658c713e8 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0797281 Feb 08 18:17:22.901477 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-03ee3eab-2524-49db-b4cd-02d92865feeb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (fcd6795b-c979-4a72-b6dc-55c74ed312f1), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:22.926158 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 42288) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:22.981802 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3ac033a6-3b19-4b0c-8d7b-59b4357315a6 tempest-TestVolumeBootPattern-667580451 tempest-TestVolumeBootPattern-667580451-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:22.983400 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-3ac033a6-3b19-4b0c-8d7b-59b4357315a6 tempest-TestVolumeBootPattern-667580451 tempest-TestVolumeBootPattern-667580451-project-admin] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 1124 time: 0.0524013 Feb 08 18:17:22.986233 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 42290) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:22.986668 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-28a03e1e-ffee-4352-8363-f18776de0842 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:22.993804 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Request body: {'floatingip': {'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'port_id': '8f5b70dd-2b98-47c5-9288-4dabd9ca45e6', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'fixed_ip_address': '172.20.0.3'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:17:23.009613 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port b23f7769-8791-432a-ad36-c1022d3e09a4 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:23.060546 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for floatingip (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:23.069536 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03ee3eab-2524-49db-b4cd-02d92865feeb None None] Pushing event updated for resources: {'Port': ['ID=fcd6795b-c979-4a72-b6dc-55c74ed312f1,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:23.097478 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-d890042b-abc6-4a02-88ee-3e3798700a9f None None] Provisioning complete for port fcd6795b-c979-4a72-b6dc-55c74ed312f1 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:23.097844 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-d890042b-abc6-4a02-88ee-3e3798700a9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (fcd6795b-c979-4a72-b6dc-55c74ed312f1), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:23.161789 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd95d872-66ab-4182-bf88-5307b4f94217', 'name': 'tempest-TestShelveInstance-467833778-router', 'tenant_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.189'}], 'enable_snat': True}, 'gw_port_id': '00808ea1-d214-41c7-a14f-da57ed86d9c4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:20Z', 'updated_at': '2022-02-08T18:17:21Z', 'revision_number': 3, 'project_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'gw_port': {'id': '00808ea1-d214-41c7-a14f-da57ed86d9c4', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:27:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd95d872-66ab-4182-bf88-5307b4f94217', 'device_owner': 'network:router_gateway', 'standard_attr_id': 543, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.189', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:20Z', 'updated_at': '2022-02-08T18:17:21Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:23.211323 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:23.212287 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [None req-28a03e1e-ffee-4352-8363-f18776de0842 admin admin] Allocated IP 172.20.0.1 (104cc343-bac7-4e28-b431-8f5c486a990b/a8821dcf-aec5-40f7-bf52-57ca331a164a/f2343e5e-db58-45cd-8f37-ed1e16875a67) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:17:23.253989 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-d890042b-abc6-4a02-88ee-3e3798700a9f None None] Current status of the port fcd6795b-c979-4a72-b6dc-55c74ed312f1 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:23.256651 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] Checking router: dd95d872-66ab-4182-bf88-5307b4f94217 for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:17:23.256980 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] Updating router dd95d872-66ab-4182-bf88-5307b4f94217 port 00808ea1-d214-41c7-a14f-da57ed86d9c4 binding host dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Feb 08 18:17:23.290817 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-d890042b-abc6-4a02-88ee-3e3798700a9f None None] Provisioning complete for port 5fea208c-37b9-4fd9-8f82-1ff18d46f399 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:23.291222 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-d890042b-abc6-4a02-88ee-3e3798700a9f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (5fea208c-37b9-4fd9-8f82-1ff18d46f399), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:23.333411 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (00808ea1-d214-41c7-a14f-da57ed86d9c4), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:23.350097 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-28a03e1e-ffee-4352-8363-f18776de0842 admin admin] Publish callbacks [] for port (f2343e5e-db58-45cd-8f37-ed1e16875a67), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:23.364807 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_common [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Allocated IP 172.27.1.78 (77055816-7c88-403d-8f8a-9be2c1faa10d/18547c52-7b23-42cd-bb53-214663ed102b/177108d5-7af3-47a5-a94a-774e9e7cccb7) {{(pid=102560) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:17:23.407511 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-28a03e1e-ffee-4352-8363-f18776de0842 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (f2343e5e-db58-45cd-8f37-ed1e16875a67), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:23.453103 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28a03e1e-ffee-4352-8363-f18776de0842 admin admin] Network 104cc343-bac7-4e28-b431-8f5c486a990b is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:17:23.456108 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-28a03e1e-ffee-4352-8363-f18776de0842 admin admin] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:17:23.460154 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28a03e1e-ffee-4352-8363-f18776de0842 admin admin] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:17:23.485790 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for port (177108d5-7af3-47a5-a94a-774e9e7cccb7), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:23.496721 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28a03e1e-ffee-4352-8363-f18776de0842 admin admin] Pushing event updated for resources: {'Port': ['ID=f2343e5e-db58-45cd-8f37-ed1e16875a67,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:23.517051 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-28a03e1e-ffee-4352-8363-f18776de0842 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-560871'] for router_interface (dd95d872-66ab-4182-bf88-5307b4f94217), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:23.542550 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (177108d5-7af3-47a5-a94a-774e9e7cccb7), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:23.598010 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Network 77055816-7c88-403d-8f8a-9be2c1faa10d is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:17:23.604736 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:17:23.619804 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Received port after_create {{(pid=102560) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:17:23.632766 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-d890042b-abc6-4a02-88ee-3e3798700a9f None None] Current status of the port 5fea208c-37b9-4fd9-8f82-1ff18d46f399 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:23.681782 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Pushing event updated for resources: {'Port': ['ID=177108d5-7af3-47a5-a94a-774e9e7cccb7,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:23.704045 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:23.704954 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:23.705306 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:23.705639 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:23.705974 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:23.706298 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:23.706627 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:23.707019 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:23.707351 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:23.707660 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:23.707992 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:23.708312 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:23.708628 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:23.775619 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-3df69a9b-d683-48a4-b31b-5d9b1c7f1b4e None None] Provisioning complete for port f2343e5e-db58-45cd-8f37-ed1e16875a67 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:23.776201 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-3df69a9b-d683-48a4-b31b-5d9b1c7f1b4e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (f2343e5e-db58-45cd-8f37-ed1e16875a67), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:23.828439 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 5fea208c-37b9-4fd9-8f82-1ff18d46f399 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:17:23.860632 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-3df69a9b-d683-48a4-b31b-5d9b1c7f1b4e None None] Port f2343e5e-db58-45cd-8f37-ed1e16875a67 cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:17:23.861796 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91c6a66e-632e-4d4d-b5cd-68fa28c25fe3 req-53ac6791-7d2a-41b8-b001-6d5ee4802707 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:23.863502 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-91c6a66e-632e-4d4d-b5cd-68fa28c25fe3 req-53ac6791-7d2a-41b8-b001-6d5ee4802707 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.1966867 Feb 08 18:17:23.914004 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-3df69a9b-d683-48a4-b31b-5d9b1c7f1b4e None None] Provisioning complete for port 5fea208c-37b9-4fd9-8f82-1ff18d46f399 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:23.914400 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-3df69a9b-d683-48a4-b31b-5d9b1c7f1b4e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (5fea208c-37b9-4fd9-8f82-1ff18d46f399), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:23.975249 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-28a03e1e-ffee-4352-8363-f18776de0842 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (f2343e5e-db58-45cd-8f37-ed1e16875a67), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:23.991544 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-91c6a66e-632e-4d4d-b5cd-68fa28c25fe3 req-5d490b9e-80e0-48b9-874d-606db2648a3d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1220570 Feb 08 18:17:24.020444 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 5fea208c-37b9-4fd9-8f82-1ff18d46f399 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:24.020444 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (5fea208c-37b9-4fd9-8f82-1ff18d46f399), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:24.020444 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] Publish callbacks [] for port (00808ea1-d214-41c7-a14f-da57ed86d9c4), precommit_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:24.042465 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (00808ea1-d214-41c7-a14f-da57ed86d9c4), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:24.132295 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abf443ae-1843-4f9f-b137-49361eb64504 None None] Pushing event updated for resources: {'Port': ['ID=00808ea1-d214-41c7-a14f-da57ed86d9c4,revision_number=2']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:24.135702 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-3df69a9b-d683-48a4-b31b-5d9b1c7f1b4e None None] Current status of the port 5fea208c-37b9-4fd9-8f82-1ff18d46f399 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:24.158311 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] Attempting to bind port 00808ea1-d214-41c7-a14f-da57ed86d9c4 on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:17:24.158863 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] Attempting to bind port 00808ea1-d214-41c7-a14f-da57ed86d9c4 by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:17:24.159342 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] Attempting to bind port 00808ea1-d214-41c7-a14f-da57ed86d9c4 on network 77055816-7c88-403d-8f8a-9be2c1faa10d {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:17:24.168366 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 17, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:17:24.168828 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] Checking segment: {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102561) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:17:24.169131 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-28a03e1e-ffee-4352-8363-f18776de0842 admin admin] Publish callbacks [] for port (f2343e5e-db58-45cd-8f37-ed1e16875a67), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:24.169424 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:24.169915 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] Bound using segment: {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:17:24.170500 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] Bound port: 00808ea1-d214-41c7-a14f-da57ed86d9c4, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:17:24.170950 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (00808ea1-d214-41c7-a14f-da57ed86d9c4), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:24.176842 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-28a03e1e-ffee-4352-8363-f18776de0842 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-63856478'] for port (f2343e5e-db58-45cd-8f37-ed1e16875a67), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:24.247585 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28a03e1e-ffee-4352-8363-f18776de0842 admin admin] Pushing event updated for resources: {'Port': ['ID=f2343e5e-db58-45cd-8f37-ed1e16875a67,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:24.251141 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 5fea208c-37b9-4fd9-8f82-1ff18d46f399 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:24.254004 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device fcd6795b-c979-4a72-b6dc-55c74ed312f1 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:17:24.269006 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-28a03e1e-ffee-4352-8363-f18776de0842 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-631683', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-559991'] for router_interface (dd95d872-66ab-4182-bf88-5307b4f94217), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:24.292938 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] For port 00808ea1-d214-41c7-a14f-da57ed86d9c4, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102561) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:17:24.312705 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] For port 00808ea1-d214-41c7-a14f-da57ed86d9c4, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=00808ea1-d214-41c7-a14f-da57ed86d9c4,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102561) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:17:24.322469 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (00808ea1-d214-41c7-a14f-da57ed86d9c4), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:24.366883 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-28a03e1e-ffee-4352-8363-f18776de0842 admin admin] Network 104cc343-bac7-4e28-b431-8f5c486a990b is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:17:24.368352 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-28a03e1e-ffee-4352-8363-f18776de0842 admin admin] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:17:24.389071 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port fcd6795b-c979-4a72-b6dc-55c74ed312f1 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:24.389462 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (fcd6795b-c979-4a72-b6dc-55c74ed312f1), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:24.393725 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] Routers {'dd95d872-66ab-4182-bf88-5307b4f94217'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:17:24.394389 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:17:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['dd95d872-66ab-4182-bf88-5307b4f94217'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:24.450575 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for floatingip (8b5d25a6-20c1-4111-8cd4-527be842c81e), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:24.453875 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abf443ae-1843-4f9f-b137-49361eb64504 None None] Pushing event updated for resources: {'Port': ['ID=00808ea1-d214-41c7-a14f-da57ed86d9c4,revision_number=3']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:24.515408 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-28a03e1e-ffee-4352-8363-f18776de0842 admin admin] Router dd95d872-66ab-4182-bf88-5307b4f94217 has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102559) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:17:24.559329 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (177108d5-7af3-47a5-a94a-774e9e7cccb7), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:24.565756 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] Set router dd95d872-66ab-4182-bf88-5307b4f94217 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:17:24.609642 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port fcd6795b-c979-4a72-b6dc-55c74ed312f1 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:24.653318 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-28a03e1e-ffee-4352-8363-f18776de0842 admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102559) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:17:24.659383 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-28a03e1e-ffee-4352-8363-f18776de0842 admin admin] 10.222.0.118 "PUT /v2.0/routers/dd95d872-66ab-4182-bf88-5307b4f94217/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2847848 Feb 08 18:17:24.720140 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-7e0e92ac-87f6-4b15-845d-efd31fae5216 None None] Provisioning complete for port f2343e5e-db58-45cd-8f37-ed1e16875a67 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:24.720467 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-7e0e92ac-87f6-4b15-845d-efd31fae5216 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (f2343e5e-db58-45cd-8f37-ed1e16875a67), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:24.744639 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for port (177108d5-7af3-47a5-a94a-774e9e7cccb7), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:24.750818 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-64531588'] for port (177108d5-7af3-47a5-a94a-774e9e7cccb7), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:24.775162 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-7e0e92ac-87f6-4b15-845d-efd31fae5216 None None] Port f2343e5e-db58-45cd-8f37-ed1e16875a67 cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:17:24.827414 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd95d872-66ab-4182-bf88-5307b4f94217', 'name': 'tempest-TestShelveInstance-467833778-router', 'tenant_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.189'}], 'enable_snat': True}, 'gw_port_id': '00808ea1-d214-41c7-a14f-da57ed86d9c4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:20Z', 'updated_at': '2022-02-08T18:17:23Z', 'revision_number': 4, 'project_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'gw_port': {'id': '00808ea1-d214-41c7-a14f-da57ed86d9c4', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:27:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd95d872-66ab-4182-bf88-5307b4f94217', 'device_owner': 'network:router_gateway', 'standard_attr_id': 543, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.189', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:20Z', 'updated_at': '2022-02-08T18:17:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'f2343e5e-db58-45cd-8f37-ed1e16875a67', 'name': '', 'network_id': '104cc343-bac7-4e28-b431-8f5c486a990b', 'tenant_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'mac_address': 'fa:16:3e:66:16:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd95d872-66ab-4182-bf88-5307b4f94217', 'device_owner': 'network:router_interface', 'standard_attr_id': 544, 'fixed_ips': [{'subnet_id': 'a8821dcf-aec5-40f7-bf52-57ca331a164a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:23Z', 'updated_at': '2022-02-08T18:17:24Z', 'revision_number': 2, 'project_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'subnets': [{'id': 'a8821dcf-aec5-40f7-bf52-57ca331a164a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:24.828178 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Pushing event updated for resources: {'Port': ['ID=177108d5-7af3-47a5-a94a-774e9e7cccb7,revision_number=2']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:24.838697 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-560746'] for floatingip (8b5d25a6-20c1-4111-8cd4-527be842c81e), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:24.855282 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d471dbbe-6afa-4425-b357-37c84875d79d None None] The sync data for ids ['dd95d872-66ab-4182-bf88-5307b4f94217'] in dv-cinder-773985-21-iscsi is: [{'id': 'dd95d872-66ab-4182-bf88-5307b4f94217', 'name': 'tempest-TestShelveInstance-467833778-router', 'tenant_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.189'}], 'enable_snat': True}, 'gw_port_id': '00808ea1-d214-41c7-a14f-da57ed86d9c4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:20Z', 'updated_at': '2022-02-08T18:17:23Z', 'revision_number': 4, 'project_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'gw_port': {'id': '00808ea1-d214-41c7-a14f-da57ed86d9c4', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:27:46', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd95d872-66ab-4182-bf88-5307b4f94217', 'device_owner': 'network:router_gateway', 'standard_attr_id': 543, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.189', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:20Z', 'updated_at': '2022-02-08T18:17:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'f2343e5e-db58-45cd-8f37-ed1e16875a67', 'name': '', 'network_id': '104cc343-bac7-4e28-b431-8f5c486a990b', 'tenant_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'mac_address': 'fa:16:3e:66:16:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd95d872-66ab-4182-bf88-5307b4f94217', 'device_owner': 'network:router_interface', 'standard_attr_id': 544, 'fixed_ips': [{'subnet_id': 'a8821dcf-aec5-40f7-bf52-57ca331a164a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:23Z', 'updated_at': '2022-02-08T18:17:24Z', 'revision_number': 2, 'project_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'subnets': [{'id': 'a8821dcf-aec5-40f7-bf52-57ca331a164a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:17:24.948610 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.l3_db [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Floating IP 8b5d25a6-20c1-4111-8cd4-527be842c81e associated. External IP: 172.27.1.78, port: 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6. Feb 08 18:17:25.133848 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 42302) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:25.138635 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-11738963-228c-4049-8886-e9656a9901fa tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-299122988', 'description': 'tempest-secgroup-smoke-299122988 description', 'project_id': 'c504038b02a545d8a8b1873a4dfee655'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:17:25.167447 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-11738963-228c-4049-8886-e9656a9901fa tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:25.225880 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3d3f4fc-2c59-4755-91d4-a183a525c025 req-d92bd322-0d88-49dc-a245-83f8034b1232 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:25.227532 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f3d3f4fc-2c59-4755-91d4-a183a525c025 req-d92bd322-0d88-49dc-a245-83f8034b1232 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.1055756 Feb 08 18:17:25.248938 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-11738963-228c-4049-8886-e9656a9901fa tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group (139768cd-8631-410a-b2f1-32ac28ffc91c), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:25.253456 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Router 72b4fd56-6775-4076-9195-fe85693f53aa has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:17:25.255281 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-11738963-228c-4049-8886-e9656a9901fa tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (139768cd-8631-410a-b2f1-32ac28ffc91c), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:25.272869 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-11738963-228c-4049-8886-e9656a9901fa tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:25.277240 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-11738963-228c-4049-8886-e9656a9901fa tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.1393478 Feb 08 18:17:25.278446 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 42304) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:25.282985 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-508cfcbf-54ae-46bf-ab56-175e1d746012 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Request body: {'security_group_rule': {'security_group_id': '139768cd-8631-410a-b2f1-32ac28ffc91c', 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:17:25.299702 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-11738963-228c-4049-8886-e9656a9901fa tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Pushing event updated for resources: {'SecurityGroup': ['ID=139768cd-8631-410a-b2f1-32ac28ffc91c,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:25.307892 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11738963-228c-4049-8886-e9656a9901fa tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:25.308239 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11738963-228c-4049-8886-e9656a9901fa tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:25.308578 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11738963-228c-4049-8886-e9656a9901fa tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:25.308915 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11738963-228c-4049-8886-e9656a9901fa tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:25.309242 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11738963-228c-4049-8886-e9656a9901fa tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:25.309563 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11738963-228c-4049-8886-e9656a9901fa tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:25.309885 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11738963-228c-4049-8886-e9656a9901fa tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:25.310206 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11738963-228c-4049-8886-e9656a9901fa tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:25.310523 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11738963-228c-4049-8886-e9656a9901fa tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:25.310879 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11738963-228c-4049-8886-e9656a9901fa tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:25.311252 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11738963-228c-4049-8886-e9656a9901fa tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:25.311736 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11738963-228c-4049-8886-e9656a9901fa tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:25.312058 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-11738963-228c-4049-8886-e9656a9901fa tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:17:25.362480 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f3d3f4fc-2c59-4755-91d4-a183a525c025 req-6866d6c9-99cc-48f0-8639-594142b767f2 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1264472 Feb 08 18:17:25.393965 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-508cfcbf-54ae-46bf-ab56-175e1d746012 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group_rule (239da495-6d73-48d9-a7e2-47dea91aa458), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:25.432674 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:17:25.444939 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1161aa7-0d5e-43d2-b30e-16bc093ba2c3 None None] Sync routers for ids ['72b4fd56-6775-4076-9195-fe85693f53aa'] in dv-cinder-773985-21-iscsi {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:17:25.456734 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1161aa7-0d5e-43d2-b30e-16bc093ba2c3 None None] Routers {'72b4fd56-6775-4076-9195-fe85693f53aa'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:17:25.457437 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-f1161aa7-0d5e-43d2-b30e-16bc093ba2c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:17:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['72b4fd56-6775-4076-9195-fe85693f53aa'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:25.462724 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for floatingip (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:25.466692 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-508cfcbf-54ae-46bf-ab56-175e1d746012 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group_rule (239da495-6d73-48d9-a7e2-47dea91aa458), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:25.483963 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-508cfcbf-54ae-46bf-ab56-175e1d746012 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (239da495-6d73-48d9-a7e2-47dea91aa458), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:25.512848 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-508cfcbf-54ae-46bf-ab56-175e1d746012 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=239da495-6d73-48d9-a7e2-47dea91aa458,revision_number=0']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:25.522823 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-c150fb67-a5d3-4bc5-be60-ffb489094ed1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.5277781 Feb 08 18:17:25.522823 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7b68b868-44af-459b-8cc4-7ec714415497', 'tag': '8f5b70dd-2b98-47c5-9288-4dabd9ca45e6'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:17:25.522823 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5e28a069-c391-4023-bec7-9897d4d61929" -d '{"events": [{"name": "network-changed", "server_uuid": "7b68b868-44af-459b-8cc4-7ec714415497", "tag": "8f5b70dd-2b98-47c5-9288-4dabd9ca45e6"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:17:25.554336 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-508cfcbf-54ae-46bf-ab56-175e1d746012 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:25.564559 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-508cfcbf-54ae-46bf-ab56-175e1d746012 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.2789996 Feb 08 18:17:25.564559 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 42310) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:25.574621 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-4935ce42-3bfd-49f1-857a-5ebb4b4a468d tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Request body: {'security_group_rule': {'security_group_id': '139768cd-8631-410a-b2f1-32ac28ffc91c', 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:17:25.595286 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:17:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-46cbbd79-89cb-40e1-b97f-23eff23ff042 x-openstack-request-id: req-46cbbd79-89cb-40e1-b97f-23eff23ff042 {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:17:25.595572 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7b68b868-44af-459b-8cc4-7ec714415497", "tag": "8f5b70dd-2b98-47c5-9288-4dabd9ca45e6", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:17:25.595819 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-46cbbd79-89cb-40e1-b97f-23eff23ff042 {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:17:25.596211 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7b68b868-44af-459b-8cc4-7ec714415497', 'tag': '8f5b70dd-2b98-47c5-9288-4dabd9ca45e6', 'status': 'completed', 'code': 200} Feb 08 18:17:25.604195 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-f1161aa7-0d5e-43d2-b30e-16bc093ba2c3 None None] Set router 72b4fd56-6775-4076-9195-fe85693f53aa gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:17:25.612671 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4935ce42-3bfd-49f1-857a-5ebb4b4a468d tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group_rule (270385b3-6267-48c1-af5d-639fa1881a54), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:25.706550 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4935ce42-3bfd-49f1-857a-5ebb4b4a468d tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group_rule (270385b3-6267-48c1-af5d-639fa1881a54), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:25.708969 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e28a069-c391-4023-bec7-9897d4d61929 req-51f4b072-8375-4890-b5d1-812aa258336f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:25.710611 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5e28a069-c391-4023-bec7-9897d4d61929 req-51f4b072-8375-4890-b5d1-812aa258336f service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=768f50510c57419e8a49ed0988014174&device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 1129 time: 0.0855937 Feb 08 18:17:25.712095 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4935ce42-3bfd-49f1-857a-5ebb4b4a468d tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (270385b3-6267-48c1-af5d-639fa1881a54), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:25.776763 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4935ce42-3bfd-49f1-857a-5ebb4b4a468d tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=270385b3-6267-48c1-af5d-639fa1881a54,revision_number=0']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:25.780440 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 00808ea1-d214-41c7-a14f-da57ed86d9c4 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:17:25.798890 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4935ce42-3bfd-49f1-857a-5ebb4b4a468d tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:25.800829 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-4935ce42-3bfd-49f1-857a-5ebb4b4a468d tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2406859 Feb 08 18:17:25.803932 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 42312) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:25.809057 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-2e7832a9-114d-4b9c-b764-ba82f593d4e1 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Request body: {'security_group_rule': {'security_group_id': '139768cd-8631-410a-b2f1-32ac28ffc91c', 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:17:25.861473 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-2e7832a9-114d-4b9c-b764-ba82f593d4e1 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group_rule (ae0ddf43-d1ab-4e7e-918d-2754a4bf8f9f), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:25.864760 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 00808ea1-d214-41c7-a14f-da57ed86d9c4 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:25.865992 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (00808ea1-d214-41c7-a14f-da57ed86d9c4), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:25.880308 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-f1161aa7-0d5e-43d2-b30e-16bc093ba2c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 4, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '8b5d25a6-20c1-4111-8cd4-527be842c81e', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'floating_ip_address': '172.27.1.78', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'port_id': '8f5b70dd-2b98-47c5-9288-4dabd9ca45e6', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 546, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'mac_address': 'fa:16:3e:61:f1:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b68b868-44af-459b-8cc4-7ec714415497', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:17:24Z', 'updated_at': '2022-02-08T18:17:24Z', 'revision_number': 0, 'project_id': '768f50510c57419e8a49ed0988014174', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '13fcfd03-fc49-4bba-8574-ec74e795e2bd', 'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'mac_address': 'fa:16:3e:4b:7b:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:44Z', 'updated_at': '2022-02-08T18:13:51Z', 'revision_number': 5, 'project_id': '768f50510c57419e8a49ed0988014174', 'subnets': [{'id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:25.902974 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e28a069-c391-4023-bec7-9897d4d61929 req-5c146001-a9c6-4f30-a17d-446842b860e4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:25.904815 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5e28a069-c391-4023-bec7-9897d4d61929 req-5c146001-a9c6-4f30-a17d-446842b860e4 service neutron] 10.222.0.109 "GET /v2.0/networks?id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 HTTP/1.1" status: 200 len: 913 time: 0.1818783 Feb 08 18:17:25.915188 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1161aa7-0d5e-43d2-b30e-16bc093ba2c3 None None] Checking router: 72b4fd56-6775-4076-9195-fe85693f53aa for host: dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:17:25.924968 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f1161aa7-0d5e-43d2-b30e-16bc093ba2c3 None None] Routers {'72b4fd56-6775-4076-9195-fe85693f53aa'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:17:25.926230 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-f1161aa7-0d5e-43d2-b30e-16bc093ba2c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:17:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['72b4fd56-6775-4076-9195-fe85693f53aa'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:25.960457 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 00808ea1-d214-41c7-a14f-da57ed86d9c4 is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:25.960846 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (00808ea1-d214-41c7-a14f-da57ed86d9c4), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:25.981903 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-2e7832a9-114d-4b9c-b764-ba82f593d4e1 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group_rule (ae0ddf43-d1ab-4e7e-918d-2754a4bf8f9f), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:25.992341 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] For port 00808ea1-d214-41c7-a14f-da57ed86d9c4, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=00808ea1-d214-41c7-a14f-da57ed86d9c4,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:17:25.994910 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-2e7832a9-114d-4b9c-b764-ba82f593d4e1 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (ae0ddf43-d1ab-4e7e-918d-2754a4bf8f9f), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:25.998565 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (00808ea1-d214-41c7-a14f-da57ed86d9c4), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:26.013020 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5e28a069-c391-4023-bec7-9897d4d61929 req-146a9c62-47bf-43fa-9f5e-24c2df427bbb service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 HTTP/1.1" status: 200 len: 998 time: 0.0990696 Feb 08 18:17:26.026865 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e7832a9-114d-4b9c-b764-ba82f593d4e1 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ae0ddf43-d1ab-4e7e-918d-2754a4bf8f9f,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:26.034517 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-2e7832a9-114d-4b9c-b764-ba82f593d4e1 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:26.035963 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-2e7832a9-114d-4b9c-b764-ba82f593d4e1 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2305825 Feb 08 18:17:26.039127 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 42316) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:26.046592 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-93583d91-ff58-4f5c-ba37-17ed52b1a768 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Request body: {'security_group_rule': {'security_group_id': '139768cd-8631-410a-b2f1-32ac28ffc91c', 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:17:26.071104 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Pushing event updated for resources: {'Port': ['ID=00808ea1-d214-41c7-a14f-da57ed86d9c4,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:26.091263 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-93583d91-ff58-4f5c-ba37-17ed52b1a768 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group_rule (a0f9e329-bf4a-463b-97a7-06fff0bba29d), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:26.097406 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e28a069-c391-4023-bec7-9897d4d61929 req-da3fd98c-0279-4b70-a4f4-95c64e002e29 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:26.099282 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5e28a069-c391-4023-bec7-9897d4d61929 req-da3fd98c-0279-4b70-a4f4-95c64e002e29 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=7b1e16de-d9af-4f50-86d7-ee22c9e14b1b HTTP/1.1" status: 200 len: 850 time: 0.0762947 Feb 08 18:17:26.159521 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e28a069-c391-4023-bec7-9897d4d61929 req-51a846f6-ccec-40a2-9971-8d5d59a358a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:26.161185 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5e28a069-c391-4023-bec7-9897d4d61929 req-51a846f6-ccec-40a2-9971-8d5d59a358a2 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0556402 Feb 08 18:17:26.161698 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-93583d91-ff58-4f5c-ba37-17ed52b1a768 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group_rule (a0f9e329-bf4a-463b-97a7-06fff0bba29d), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:26.168502 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-93583d91-ff58-4f5c-ba37-17ed52b1a768 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (a0f9e329-bf4a-463b-97a7-06fff0bba29d), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:26.186872 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-93583d91-ff58-4f5c-ba37-17ed52b1a768 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=a0f9e329-bf4a-463b-97a7-06fff0bba29d,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:26.203045 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-93583d91-ff58-4f5c-ba37-17ed52b1a768 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:26.204482 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-93583d91-ff58-4f5c-ba37-17ed52b1a768 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1642630 Feb 08 18:17:26.207598 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 42318) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:26.218317 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-0264487e-7c36-44bc-923e-e6721217078e tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Request body: {'security_group_rule': {'security_group_id': '139768cd-8631-410a-b2f1-32ac28ffc91c', 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:17:26.237299 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-f1161aa7-0d5e-43d2-b30e-16bc093ba2c3 None None] Set router 72b4fd56-6775-4076-9195-fe85693f53aa gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:17:26.241772 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.db.securitygroups_db [None req-0264487e-7c36-44bc-923e-e6721217078e tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Project c504038b02a545d8a8b1873a4dfee655 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Feb 08 18:17:26.247131 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0264487e-7c36-44bc-923e-e6721217078e tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group_rule (30c3e3f5-849c-465c-bd4b-f711a2bcdc75), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:26.281750 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5e28a069-c391-4023-bec7-9897d4d61929 req-3afb8678-84bc-4d46-b95d-068a07f65fed service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1136038 Feb 08 18:17:26.316430 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0264487e-7c36-44bc-923e-e6721217078e tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group_rule (30c3e3f5-849c-465c-bd4b-f711a2bcdc75), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:26.321691 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0264487e-7c36-44bc-923e-e6721217078e tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (30c3e3f5-849c-465c-bd4b-f711a2bcdc75), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:26.345447 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0264487e-7c36-44bc-923e-e6721217078e tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=30c3e3f5-849c-465c-bd4b-f711a2bcdc75,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:26.360238 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0264487e-7c36-44bc-923e-e6721217078e tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:26.361562 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-0264487e-7c36-44bc-923e-e6721217078e tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1510875 Feb 08 18:17:26.364527 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 42322) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:26.369118 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-fda38273-6696-490a-a20c-a001b371573c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Request body: {'security_group_rule': {'security_group_id': '139768cd-8631-410a-b2f1-32ac28ffc91c', 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:17:26.399316 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.securitygroups_db [None req-fda38273-6696-490a-a20c-a001b371573c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Project c504038b02a545d8a8b1873a4dfee655 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Feb 08 18:17:26.407544 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-fda38273-6696-490a-a20c-a001b371573c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group_rule (94abd3e7-2723-49f3-a6ab-ae242883ffc3), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:26.506892 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-f1161aa7-0d5e-43d2-b30e-16bc093ba2c3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 4, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '8b5d25a6-20c1-4111-8cd4-527be842c81e', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'floating_ip_address': '172.27.1.78', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'port_id': '8f5b70dd-2b98-47c5-9288-4dabd9ca45e6', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 546, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'mac_address': 'fa:16:3e:61:f1:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b68b868-44af-459b-8cc4-7ec714415497', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:17:24Z', 'updated_at': '2022-02-08T18:17:24Z', 'revision_number': 0, 'project_id': '768f50510c57419e8a49ed0988014174', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '13fcfd03-fc49-4bba-8574-ec74e795e2bd', 'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'mac_address': 'fa:16:3e:4b:7b:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:44Z', 'updated_at': '2022-02-08T18:13:51Z', 'revision_number': 5, 'project_id': '768f50510c57419e8a49ed0988014174', 'subnets': [{'id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:26.536366 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f1161aa7-0d5e-43d2-b30e-16bc093ba2c3 None None] The sync data for ids ['72b4fd56-6775-4076-9195-fe85693f53aa'] in dv-cinder-773985-21-iscsi is: [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 4, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '8b5d25a6-20c1-4111-8cd4-527be842c81e', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'floating_ip_address': '172.27.1.78', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'port_id': '8f5b70dd-2b98-47c5-9288-4dabd9ca45e6', 'fixed_ip_address': '172.20.0.3', 'status': 'DOWN', 'standard_attr_id': 546, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'mac_address': 'fa:16:3e:61:f1:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b68b868-44af-459b-8cc4-7ec714415497', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:17:24Z', 'updated_at': '2022-02-08T18:17:24Z', 'revision_number': 0, 'project_id': '768f50510c57419e8a49ed0988014174', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '13fcfd03-fc49-4bba-8574-ec74e795e2bd', 'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'mac_address': 'fa:16:3e:4b:7b:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:44Z', 'updated_at': '2022-02-08T18:13:51Z', 'revision_number': 5, 'project_id': '768f50510c57419e8a49ed0988014174', 'subnets': [{'id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:17:26.562738 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-fda38273-6696-490a-a20c-a001b371573c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group_rule (94abd3e7-2723-49f3-a6ab-ae242883ffc3), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:26.573570 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-fda38273-6696-490a-a20c-a001b371573c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (94abd3e7-2723-49f3-a6ab-ae242883ffc3), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:26.597395 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e9a975b-2d61-4aff-9fea-3f31f0630527 req-a9695c5e-c3a1-4e63-93f3-4209cea0aa7d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:26.598986 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1e9a975b-2d61-4aff-9fea-3f31f0630527 req-a9695c5e-c3a1-4e63-93f3-4209cea0aa7d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.1310008 Feb 08 18:17:26.605244 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5e28a069-c391-4023-bec7-9897d4d61929 req-c1c93625-99e7-454f-a911-07739b8a1a3b service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3169174 Feb 08 18:17:26.609885 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fda38273-6696-490a-a20c-a001b371573c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=94abd3e7-2723-49f3-a6ab-ae242883ffc3,revision_number=0']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:26.630119 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-fda38273-6696-490a-a20c-a001b371573c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:26.631526 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-fda38273-6696-490a-a20c-a001b371573c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.2658732 Feb 08 18:17:26.659153 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1e9a975b-2d61-4aff-9fea-3f31f0630527 req-d467ae64-363a-438d-a9a2-7af3c756bfda tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0529242 Feb 08 18:17:26.891034 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fb590fdf-e7ed-4774-b341-3b833b5d8dee None None] New status for floating IP 8b5d25a6-20c1-4111-8cd4-527be842c81e: ACTIVE {{(pid=102561) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Feb 08 18:17:27.286795 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] Sync routers for ids ['dd95d872-66ab-4182-bf88-5307b4f94217'] in dv-cinder-773985-21-iscsi {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:17:27.301510 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] Routers {'dd95d872-66ab-4182-bf88-5307b4f94217'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:17:27.302222 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:17:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['dd95d872-66ab-4182-bf88-5307b4f94217'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:27.408584 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] Set router dd95d872-66ab-4182-bf88-5307b4f94217 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:17:27.630013 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd95d872-66ab-4182-bf88-5307b4f94217', 'name': 'tempest-TestShelveInstance-467833778-router', 'tenant_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.189'}], 'enable_snat': True}, 'gw_port_id': '00808ea1-d214-41c7-a14f-da57ed86d9c4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:20Z', 'updated_at': '2022-02-08T18:17:23Z', 'revision_number': 4, 'project_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'gw_port': {'id': '00808ea1-d214-41c7-a14f-da57ed86d9c4', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:27:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd95d872-66ab-4182-bf88-5307b4f94217', 'device_owner': 'network:router_gateway', 'standard_attr_id': 543, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.189', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:20Z', 'updated_at': '2022-02-08T18:17:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'f2343e5e-db58-45cd-8f37-ed1e16875a67', 'name': '', 'network_id': '104cc343-bac7-4e28-b431-8f5c486a990b', 'tenant_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'mac_address': 'fa:16:3e:66:16:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd95d872-66ab-4182-bf88-5307b4f94217', 'device_owner': 'network:router_interface', 'standard_attr_id': 544, 'fixed_ips': [{'subnet_id': 'a8821dcf-aec5-40f7-bf52-57ca331a164a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:23Z', 'updated_at': '2022-02-08T18:17:24Z', 'revision_number': 2, 'project_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'subnets': [{'id': 'a8821dcf-aec5-40f7-bf52-57ca331a164a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:27.655762 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] Checking router: dd95d872-66ab-4182-bf88-5307b4f94217 for host: dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:17:27.656102 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] Updating router dd95d872-66ab-4182-bf88-5307b4f94217 port f2343e5e-db58-45cd-8f37-ed1e16875a67 binding host dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Feb 08 18:17:27.685277 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (f2343e5e-db58-45cd-8f37-ed1e16875a67), before_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:27.745440 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 00808ea1-d214-41c7-a14f-da57ed86d9c4 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:17:27.792921 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 00808ea1-d214-41c7-a14f-da57ed86d9c4 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:27.793291 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (00808ea1-d214-41c7-a14f-da57ed86d9c4), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:27.804251 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17bab75a-ac2a-4003-a284-fc7981a972da req-a4626041-28bb-4937-8ca6-fc78ac11b986 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:27.805875 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-17bab75a-ac2a-4003-a284-fc7981a972da req-a4626041-28bb-4937-8ca6-fc78ac11b986 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0616632 Feb 08 18:17:27.866368 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-17bab75a-ac2a-4003-a284-fc7981a972da req-c9113a2c-1736-4041-91b4-21bab601746c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481679 Feb 08 18:17:27.884459 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 00808ea1-d214-41c7-a14f-da57ed86d9c4 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:27.981197 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] Publish callbacks [] for port (f2343e5e-db58-45cd-8f37-ed1e16875a67), precommit_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:27.988411 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (f2343e5e-db58-45cd-8f37-ed1e16875a67), after_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:28.041565 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2657948-7f1e-4e71-80f9-5329d2274650 None None] Pushing event updated for resources: {'Port': ['ID=f2343e5e-db58-45cd-8f37-ed1e16875a67,revision_number=3']} {{(pid=102562) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:28.095824 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] Attempting to bind port f2343e5e-db58-45cd-8f37-ed1e16875a67 on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:17:28.096192 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] Attempting to bind port f2343e5e-db58-45cd-8f37-ed1e16875a67 by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': 'c2af1e5f-fa31-4573-977c-86e6f81f6ce5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1086, 'network_id': '104cc343-bac7-4e28-b431-8f5c486a990b'}] {{(pid=102562) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:17:28.096572 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] Attempting to bind port f2343e5e-db58-45cd-8f37-ed1e16875a67 on network 104cc343-bac7-4e28-b431-8f5c486a990b {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:17:28.102010 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 17, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:17:28.102383 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] Checking segment: {'id': 'c2af1e5f-fa31-4573-977c-86e6f81f6ce5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1086, 'network_id': '104cc343-bac7-4e28-b431-8f5c486a990b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102562) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:17:28.102805 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:28.103197 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] Bound using segment: {'id': 'c2af1e5f-fa31-4573-977c-86e6f81f6ce5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1086, 'network_id': '104cc343-bac7-4e28-b431-8f5c486a990b'} {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:17:28.103668 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] Bound port: f2343e5e-db58-45cd-8f37-ed1e16875a67, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c2af1e5f-fa31-4573-977c-86e6f81f6ce5', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1086, 'network_id': '104cc343-bac7-4e28-b431-8f5c486a990b'}}] {{(pid=102562) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:17:28.104042 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (f2343e5e-db58-45cd-8f37-ed1e16875a67), before_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:28.182233 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.db [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] For port f2343e5e-db58-45cd-8f37-ed1e16875a67, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102562) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:17:28.185708 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.db [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] For port f2343e5e-db58-45cd-8f37-ed1e16875a67, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=f2343e5e-db58-45cd-8f37-ed1e16875a67,segment=NetworkSegment(c2af1e5f-fa31-4573-977c-86e6f81f6ce5),segment_id=c2af1e5f-fa31-4573-977c-86e6f81f6ce5)] {{(pid=102562) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:17:28.193470 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (f2343e5e-db58-45cd-8f37-ed1e16875a67), after_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:28.231656 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-a974ad31-7071-489b-86fb-db2aebc31b06 None None] Provisioning complete for port f2343e5e-db58-45cd-8f37-ed1e16875a67 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:28.232175 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-a974ad31-7071-489b-86fb-db2aebc31b06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (f2343e5e-db58-45cd-8f37-ed1e16875a67), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:28.251739 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] Routers {'dd95d872-66ab-4182-bf88-5307b4f94217'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:17:28.252391 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:17:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['dd95d872-66ab-4182-bf88-5307b4f94217'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:28.289530 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2657948-7f1e-4e71-80f9-5329d2274650 None None] Pushing event updated for resources: {'Port': ['ID=f2343e5e-db58-45cd-8f37-ed1e16875a67,revision_number=4']} {{(pid=102562) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:28.321560 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-a974ad31-7071-489b-86fb-db2aebc31b06 None None] Current status of the port f2343e5e-db58-45cd-8f37-ed1e16875a67 is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:28.321959 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-a974ad31-7071-489b-86fb-db2aebc31b06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (f2343e5e-db58-45cd-8f37-ed1e16875a67), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:28.361195 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-a974ad31-7071-489b-86fb-db2aebc31b06 None None] For port f2343e5e-db58-45cd-8f37-ed1e16875a67, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=f2343e5e-db58-45cd-8f37-ed1e16875a67,segment=NetworkSegment(c2af1e5f-fa31-4573-977c-86e6f81f6ce5),segment_id=c2af1e5f-fa31-4573-977c-86e6f81f6ce5)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:17:28.368205 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-a974ad31-7071-489b-86fb-db2aebc31b06 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (f2343e5e-db58-45cd-8f37-ed1e16875a67), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:28.368848 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] Set router dd95d872-66ab-4182-bf88-5307b4f94217 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:17:28.428762 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a974ad31-7071-489b-86fb-db2aebc31b06 None None] Pushing event updated for resources: {'Port': ['ID=f2343e5e-db58-45cd-8f37-ed1e16875a67,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:28.487633 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-b947f311-64d0-41f1-afb3-eae30d0c9928 None None] Provisioning complete for port f2343e5e-db58-45cd-8f37-ed1e16875a67 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:28.488002 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b947f311-64d0-41f1-afb3-eae30d0c9928 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (f2343e5e-db58-45cd-8f37-ed1e16875a67), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:28.569330 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-b947f311-64d0-41f1-afb3-eae30d0c9928 None None] Current status of the port f2343e5e-db58-45cd-8f37-ed1e16875a67 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:28.570311 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd95d872-66ab-4182-bf88-5307b4f94217', 'name': 'tempest-TestShelveInstance-467833778-router', 'tenant_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.189'}], 'enable_snat': True}, 'gw_port_id': '00808ea1-d214-41c7-a14f-da57ed86d9c4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:20Z', 'updated_at': '2022-02-08T18:17:23Z', 'revision_number': 4, 'project_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'gw_port': {'id': '00808ea1-d214-41c7-a14f-da57ed86d9c4', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:27:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd95d872-66ab-4182-bf88-5307b4f94217', 'device_owner': 'network:router_gateway', 'standard_attr_id': 543, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.189', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:20Z', 'updated_at': '2022-02-08T18:17:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'f2343e5e-db58-45cd-8f37-ed1e16875a67', 'name': '', 'network_id': '104cc343-bac7-4e28-b431-8f5c486a990b', 'tenant_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'mac_address': 'fa:16:3e:66:16:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd95d872-66ab-4182-bf88-5307b4f94217', 'device_owner': 'network:router_interface', 'standard_attr_id': 544, 'fixed_ips': [{'subnet_id': 'a8821dcf-aec5-40f7-bf52-57ca331a164a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:23Z', 'updated_at': '2022-02-08T18:17:28Z', 'revision_number': 4, 'project_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'subnets': [{'id': 'a8821dcf-aec5-40f7-bf52-57ca331a164a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:28.688042 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b0ad1931-4d6a-42f0-a703-7255e6f1a000 None None] The sync data for ids ['dd95d872-66ab-4182-bf88-5307b4f94217'] in dv-cinder-773985-21-iscsi is: [{'id': 'dd95d872-66ab-4182-bf88-5307b4f94217', 'name': 'tempest-TestShelveInstance-467833778-router', 'tenant_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.189'}], 'enable_snat': True}, 'gw_port_id': '00808ea1-d214-41c7-a14f-da57ed86d9c4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:20Z', 'updated_at': '2022-02-08T18:17:23Z', 'revision_number': 4, 'project_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'gw_port': {'id': '00808ea1-d214-41c7-a14f-da57ed86d9c4', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:27:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd95d872-66ab-4182-bf88-5307b4f94217', 'device_owner': 'network:router_gateway', 'standard_attr_id': 543, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.189', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:20Z', 'updated_at': '2022-02-08T18:17:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'f2343e5e-db58-45cd-8f37-ed1e16875a67', 'name': '', 'network_id': '104cc343-bac7-4e28-b431-8f5c486a990b', 'tenant_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'mac_address': 'fa:16:3e:66:16:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'dd95d872-66ab-4182-bf88-5307b4f94217', 'device_owner': 'network:router_interface', 'standard_attr_id': 544, 'fixed_ips': [{'subnet_id': 'a8821dcf-aec5-40f7-bf52-57ca331a164a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:23Z', 'updated_at': '2022-02-08T18:17:28Z', 'revision_number': 4, 'project_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'subnets': [{'id': 'a8821dcf-aec5-40f7-bf52-57ca331a164a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:17:29.117404 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36c5fa91-1590-4ba6-b2c9-b1ab1873fc24 req-fc763699-9134-4cfe-8616-57ab8aa95596 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:29.119007 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-36c5fa91-1590-4ba6-b2c9-b1ab1873fc24 req-fc763699-9134-4cfe-8616-57ab8aa95596 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0538411 Feb 08 18:17:29.175005 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-36c5fa91-1590-4ba6-b2c9-b1ab1873fc24 req-7f04bcb1-a267-46aa-8dae-b7201049a77e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0503073 Feb 08 18:17:29.760611 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device f2343e5e-db58-45cd-8f37-ed1e16875a67 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:17:29.813553 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port f2343e5e-db58-45cd-8f37-ed1e16875a67 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:29.813803 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (f2343e5e-db58-45cd-8f37-ed1e16875a67), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:30.015946 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port f2343e5e-db58-45cd-8f37-ed1e16875a67 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:30.314811 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8852ebef-d838-4e36-8565-18546abba50b req-40878b8a-83a8-4a23-bf88-adf8296a4bae tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:30.316544 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8852ebef-d838-4e36-8565-18546abba50b req-40878b8a-83a8-4a23-bf88-adf8296a4bae tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0538108 Feb 08 18:17:30.364581 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8852ebef-d838-4e36-8565-18546abba50b req-e5a0acba-c8f1-4044-9e43-7963caa3b910 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424466 Feb 08 18:17:31.505203 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7ef00b4-d03b-4213-b1ee-46f09714f85a req-ad356f25-8693-4137-9529-03add69a0e86 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:31.506666 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a7ef00b4-d03b-4213-b1ee-46f09714f85a req-ad356f25-8693-4137-9529-03add69a0e86 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0590734 Feb 08 18:17:31.553119 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a7ef00b4-d03b-4213-b1ee-46f09714f85a req-93b804a7-e6a9-4ab0-8b60-cec9b7c3311b tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0405476 Feb 08 18:17:32.683935 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d48dd228-bd5e-4882-b577-445c4ef8c89a req-e463a323-4698-4757-9756-98e20ff6530e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:32.685451 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d48dd228-bd5e-4882-b577-445c4ef8c89a req-e463a323-4698-4757-9756-98e20ff6530e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0591264 Feb 08 18:17:32.741392 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d48dd228-bd5e-4882-b577-445c4ef8c89a req-298bd211-f4db-42fc-a9d9-365978029547 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0497105 Feb 08 18:17:33.879726 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a9c4833-7e15-44fc-a01f-48f87bdf3d91 req-97aa6207-d31a-48c9-b9a2-4ebf0a47d7ed tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:33.881194 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-2a9c4833-7e15-44fc-a01f-48f87bdf3d91 req-97aa6207-d31a-48c9-b9a2-4ebf0a47d7ed tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0555885 Feb 08 18:17:33.932279 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-2a9c4833-7e15-44fc-a01f-48f87bdf3d91 req-fa98fac4-1634-4ed4-9f61-2dd508019bf2 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0447917 Feb 08 18:17:35.061397 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3bc15130-870e-429f-85b9-577954beb9b9 req-1e8afcac-bf39-4dd4-b4a4-3653e8bfe1df tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:35.067374 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-3bc15130-870e-429f-85b9-577954beb9b9 req-1e8afcac-bf39-4dd4-b4a4-3653e8bfe1df tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0598114 Feb 08 18:17:35.083526 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a07b27fd-eeea-4284-bc80-f32bbb4e7438 req-a8de1bc1-80ad-47db-95ca-75b2723cd34d tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:35.085240 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a07b27fd-eeea-4284-bc80-f32bbb4e7438 req-a8de1bc1-80ad-47db-95ca-75b2723cd34d tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 946 time: 0.0589654 Feb 08 18:17:35.110696 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-3bc15130-870e-429f-85b9-577954beb9b9 req-0cdbb107-6d35-4558-bd47-361c563c4fa2 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417292 Feb 08 18:17:35.137107 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a07b27fd-eeea-4284-bc80-f32bbb4e7438 req-bbc92522-ddc1-4dce-9803-34535ffd075d tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=4ead608b-09aa-4247-92a7-e3d23386c346&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458689 Feb 08 18:17:35.984313 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:17:36.237777 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebde6af8-0f48-4c85-b3fd-026b1f3550d7 req-1cdd95f7-6205-4681-ab77-67551bf292a1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:36.239849 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ebde6af8-0f48-4c85-b3fd-026b1f3550d7 req-1cdd95f7-6205-4681-ab77-67551bf292a1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0533869 Feb 08 18:17:36.258596 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-428661ea-d24a-4dca-83c8-ece79e87336e req-363a216d-47ec-46f7-8a66-9831ca1109ac tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:36.260105 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-428661ea-d24a-4dca-83c8-ece79e87336e req-363a216d-47ec-46f7-8a66-9831ca1109ac tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 946 time: 0.0551324 Feb 08 18:17:36.286443 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ebde6af8-0f48-4c85-b3fd-026b1f3550d7 req-36932227-7522-4e59-ad41-21cdcc3c16fa tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0411789 Feb 08 18:17:36.310128 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-428661ea-d24a-4dca-83c8-ece79e87336e req-95af0bba-5c67-4e92-b724-c582dc1b4d62 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=4ead608b-09aa-4247-92a7-e3d23386c346&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440266 Feb 08 18:17:37.180075 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a5fc7dd-0b5b-49ef-ab03-2543113d9284 req-034da58c-ce47-49e8-8d20-39dfa5da9a44 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:37.181526 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1a5fc7dd-0b5b-49ef-ab03-2543113d9284 req-034da58c-ce47-49e8-8d20-39dfa5da9a44 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.109 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 946 time: 0.0535016 Feb 08 18:17:37.282836 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 50b2e85d-5914-4f54-9939-14603e53f04e details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:17:37.288123 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-1a5fc7dd-0b5b-49ef-ab03-2543113d9284 req-a419253d-a48a-4b74-b8be-e0aeb488461c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Deleting port b77bffb2-0403-4c4d-b0c9-4de454874429 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:17:37.288697 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1a5fc7dd-0b5b-49ef-ab03-2543113d9284 req-a419253d-a48a-4b74-b8be-e0aeb488461c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (b77bffb2-0403-4c4d-b0c9-4de454874429), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:37.385600 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 50b2e85d-5914-4f54-9939-14603e53f04e, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=50b2e85d-5914-4f54-9939-14603e53f04e,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:17:37.396997 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-1a5fc7dd-0b5b-49ef-ab03-2543113d9284 req-a419253d-a48a-4b74-b8be-e0aeb488461c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] For port b77bffb2-0403-4c4d-b0c9-4de454874429, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=b77bffb2-0403-4c4d-b0c9-4de454874429,segment=NetworkSegment(acdceaea-bf94-4e23-8e9f-0f5d9197e75f),segment_id=acdceaea-bf94-4e23-8e9f-0f5d9197e75f)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:17:37.397642 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1a5fc7dd-0b5b-49ef-ab03-2543113d9284 req-a419253d-a48a-4b74-b8be-e0aeb488461c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (b77bffb2-0403-4c4d-b0c9-4de454874429), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:37.398753 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': '50b2e85d-5914-4f54-9939-14603e53f04e', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'port_id': '50b2e85d-5914-4f54-9939-14603e53f04e', 'mac_address': 'fa:16:3e:8f:67:4b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1053, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '73de7865-d87d-4a2a-a702-160c400f145f', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:17:37.446058 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 50b2e85d-5914-4f54-9939-14603e53f04e is: ACTIVE; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:37.446457 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:37.461848 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 50b2e85d-5914-4f54-9939-14603e53f04e {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:17:37.485145 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 50b2e85d-5914-4f54-9939-14603e53f04e, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=50b2e85d-5914-4f54-9939-14603e53f04e,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:17:37.492341 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5363df3-167d-4c69-8372-5dc446eca844 req-4775b3d4-94d4-44df-a1d0-a12a9fd4ca72 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:37.499132 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:37.507657 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c5363df3-167d-4c69-8372-5dc446eca844 req-4775b3d4-94d4-44df-a1d0-a12a9fd4ca72 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 946 time: 0.0901399 Feb 08 18:17:37.509188 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-492ff74b-63cf-421b-8281-0be8a3dbc6b5 req-00c0da4e-d8ac-4198-ad1a-865dd532cb5c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:37.510899 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-492ff74b-63cf-421b-8281-0be8a3dbc6b5 req-00c0da4e-d8ac-4198-ad1a-865dd532cb5c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.1092386 Feb 08 18:17:37.565423 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c5363df3-167d-4c69-8372-5dc446eca844 req-a01f9c3e-0cfa-4480-beb2-2ce53053a9a3 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups?id=4ead608b-09aa-4247-92a7-e3d23386c346&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0546601 Feb 08 18:17:37.592853 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['50b2e85d-5914-4f54-9939-14603e53f04e'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:17:37.597493 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=50b2e85d-5914-4f54-9939-14603e53f04e,revision_number=6']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:37.629560 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-492ff74b-63cf-421b-8281-0be8a3dbc6b5 req-eff3888e-1cc2-4b66-945c-f6148135d7e4 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1077902 Feb 08 18:17:37.695913 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1a5fc7dd-0b5b-49ef-ab03-2543113d9284 req-a419253d-a48a-4b74-b8be-e0aeb488461c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:37.696362 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1a5fc7dd-0b5b-49ef-ab03-2543113d9284 req-a419253d-a48a-4b74-b8be-e0aeb488461c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-560746'] for floatingip (0a8ed6c0-d363-4a2c-9628-d369a0abdf56), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:37.696748 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.l3_db [req-1a5fc7dd-0b5b-49ef-ab03-2543113d9284 req-a419253d-a48a-4b74-b8be-e0aeb488461c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Floating IP 0a8ed6c0-d363-4a2c-9628-d369a0abdf56 disassociated. External IP: 172.27.1.16, port: b77bffb2-0403-4c4d-b0c9-4de454874429. Feb 08 18:17:37.697095 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-1a5fc7dd-0b5b-49ef-ab03-2543113d9284 req-a419253d-a48a-4b74-b8be-e0aeb488461c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Calling delete_port for b77bffb2-0403-4c4d-b0c9-4de454874429 owned by compute:nova {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:17:37.836586 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1a5fc7dd-0b5b-49ef-ab03-2543113d9284 req-a419253d-a48a-4b74-b8be-e0aeb488461c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (b77bffb2-0403-4c4d-b0c9-4de454874429), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:37.866315 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a419253d-a48a-4b74-b8be-e0aeb488461c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Pushing event deleted for resources: {'Port': ['ID=b77bffb2-0403-4c4d-b0c9-4de454874429,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:37.998213 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [req-1a5fc7dd-0b5b-49ef-ab03-2543113d9284 req-a419253d-a48a-4b74-b8be-e0aeb488461c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:17:38.119009 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-1a5fc7dd-0b5b-49ef-ab03-2543113d9284 req-a419253d-a48a-4b74-b8be-e0aeb488461c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:17:38.134147 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45c2ee02-634f-4b5d-be6a-6363d641c570 None None] Sync routers for ids ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:17:38.145329 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45c2ee02-634f-4b5d-be6a-6363d641c570 None None] Routers {'3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:17:38.145858 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-45c2ee02-634f-4b5d-be6a-6363d641c570 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:17:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:38.171943 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [req-1a5fc7dd-0b5b-49ef-ab03-2543113d9284 req-a419253d-a48a-4b74-b8be-e0aeb488461c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] No DVR routers for this DVR port b77bffb2-0403-4c4d-b0c9-4de454874429 on host hv-cinder-77398 {{(pid=102560) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:17:38.175314 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-1a5fc7dd-0b5b-49ef-ab03-2543113d9284 req-a419253d-a48a-4b74-b8be-e0aeb488461c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:38.178948 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1a5fc7dd-0b5b-49ef-ab03-2543113d9284 req-a419253d-a48a-4b74-b8be-e0aeb488461c tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.109 "DELETE /v2.0/ports/b77bffb2-0403-4c4d-b0c9-4de454874429 HTTP/1.1" status: 204 len: 173 time: 0.9895582 Feb 08 18:17:38.179461 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '93e9d398-2f45-4bba-8f28-35d32a92af5b', 'name': 'network-vif-deleted', 'tag': 'b77bffb2-0403-4c4d-b0c9-4de454874429'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:17:38.181858 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bd6e1e6b-b539-486d-8ac1-12c01ba29888" -d '{"events": [{"server_uuid": "93e9d398-2f45-4bba-8f28-35d32a92af5b", "name": "network-vif-deleted", "tag": "b77bffb2-0403-4c4d-b0c9-4de454874429"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:17:38.346098 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-45c2ee02-634f-4b5d-be6a-6363d641c570 None None] Set router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:17:38.365356 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:17:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ffa2777d-1ee2-4eca-a0c2-980351f84a86 x-openstack-request-id: req-ffa2777d-1ee2-4eca-a0c2-980351f84a86 {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:17:38.365900 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "93e9d398-2f45-4bba-8f28-35d32a92af5b", "name": "network-vif-deleted", "tag": "b77bffb2-0403-4c4d-b0c9-4de454874429", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:17:38.366364 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-ffa2777d-1ee2-4eca-a0c2-980351f84a86 {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:17:38.367093 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '93e9d398-2f45-4bba-8f28-35d32a92af5b', 'name': 'network-vif-deleted', 'tag': 'b77bffb2-0403-4c4d-b0c9-4de454874429', 'status': 'completed', 'code': 200} Feb 08 18:17:38.631049 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-45c2ee02-634f-4b5d-be6a-6363d641c570 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'name': 'tempest-AttachVolumeTestJSON-997005721-router', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77'}], 'enable_snat': True}, 'gw_port_id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:23Z', 'revision_number': 4, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'gw_port': {'id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ad:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'fe9dfbe9-83a8-472c-b3a3-9537d424939b', 'name': '', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'mac_address': 'fa:16:3e:dd:46:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:19Z', 'updated_at': '2022-02-08T18:12:34Z', 'revision_number': 5, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'subnets': [{'id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:38.664370 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45c2ee02-634f-4b5d-be6a-6363d641c570 None None] Checking router: 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:17:38.697703 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-45c2ee02-634f-4b5d-be6a-6363d641c570 None None] Routers {'3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:17:38.699777 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-45c2ee02-634f-4b5d-be6a-6363d641c570 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:17:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:38.791456 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-471b003b-b2fc-413a-a6c9-b529129d539a req-42f62310-0d77-4100-8ecb-534ad30fe83b tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/ports?device_id=93e9d398-2f45-4bba-8f28-35d32a92af5b HTTP/1.1" status: 200 len: 210 time: 0.0782740 Feb 08 18:17:38.817413 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54e35b8a-a393-448f-ab98-d9a068f6e7fc req-7fee4f86-9cc6-44fa-8f9c-ba08dcd3c15f tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:38.826569 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-54e35b8a-a393-448f-ab98-d9a068f6e7fc req-7fee4f86-9cc6-44fa-8f9c-ba08dcd3c15f tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 944 time: 0.0812798 Feb 08 18:17:38.864209 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-45c2ee02-634f-4b5d-be6a-6363d641c570 None None] Set router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:17:38.904818 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-54e35b8a-a393-448f-ab98-d9a068f6e7fc req-1d05e9e8-6ab7-49f9-814c-0e9205335c3d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0717626 Feb 08 18:17:39.104594 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-45c2ee02-634f-4b5d-be6a-6363d641c570 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'name': 'tempest-AttachVolumeTestJSON-997005721-router', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77'}], 'enable_snat': True}, 'gw_port_id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:23Z', 'revision_number': 4, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'gw_port': {'id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ad:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'fe9dfbe9-83a8-472c-b3a3-9537d424939b', 'name': '', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'mac_address': 'fa:16:3e:dd:46:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:19Z', 'updated_at': '2022-02-08T18:12:34Z', 'revision_number': 5, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'subnets': [{'id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:39.132531 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-45c2ee02-634f-4b5d-be6a-6363d641c570 None None] The sync data for ids ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'] in dv-cinder-773985-21-iscsi is: [{'id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'name': 'tempest-AttachVolumeTestJSON-997005721-router', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77'}], 'enable_snat': True}, 'gw_port_id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:23Z', 'revision_number': 4, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'gw_port': {'id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ad:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'fe9dfbe9-83a8-472c-b3a3-9537d424939b', 'name': '', 'network_id': 'e430084e-9b28-426f-9937-61346814b135', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'mac_address': 'fa:16:3e:dd:46:e7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_interface', 'standard_attr_id': 92, 'fixed_ips': [{'subnet_id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:19Z', 'updated_at': '2022-02-08T18:12:34Z', 'revision_number': 5, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'subnets': [{'id': '86592955-e7d0-4e8a-9490-976e17240d7c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:17:39.307366 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 50b2e85d-5914-4f54-9939-14603e53f04e up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:17:39.381363 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port 50b2e85d-5914-4f54-9939-14603e53f04e triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:39.382245 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:39.420033 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3dd70112-d067-4a30-a6c6-37abbd79f96d None None] New status for floating IP 0a8ed6c0-d363-4a2c-9628-d369a0abdf56: DOWN {{(pid=102562) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Feb 08 18:17:39.487290 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 50b2e85d-5914-4f54-9939-14603e53f04e is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:39.487777 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:39.514247 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '097f7b21-9f4e-4341-831a-307f6b722f44', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '50b2e85d-5914-4f54-9939-14603e53f04e'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:17:39.517244 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1fa85246-da12-4904-adfc-e4f9d4612171" -d '{"events": [{"server_uuid": "097f7b21-9f4e-4341-831a-307f6b722f44", "name": "network-vif-plugged", "status": "completed", "tag": "50b2e85d-5914-4f54-9939-14603e53f04e"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:17:39.553541 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 50b2e85d-5914-4f54-9939-14603e53f04e, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=50b2e85d-5914-4f54-9939-14603e53f04e,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:17:39.562478 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:39.563612 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device b77bffb2-0403-4c4d-b0c9-4de454874429 no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:17:39.586834 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:17:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6ba7579c-9157-4aba-bb81-9925fa0adea4 x-openstack-request-id: req-6ba7579c-9157-4aba-bb81-9925fa0adea4 {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:17:39.587195 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "097f7b21-9f4e-4341-831a-307f6b722f44", "name": "network-vif-plugged", "status": "completed", "tag": "50b2e85d-5914-4f54-9939-14603e53f04e", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:17:39.587523 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-6ba7579c-9157-4aba-bb81-9925fa0adea4 {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:17:39.588111 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '097f7b21-9f4e-4341-831a-307f6b722f44', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '50b2e85d-5914-4f54-9939-14603e53f04e', 'code': 200} Feb 08 18:17:39.608575 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] No Port match for: b77bffb2-0403-4c4d-b0c9-4de454874429 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:17:39.608951 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device b77bffb2-0403-4c4d-b0c9-4de454874429 not bound to the agent host hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:17:39.645206 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=50b2e85d-5914-4f54-9939-14603e53f04e,revision_number=7']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:39.877638 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 42530) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:39.948365 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-35c7a835-91a3-44c0-bcd2-c8c71a62ffd2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group (4ead608b-09aa-4247-92a7-e3d23386c346), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:39.974599 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-35c7a835-91a3-44c0-bcd2-c8c71a62ffd2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group (4ead608b-09aa-4247-92a7-e3d23386c346), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:40.033979 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-35c7a835-91a3-44c0-bcd2-c8c71a62ffd2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (4ead608b-09aa-4247-92a7-e3d23386c346), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:40.037408 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-35c7a835-91a3-44c0-bcd2-c8c71a62ffd2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:40.038610 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-35c7a835-91a3-44c0-bcd2-c8c71a62ffd2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "DELETE /v2.0/security-groups/4ead608b-09aa-4247-92a7-e3d23386c346 HTTP/1.1" status: 204 len: 168 time: 0.1599197 Feb 08 18:17:40.039483 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f5013a-ac19-4b0a-9628-dc3b3fdb7b41 req-c1ed9e26-77ba-4dfd-9a1d-c3b66205923d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:40.041820 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 42534) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:40.047307 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-04f5013a-ac19-4b0a-9628-dc3b3fdb7b41 req-c1ed9e26-77ba-4dfd-9a1d-c3b66205923d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0678248 Feb 08 18:17:40.062043 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35c7a835-91a3-44c0-bcd2-c8c71a62ffd2 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4ead608b-09aa-4247-92a7-e3d23386c346,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:40.065888 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.api.v2.resource [None req-658888b4-329a-4e06-af11-84b416f4bed3 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] show failed (client error): The resource could not be found. Feb 08 18:17:40.067118 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-658888b4-329a-4e06-af11-84b416f4bed3 tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "GET /v2.0/security-groups/4ead608b-09aa-4247-92a7-e3d23386c346 HTTP/1.1" status: 404 len: 347 time: 0.0240743 Feb 08 18:17:40.069941 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 42536) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:40.107822 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-04f5013a-ac19-4b0a-9628-dc3b3fdb7b41 req-381045b1-a5b5-407e-9cf0-def33594931f tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0573044 Feb 08 18:17:40.235971 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-2ac34bba-6ce6-42b7-ab9d-6936cd70f75a tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Deleting port 6c07f56b-b602-41d3-b110-3008f5a53801 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:17:40.236566 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2ac34bba-6ce6-42b7-ab9d-6936cd70f75a tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (6c07f56b-b602-41d3-b110-3008f5a53801), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:40.325594 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2ac34bba-6ce6-42b7-ab9d-6936cd70f75a tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (6c07f56b-b602-41d3-b110-3008f5a53801), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:40.325917 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2ac34bba-6ce6-42b7-ab9d-6936cd70f75a tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for floatingip (6c07f56b-b602-41d3-b110-3008f5a53801), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:40.338459 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-2ac34bba-6ce6-42b7-ab9d-6936cd70f75a tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Calling delete_port for 6c07f56b-b602-41d3-b110-3008f5a53801 owned by network:floatingip {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:17:40.479081 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2ac34bba-6ce6-42b7-ab9d-6936cd70f75a tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (6c07f56b-b602-41d3-b110-3008f5a53801), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:40.508162 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ac34bba-6ce6-42b7-ab9d-6936cd70f75a tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Pushing event deleted for resources: {'Port': ['ID=6c07f56b-b602-41d3-b110-3008f5a53801,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:40.576487 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2ac34bba-6ce6-42b7-ab9d-6936cd70f75a tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks [] for floatingip (0a8ed6c0-d363-4a2c-9628-d369a0abdf56), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:40.579399 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2ac34bba-6ce6-42b7-ab9d-6936cd70f75a tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for floatingip (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:40.580701 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-2ac34bba-6ce6-42b7-ab9d-6936cd70f75a tempest-AttachVolumeTestJSON-1138181899 tempest-AttachVolumeTestJSON-1138181899-project] 10.222.0.118 "DELETE /v2.0/floatingips/0a8ed6c0-d363-4a2c-9628-d369a0abdf56 HTTP/1.1" status: 204 len: 168 time: 0.4992344 Feb 08 18:17:41.231504 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49633f4e-e90c-4b61-9b18-0677246d760d req-772ad0df-17ac-4c0c-8f10-b672a31eee71 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:41.232946 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-49633f4e-e90c-4b61-9b18-0677246d760d req-772ad0df-17ac-4c0c-8f10-b672a31eee71 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0585523 Feb 08 18:17:41.288209 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-49633f4e-e90c-4b61-9b18-0677246d760d req-c731a0b6-4d07-4bf5-aafa-d44b413bb437 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0490563 Feb 08 18:17:42.428158 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-296af018-6ad1-41f6-8f28-11f59ce64357 req-81ca9cbf-8af9-4939-935d-2c7a4e86f34e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:42.430324 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-296af018-6ad1-41f6-8f28-11f59ce64357 req-81ca9cbf-8af9-4939-935d-2c7a4e86f34e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0603690 Feb 08 18:17:42.501275 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-296af018-6ad1-41f6-8f28-11f59ce64357 req-c46fe905-fc5d-4921-bfc3-cfc44c4eb53a tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0613666 Feb 08 18:17:43.127668 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d15390ac-22ba-4293-9135-5176ef729353 req-dba7e95e-50ec-4ed8-b837-3de21b755f85 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-299122988&fields=id&tenant_id=c504038b02a545d8a8b1873a4dfee655 HTTP/1.1" status: 200 len: 267 time: 0.0594089 Feb 08 18:17:43.247606 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d15390ac-22ba-4293-9135-5176ef729353 req-33c33c71-465b-44b1-b527-254eefa234b0 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:43.249332 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d15390ac-22ba-4293-9135-5176ef729353 req-33c33c71-465b-44b1-b527-254eefa234b0 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/networks?id=ad3e14dd-35bd-4c6d-8d94-5b851458e927 HTTP/1.1" status: 200 len: 809 time: 0.1188159 Feb 08 18:17:43.272371 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d15390ac-22ba-4293-9135-5176ef729353 req-8583f5d0-238a-43d0-85aa-50167aa4f61d tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/quotas/c504038b02a545d8a8b1873a4dfee655 HTTP/1.1" status: 200 len: 375 time: 0.0169988 Feb 08 18:17:43.339235 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d15390ac-22ba-4293-9135-5176ef729353 req-084a1fe8-e617-4093-bb8c-8b7410405175 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?tenant_id=c504038b02a545d8a8b1873a4dfee655&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0642681 Feb 08 18:17:43.495666 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d15390ac-22ba-4293-9135-5176ef729353 req-2a6a59ec-972e-4246-ba8e-a43f2d12806c service neutron] 10.222.0.118 "GET /v2.0/networks/ad3e14dd-35bd-4c6d-8d94-5b851458e927?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1509202 Feb 08 18:17:43.629440 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61193724-1b3c-4b26-bb10-429b10098ffb req-9595907b-5fd0-4443-b074-5ecbd8626fca tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:43.637335 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-61193724-1b3c-4b26-bb10-429b10098ffb req-9595907b-5fd0-4443-b074-5ecbd8626fca tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0674295 Feb 08 18:17:43.697804 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-61193724-1b3c-4b26-bb10-429b10098ffb req-33ef9d2d-190f-4592-ae63-a4f0b8fb6456 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0590293 Feb 08 18:17:43.881128 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d15390ac-22ba-4293-9135-5176ef729353 req-0206a829-fee0-46d6-861f-dff7ef8f180c service neutron] 10.222.0.118 "GET /v2.0/networks/ad3e14dd-35bd-4c6d-8d94-5b851458e927?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3784773 Feb 08 18:17:44.238845 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3c2c64c7-bd1f-4d23-85b8-3aab861a9f4f req-7c378f3b-7479-437f-8c9e-8d00533369a0 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 210 time: 0.0378258 Feb 08 18:17:44.313390 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 42600) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:44.841703 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-23924b73-dbcb-4e87-874b-d5358b560307 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-559978'] for router_interface (3c53cb16-5d43-40f1-a3a6-2ca2f7a42984), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:44.877523 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2c0b4df-e95d-4916-b4a0-52fbf6454a66 req-87613322-906d-4565-ae13-0753eb03a640 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:44.880298 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c2c0b4df-e95d-4916-b4a0-52fbf6454a66 req-87613322-906d-4565-ae13-0753eb03a640 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0895531 Feb 08 18:17:44.938845 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c2c0b4df-e95d-4916-b4a0-52fbf6454a66 req-164835fe-82e3-400f-966e-9476f2c1fb7d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0484686 Feb 08 18:17:45.149258 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-23924b73-dbcb-4e87-874b-d5358b560307 admin admin] Deleting port fe9dfbe9-83a8-472c-b3a3-9537d424939b {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:17:45.149650 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-23924b73-dbcb-4e87-874b-d5358b560307 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (fe9dfbe9-83a8-472c-b3a3-9537d424939b), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:45.254735 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [None req-23924b73-dbcb-4e87-874b-d5358b560307 admin admin] For port fe9dfbe9-83a8-472c-b3a3-9537d424939b, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=fe9dfbe9-83a8-472c-b3a3-9537d424939b,segment=NetworkSegment(acdceaea-bf94-4e23-8e9f-0f5d9197e75f),segment_id=acdceaea-bf94-4e23-8e9f-0f5d9197e75f)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:17:45.254995 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-23924b73-dbcb-4e87-874b-d5358b560307 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (fe9dfbe9-83a8-472c-b3a3-9537d424939b), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:45.274006 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-23924b73-dbcb-4e87-874b-d5358b560307 admin admin] Calling delete_port for fe9dfbe9-83a8-472c-b3a3-9537d424939b owned by network:router_interface {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:17:45.381011 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-43872017-18e7-49ae-b1bb-be9e16b7607f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:45.433790 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-fdb26d10-5781-4e23-829e-dea3a7514d80 req-60d380e8-da8d-4799-9111-afeb5c36d649 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 210 time: 0.0375800 Feb 08 18:17:45.532218 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-23924b73-dbcb-4e87-874b-d5358b560307 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (fe9dfbe9-83a8-472c-b3a3-9537d424939b), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:45.567780 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23924b73-dbcb-4e87-874b-d5358b560307 admin admin] Pushing event deleted for resources: {'Port': ['ID=fe9dfbe9-83a8-472c-b3a3-9537d424939b,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:45.839785 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d15390ac-22ba-4293-9135-5176ef729353 req-8e98c02d-348b-4248-bacb-0c97dd3d431c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:45.841462 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d15390ac-22ba-4293-9135-5176ef729353 req-8e98c02d-348b-4248-bacb-0c97dd3d431c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.109 "GET /v2.0/networks?id=ad3e14dd-35bd-4c6d-8d94-5b851458e927 HTTP/1.1" status: 200 len: 809 time: 0.2860353 Feb 08 18:17:45.952774 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d15390ac-22ba-4293-9135-5176ef729353 req-10cafe4e-23ea-4465-bbf9-b6013b38c498 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.109 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c504038b02a545d8a8b1873a4dfee655 HTTP/1.1" status: 200 len: 379 time: 0.0853508 Feb 08 18:17:45.964833 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [req-d15390ac-22ba-4293-9135-5176ef729353 req-b02c6998-d76f-4d02-9121-97ab92b00a62 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Request body: {'port': {'device_id': 'd5ab9458-bd5e-49a0-b97b-1e388bb5af81', 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927', 'admin_state_up': True, 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'security_groups': ['139768cd-8631-410a-b2f1-32ac28ffc91c']}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:17:45.969826 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-23924b73-dbcb-4e87-874b-d5358b560307 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-631690', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-560126'] for router_interface (3c53cb16-5d43-40f1-a3a6-2ca2f7a42984), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:46.106609 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bcfbf70-ab06-45f0-85fa-1b205c900c80 req-a07b7f2f-850d-4baf-8bc4-f860beca9214 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:46.109445 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1bcfbf70-ab06-45f0-85fa-1b205c900c80 req-a07b7f2f-850d-4baf-8bc4-f860beca9214 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0745902 Feb 08 18:17:46.204464 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1bcfbf70-ab06-45f0-85fa-1b205c900c80 req-afb84b3e-23a5-4a10-9091-3343aea426c3 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0772660 Feb 08 18:17:46.276184 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d15390ac-22ba-4293-9135-5176ef729353 req-b02c6998-d76f-4d02-9121-97ab92b00a62 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Made reservation on behalf of c504038b02a545d8a8b1873a4dfee655 for: {'port': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:17:46.280382 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-d15390ac-22ba-4293-9135-5176ef729353 req-b02c6998-d76f-4d02-9121-97ab92b00a62 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:46.380446 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-23924b73-dbcb-4e87-874b-d5358b560307 admin admin] Router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:17:46.496845 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_common [req-d15390ac-22ba-4293-9135-5176ef729353 req-b02c6998-d76f-4d02-9121-97ab92b00a62 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Allocated IP 172.20.0.12 (ad3e14dd-35bd-4c6d-8d94-5b851458e927/58f829ef-859d-415d-b810-791456a616fc/012af0ea-fa3b-4267-a4da-80c767055b16) {{(pid=102560) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:17:46.562659 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-265d143a-7595-4584-b0ca-1f579161986a req-a67b10fc-8886-4409-8965-744575702a50 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 210 time: 0.0456359 Feb 08 18:17:46.653036 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-23924b73-dbcb-4e87-874b-d5358b560307 admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:17:46.660951 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-23924b73-dbcb-4e87-874b-d5358b560307 admin admin] 10.222.0.118 "PUT /v2.0/routers/3c53cb16-5d43-40f1-a3a6-2ca2f7a42984/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.3463213 Feb 08 18:17:46.663879 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 42626) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:46.674275 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5661a0b-a30a-44e3-928c-e23192646e02 None None] Sync routers for ids ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:17:46.688196 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5661a0b-a30a-44e3-928c-e23192646e02 None None] Routers {'3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:17:46.689187 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-a5661a0b-a30a-44e3-928c-e23192646e02 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:17:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:46.757619 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-d15390ac-22ba-4293-9135-5176ef729353 req-b02c6998-d76f-4d02-9121-97ab92b00a62 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for port (012af0ea-fa3b-4267-a4da-80c767055b16), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:46.808485 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-d15390ac-22ba-4293-9135-5176ef729353 req-b02c6998-d76f-4d02-9121-97ab92b00a62 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (012af0ea-fa3b-4267-a4da-80c767055b16), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:46.813848 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e25a1387-bd30-421d-9f68-457fa73904b2 admin admin] Publish callbacks [] for router (3c53cb16-5d43-40f1-a3a6-2ca2f7a42984), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:46.833303 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-a5661a0b-a30a-44e3-928c-e23192646e02 None None] Set router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:17:46.868658 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b02c6998-d76f-4d02-9121-97ab92b00a62 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Pushing event updated for resources: {'Port': ['ID=012af0ea-fa3b-4267-a4da-80c767055b16,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:46.877161 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d15390ac-22ba-4293-9135-5176ef729353 req-b02c6998-d76f-4d02-9121-97ab92b00a62 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Network ad3e14dd-35bd-4c6d-8d94-5b851458e927 is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:17:46.878683 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [req-d15390ac-22ba-4293-9135-5176ef729353 req-b02c6998-d76f-4d02-9121-97ab92b00a62 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:17:46.895926 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [req-d15390ac-22ba-4293-9135-5176ef729353 req-b02c6998-d76f-4d02-9121-97ab92b00a62 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Received port after_create {{(pid=102560) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:17:46.963810 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d15390ac-22ba-4293-9135-5176ef729353 req-b02c6998-d76f-4d02-9121-97ab92b00a62 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:46.964529 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-d15390ac-22ba-4293-9135-5176ef729353 req-b02c6998-d76f-4d02-9121-97ab92b00a62 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:46.993665 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d15390ac-22ba-4293-9135-5176ef729353 req-b02c6998-d76f-4d02-9121-97ab92b00a62 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.109 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.0327787 Feb 08 18:17:46.999673 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e25a1387-bd30-421d-9f68-457fa73904b2 admin admin] Publish callbacks [] for router_gateway (3c53cb16-5d43-40f1-a3a6-2ca2f7a42984), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:47.011031 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [req-d15390ac-22ba-4293-9135-5176ef729353 req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] Request body: {'port': {'device_id': 'd5ab9458-bd5e-49a0-b97b-1e388bb5af81', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77398'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:17:47.108943 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-e25a1387-bd30-421d-9f68-457fa73904b2 admin admin] Deleting port ae5f46f2-7729-4ab9-95e0-646bf67653f0 {{(pid=102559) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:17:47.110725 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e25a1387-bd30-421d-9f68-457fa73904b2 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (ae5f46f2-7729-4ab9-95e0-646bf67653f0), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:47.113672 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-a5661a0b-a30a-44e3-928c-e23192646e02 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'name': 'tempest-AttachVolumeTestJSON-997005721-router', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77'}], 'enable_snat': True}, 'gw_port_id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:17:45Z', 'revision_number': 5, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'gw_port': {'id': 'ae5f46f2-7729-4ab9-95e0-646bf67653f0', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:e4:ad:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'device_owner': 'network:router_gateway', 'standard_attr_id': 67, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.77', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:47.122538 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-d15390ac-22ba-4293-9135-5176ef729353 req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (012af0ea-fa3b-4267-a4da-80c767055b16), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:47.165715 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5661a0b-a30a-44e3-928c-e23192646e02 None None] Checking router: 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:17:47.203629 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5661a0b-a30a-44e3-928c-e23192646e02 None None] Routers {'3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:17:47.204491 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-a5661a0b-a30a-44e3-928c-e23192646e02 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:17:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:47.263457 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [None req-e25a1387-bd30-421d-9f68-457fa73904b2 admin admin] For port ae5f46f2-7729-4ab9-95e0-646bf67653f0, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=ae5f46f2-7729-4ab9-95e0-646bf67653f0,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102559) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:17:47.265206 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e25a1387-bd30-421d-9f68-457fa73904b2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (ae5f46f2-7729-4ab9-95e0-646bf67653f0), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:47.291376 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-e25a1387-bd30-421d-9f68-457fa73904b2 admin admin] Calling delete_port for ae5f46f2-7729-4ab9-95e0-646bf67653f0 owned by network:router_gateway {{(pid=102559) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:17:47.462632 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [req-d15390ac-22ba-4293-9135-5176ef729353 req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 012af0ea-fa3b-4267-a4da-80c767055b16 {{(pid=102560) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:17:47.470543 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-d15390ac-22ba-4293-9135-5176ef729353 req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] Publish callbacks [] for port (012af0ea-fa3b-4267-a4da-80c767055b16), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:47.470793 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-708bc1e0-4a65-4dbb-8580-26be8135633f req-dc456a34-ef8b-4b89-b436-7290b3780e11 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:47.472543 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-708bc1e0-4a65-4dbb-8580-26be8135633f req-dc456a34-ef8b-4b89-b436-7290b3780e11 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.1218793 Feb 08 18:17:47.488370 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.provisioning_blocks [req-d15390ac-22ba-4293-9135-5176ef729353 req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] Transition to ACTIVE for port object 012af0ea-fa3b-4267-a4da-80c767055b16 will not be triggered until provisioned by entity L2. {{(pid=102560) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Feb 08 18:17:47.498331 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-d15390ac-22ba-4293-9135-5176ef729353 req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-64531588'] for port (012af0ea-fa3b-4267-a4da-80c767055b16), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:47.517352 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-a5661a0b-a30a-44e3-928c-e23192646e02 None None] Set router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 gateway port host: None {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:17:47.544171 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-708bc1e0-4a65-4dbb-8580-26be8135633f req-2287ef8e-0ff6-4165-9fcd-4cbe061b8374 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0560644 Feb 08 18:17:47.557652 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] Pushing event updated for resources: {'Port': ['ID=012af0ea-fa3b-4267-a4da-80c767055b16,revision_number=2']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:47.597832 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-a5661a0b-a30a-44e3-928c-e23192646e02 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'name': 'tempest-AttachVolumeTestJSON-997005721-router', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:17:46Z', 'revision_number': 6, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'gw_port_host': None}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:47.625584 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e25a1387-bd30-421d-9f68-457fa73904b2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (ae5f46f2-7729-4ab9-95e0-646bf67653f0), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:47.647512 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5661a0b-a30a-44e3-928c-e23192646e02 None None] The sync data for ids ['3c53cb16-5d43-40f1-a3a6-2ca2f7a42984'] in dv-cinder-773985-21-iscsi is: [{'id': '3c53cb16-5d43-40f1-a3a6-2ca2f7a42984', 'name': 'tempest-AttachVolumeTestJSON-997005721-router', 'tenant_id': '630172c388404c75bda3d0ba2d9d5834', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:10Z', 'updated_at': '2022-02-08T18:17:46Z', 'revision_number': 6, 'project_id': '630172c388404c75bda3d0ba2d9d5834', 'gw_port_host': None}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:17:47.689018 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e25a1387-bd30-421d-9f68-457fa73904b2 admin admin] Pushing event deleted for resources: {'Port': ['ID=ae5f46f2-7729-4ab9-95e0-646bf67653f0,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:47.772822 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e25a1387-bd30-421d-9f68-457fa73904b2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-560668'] for router_gateway (3c53cb16-5d43-40f1-a3a6-2ca2f7a42984), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:47.794673 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-d15390ac-22ba-4293-9135-5176ef729353 req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] Attempting to bind port 012af0ea-fa3b-4267-a4da-80c767055b16 on host hv-cinder-77398 for vnic_type normal with profile {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:17:47.795064 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-d15390ac-22ba-4293-9135-5176ef729353 req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] Attempting to bind port 012af0ea-fa3b-4267-a4da-80c767055b16 by drivers openvswitch,hyperv on host hv-cinder-77398 at level 0 using segments [{'id': '2daf4609-3228-47d5-8b2b-536e57ae3977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927'}] {{(pid=102560) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:17:47.795361 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d15390ac-22ba-4293-9135-5176ef729353 req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] Attempting to bind port 012af0ea-fa3b-4267-a4da-80c767055b16 on network ad3e14dd-35bd-4c6d-8d94-5b851458e927 {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:17:47.803914 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d15390ac-22ba-4293-9135-5176ef729353 req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] Port 012af0ea-fa3b-4267-a4da-80c767055b16 on network ad3e14dd-35bd-4c6d-8d94-5b851458e927 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77398 {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Feb 08 18:17:47.804271 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d15390ac-22ba-4293-9135-5176ef729353 req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] Attempting to bind port 012af0ea-fa3b-4267-a4da-80c767055b16 on network ad3e14dd-35bd-4c6d-8d94-5b851458e927 {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:17:47.813520 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d15390ac-22ba-4293-9135-5176ef729353 req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] Checking agent: {'id': '045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77398', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'started_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 17, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:17:47.813925 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d15390ac-22ba-4293-9135-5176ef729353 req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] Checking segment: {'id': '2daf4609-3228-47d5-8b2b-536e57ae3977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102560) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:17:47.814235 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d15390ac-22ba-4293-9135-5176ef729353 req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] Bound using segment: {'id': '2daf4609-3228-47d5-8b2b-536e57ae3977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927'} {{(pid=102560) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:17:47.814732 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.managers [req-d15390ac-22ba-4293-9135-5176ef729353 req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] Bound port: 012af0ea-fa3b-4267-a4da-80c767055b16, host: hv-cinder-77398, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '2daf4609-3228-47d5-8b2b-536e57ae3977', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1065, 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927'}}] {{(pid=102560) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:17:47.815184 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-d15390ac-22ba-4293-9135-5176ef729353 req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (012af0ea-fa3b-4267-a4da-80c767055b16), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:47.832994 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-6270d86d-a0cd-4b1a-bad4-e4276c24a6d1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:47.848789 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b295bc44-afa2-46f3-b74a-419f80d52cd0 req-35437121-710a-4bba-b4fe-fcf886b5075a tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:47.850253 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b295bc44-afa2-46f3-b74a-419f80d52cd0 req-35437121-710a-4bba-b4fe-fcf886b5075a tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 944 time: 0.1502154 Feb 08 18:17:47.913785 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e25a1387-bd30-421d-9f68-457fa73904b2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-557467', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6918'] for router (3c53cb16-5d43-40f1-a3a6-2ca2f7a42984), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:47.917029 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e25a1387-bd30-421d-9f68-457fa73904b2 admin admin] Publish callbacks [] for router_controller (3c53cb16-5d43-40f1-a3a6-2ca2f7a42984), precommit_delete_associations {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:47.946910 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b295bc44-afa2-46f3-b74a-419f80d52cd0 req-6e95bb2e-6fbf-4678-b409-b58bf6661d13 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0906241 Feb 08 18:17:47.947928 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-d15390ac-22ba-4293-9135-5176ef729353 req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] For port 012af0ea-fa3b-4267-a4da-80c767055b16, host hv-cinder-77398, cleared binding levels {{(pid=102560) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:17:47.952585 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-d15390ac-22ba-4293-9135-5176ef729353 req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] For port 012af0ea-fa3b-4267-a4da-80c767055b16, host hv-cinder-77398, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=012af0ea-fa3b-4267-a4da-80c767055b16,segment=NetworkSegment(2daf4609-3228-47d5-8b2b-536e57ae3977),segment_id=2daf4609-3228-47d5-8b2b-536e57ae3977)] {{(pid=102560) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:17:47.965305 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-d15390ac-22ba-4293-9135-5176ef729353 req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-64531588'] for port (012af0ea-fa3b-4267-a4da-80c767055b16), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:48.005875 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:48.007498 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e25a1387-bd30-421d-9f68-457fa73904b2 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-557452'] for router (3c53cb16-5d43-40f1-a3a6-2ca2f7a42984), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:48.008088 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e25a1387-bd30-421d-9f68-457fa73904b2 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 {{(pid=102559) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Feb 08 18:17:48.023491 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d15390ac-22ba-4293-9135-5176ef729353 req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:48.024356 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-d15390ac-22ba-4293-9135-5176ef729353 req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:48.025779 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d15390ac-22ba-4293-9135-5176ef729353 req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] 10.222.0.109 "PUT /v2.0/ports/012af0ea-fa3b-4267-a4da-80c767055b16 HTTP/1.1" status: 200 len: 1094 time: 1.0205863 Feb 08 18:17:48.031956 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd5ab9458-bd5e-49a0-b97b-1e388bb5af81', 'tag': '012af0ea-fa3b-4267-a4da-80c767055b16'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:17:48.034241 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-707957bf-989f-42bb-9c6b-c4be2bcbe960" -d '{"events": [{"name": "network-changed", "server_uuid": "d5ab9458-bd5e-49a0-b97b-1e388bb5af81", "tag": "012af0ea-fa3b-4267-a4da-80c767055b16"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:17:48.045445 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e25a1387-bd30-421d-9f68-457fa73904b2 admin admin] Publish callbacks [] for router (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:48.048559 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-e25a1387-bd30-421d-9f68-457fa73904b2 admin admin] 10.222.0.118 "DELETE /v2.0/routers/3c53cb16-5d43-40f1-a3a6-2ca2f7a42984 HTTP/1.1" status: 204 len: 168 time: 1.3821402 Feb 08 18:17:48.050585 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 42634) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:48.074348 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d4eb237-2015-43f4-bdc8-6584e6ef27ff service neutron] Pushing event updated for resources: {'Port': ['ID=012af0ea-fa3b-4267-a4da-80c767055b16,revision_number=3']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:48.133689 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_v2 [None req-6545f527-37fc-4ea4-aecf-cd9aa5670ea9 admin admin] Deleting subnet 86592955-e7d0-4e8a-9490-976e17240d7c {{(pid=102559) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Feb 08 18:17:48.139376 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6545f527-37fc-4ea4-aecf-cd9aa5670ea9 admin admin] Publish callbacks [] for subnet (86592955-e7d0-4e8a-9490-976e17240d7c), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:48.151960 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:17:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e18fed90-5535-49fc-b80d-c28ad6a534e6 x-openstack-request-id: req-e18fed90-5535-49fc-b80d-c28ad6a534e6 {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:17:48.152535 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d5ab9458-bd5e-49a0-b97b-1e388bb5af81", "tag": "012af0ea-fa3b-4267-a4da-80c767055b16", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:17:48.153033 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-e18fed90-5535-49fc-b80d-c28ad6a534e6 {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:17:48.153631 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd5ab9458-bd5e-49a0-b97b-1e388bb5af81', 'tag': '012af0ea-fa3b-4267-a4da-80c767055b16', 'status': 'completed', 'code': 200} Feb 08 18:17:48.185538 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d15390ac-22ba-4293-9135-5176ef729353 req-bfc1100f-8988-47a2-a035-750f07832edc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:48.187422 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d15390ac-22ba-4293-9135-5176ef729353 req-bfc1100f-8988-47a2-a035-750f07832edc service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=c504038b02a545d8a8b1873a4dfee655&device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 1128 time: 0.0918303 Feb 08 18:17:48.201122 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6545f527-37fc-4ea4-aecf-cd9aa5670ea9 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-63850237'] for subnet (86592955-e7d0-4e8a-9490-976e17240d7c), precommit_delete_associations {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:48.247329 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d15390ac-22ba-4293-9135-5176ef729353 req-35614f30-e073-412e-bcfb-939ad157280d service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=012af0ea-fa3b-4267-a4da-80c767055b16 HTTP/1.1" status: 200 len: 217 time: 0.0516322 Feb 08 18:17:48.312082 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d15390ac-22ba-4293-9135-5176ef729353 req-c54d0161-4b98-4b03-a072-f4019852f4aa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:48.313557 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d15390ac-22ba-4293-9135-5176ef729353 req-c54d0161-4b98-4b03-a072-f4019852f4aa service neutron] 10.222.0.109 "GET /v2.0/subnets?id=58f829ef-859d-415d-b810-791456a616fc HTTP/1.1" status: 200 len: 848 time: 0.0590470 Feb 08 18:17:48.385982 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6545f527-37fc-4ea4-aecf-cd9aa5670ea9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1801023'] for subnet (86592955-e7d0-4e8a-9490-976e17240d7c), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:48.393893 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d15390ac-22ba-4293-9135-5176ef729353 req-2ea48544-20cf-4ff9-80dd-b6c0198b542c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:48.396161 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d15390ac-22ba-4293-9135-5176ef729353 req-2ea48544-20cf-4ff9-80dd-b6c0198b542c service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=ad3e14dd-35bd-4c6d-8d94-5b851458e927&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0694582 Feb 08 18:17:48.444160 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6545f527-37fc-4ea4-aecf-cd9aa5670ea9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1801156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-63856520', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-63685312'] for subnet (86592955-e7d0-4e8a-9490-976e17240d7c), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:48.475350 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6545f527-37fc-4ea4-aecf-cd9aa5670ea9 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=86592955-e7d0-4e8a-9490-976e17240d7c,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:48.490655 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6545f527-37fc-4ea4-aecf-cd9aa5670ea9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:48.496760 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-6545f527-37fc-4ea4-aecf-cd9aa5670ea9 admin admin] 10.222.0.118 "DELETE /v2.0/subnets/86592955-e7d0-4e8a-9490-976e17240d7c HTTP/1.1" status: 204 len: 168 time: 0.4432340 Feb 08 18:17:48.498530 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d15390ac-22ba-4293-9135-5176ef729353 req-72deef25-4883-49eb-bb78-74f7ff2cb5dd service neutron] 10.222.0.109 "GET /v2.0/networks/ad3e14dd-35bd-4c6d-8d94-5b851458e927?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0948646 Feb 08 18:17:48.502045 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 42636) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:48.507467 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e2db400a-7317-4100-9dad-55ed7bf65724 None None] Network e430084e-9b28-426f-9937-61346814b135 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:17:48.629808 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:48.783920 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6fda100c-10e2-4123-9a53-32f37971353e None None] DHCP port deletion for e430084e-9b28-426f-9937-61346814b135 request from dv-cinder-773985-21-iscsi {{(pid=102561) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Feb 08 18:17:48.850852 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-6fda100c-10e2-4123-9a53-32f37971353e None None] Deleting port e32a7e0c-0045-4331-a9ac-7dc7ba90cadf {{(pid=102561) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:17:48.851987 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-6fda100c-10e2-4123-9a53-32f37971353e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (e32a7e0c-0045-4331-a9ac-7dc7ba90cadf), before_delete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:48.948145 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-6fda100c-10e2-4123-9a53-32f37971353e None None] For port e32a7e0c-0045-4331-a9ac-7dc7ba90cadf, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=e32a7e0c-0045-4331-a9ac-7dc7ba90cadf,segment=NetworkSegment(acdceaea-bf94-4e23-8e9f-0f5d9197e75f),segment_id=acdceaea-bf94-4e23-8e9f-0f5d9197e75f)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:17:48.948547 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-6fda100c-10e2-4123-9a53-32f37971353e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (e32a7e0c-0045-4331-a9ac-7dc7ba90cadf), precommit_delete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:48.963608 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-6fda100c-10e2-4123-9a53-32f37971353e None None] Calling delete_port for e32a7e0c-0045-4331-a9ac-7dc7ba90cadf owned by network:dhcp {{(pid=102561) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:17:49.030845 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1113e648-f84f-4c20-a99d-b5e12de5d33d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1860329'] for network (e430084e-9b28-426f-9937-61346814b135), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:49.144502 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-6fda100c-10e2-4123-9a53-32f37971353e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442'] for port (e32a7e0c-0045-4331-a9ac-7dc7ba90cadf), after_delete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:49.155944 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0d3b580-baeb-41c4-aead-b2a4191a50cc req-31eed40a-3c53-427b-ba03-3d04b083951d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:49.157627 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b0d3b580-baeb-41c4-aead-b2a4191a50cc req-31eed40a-3c53-427b-ba03-3d04b083951d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.2492597 Feb 08 18:17:49.158849 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19100f3f-bc2b-46f1-8930-3f012ece6a7e req-905380ad-9a3f-40d1-a2e6-ea76b5c281b4 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:49.163856 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6fda100c-10e2-4123-9a53-32f37971353e None None] No DVR routers for this DVR port e32a7e0c-0045-4331-a9ac-7dc7ba90cadf on host dv-cinder-773985-21-iscsi {{(pid=102561) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:17:49.164479 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d15390ac-22ba-4293-9135-5176ef729353 req-eec90878-ab44-4488-8893-9dca91ecb47e service neutron] 10.222.0.109 "GET /v2.0/networks/ad3e14dd-35bd-4c6d-8d94-5b851458e927?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5688806 Feb 08 18:17:49.169224 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-19100f3f-bc2b-46f1-8930-3f012ece6a7e req-905380ad-9a3f-40d1-a2e6-ea76b5c281b4 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 944 time: 0.0947254 Feb 08 18:17:49.210603 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fda100c-10e2-4123-9a53-32f37971353e None None] Pushing event deleted for resources: {'Port': ['ID=e32a7e0c-0045-4331-a9ac-7dc7ba90cadf,revision_number=None']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:49.234920 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-1113e648-f84f-4c20-a99d-b5e12de5d33d admin admin] Deleting port e32a7e0c-0045-4331-a9ac-7dc7ba90cadf {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:17:49.235264 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1113e648-f84f-4c20-a99d-b5e12de5d33d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (e32a7e0c-0045-4331-a9ac-7dc7ba90cadf), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:49.239839 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b0d3b580-baeb-41c4-aead-b2a4191a50cc req-82bdabc6-e50e-437b-80be-92daba5ad29c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0744007 Feb 08 18:17:49.260172 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-19100f3f-bc2b-46f1-8930-3f012ece6a7e req-9405fd9c-340f-402b-9206-8fe85d259c20 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0775204 Feb 08 18:17:49.344765 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [None req-1113e648-f84f-4c20-a99d-b5e12de5d33d admin admin] For port e32a7e0c-0045-4331-a9ac-7dc7ba90cadf, host dv-cinder-773985-21-iscsi, got binding levels [] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:17:49.345139 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1113e648-f84f-4c20-a99d-b5e12de5d33d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (e32a7e0c-0045-4331-a9ac-7dc7ba90cadf), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:49.365246 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-1113e648-f84f-4c20-a99d-b5e12de5d33d admin admin] Calling delete_port for e32a7e0c-0045-4331-a9ac-7dc7ba90cadf owned by network:dhcp {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:17:49.369279 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.ipam_backend_mixin [None req-1113e648-f84f-4c20-a99d-b5e12de5d33d admin admin] Port e32a7e0c-0045-4331-a9ac-7dc7ba90cadf was not found and therefore no delete operation was performed {{(pid=102560) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Feb 08 18:17:49.372480 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-707957bf-989f-42bb-9c6b-c4be2bcbe960 req-8c6fd0fd-ccd6-4b9e-8837-c1f184f1a02e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:49.374002 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-707957bf-989f-42bb-9c6b-c4be2bcbe960 req-8c6fd0fd-ccd6-4b9e-8837-c1f184f1a02e service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=c504038b02a545d8a8b1873a4dfee655&device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 1128 time: 0.1324716 Feb 08 18:17:49.374737 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1113e648-f84f-4c20-a99d-b5e12de5d33d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (e32a7e0c-0045-4331-a9ac-7dc7ba90cadf), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:49.416472 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1113e648-f84f-4c20-a99d-b5e12de5d33d admin admin] Pushing event deleted for resources: {'Port': ['ID=e32a7e0c-0045-4331-a9ac-7dc7ba90cadf,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:49.454974 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1113e648-f84f-4c20-a99d-b5e12de5d33d admin admin] No DVR routers for this DVR port e32a7e0c-0045-4331-a9ac-7dc7ba90cadf on host dv-cinder-773985-21-iscsi {{(pid=102560) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:17:49.543983 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1113e648-f84f-4c20-a99d-b5e12de5d33d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1721768', 'neutron.services.segments.db._delete_segments_for_network-8770558865089'] for network (e430084e-9b28-426f-9937-61346814b135), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:49.573138 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-707957bf-989f-42bb-9c6b-c4be2bcbe960 req-8bb23174-59dd-471e-9c55-d10c587fa85c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:49.575939 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-707957bf-989f-42bb-9c6b-c4be2bcbe960 req-8bb23174-59dd-471e-9c55-d10c587fa85c service neutron] 10.222.0.109 "GET /v2.0/networks?id=ad3e14dd-35bd-4c6d-8d94-5b851458e927 HTTP/1.1" status: 200 len: 911 time: 0.1768231 Feb 08 18:17:49.581675 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-1113e648-f84f-4c20-a99d-b5e12de5d33d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e430084e-9b28-426f-9937-61346814b135']}} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:49.598337 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-1113e648-f84f-4c20-a99d-b5e12de5d33d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'acdceaea-bf94-4e23-8e9f-0f5d9197e75f') {'for_net_delete': True} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:49.598633 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-1113e648-f84f-4c20-a99d-b5e12de5d33d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'acdceaea-bf94-4e23-8e9f-0f5d9197e75f') {} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:17:49.633913 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-707957bf-989f-42bb-9c6b-c4be2bcbe960 req-2b4727f5-f86c-4a0a-a556-ee822d856b08 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=012af0ea-fa3b-4267-a4da-80c767055b16 HTTP/1.1" status: 200 len: 217 time: 0.0496898 Feb 08 18:17:49.637261 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1113e648-f84f-4c20-a99d-b5e12de5d33d admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8770558866122', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-64533840'] for segment (acdceaea-bf94-4e23-8e9f-0f5d9197e75f), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:49.676531 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1113e648-f84f-4c20-a99d-b5e12de5d33d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (acdceaea-bf94-4e23-8e9f-0f5d9197e75f), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:49.688512 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1113e648-f84f-4c20-a99d-b5e12de5d33d admin admin] Releasing vlan 1082 on physical network physnet1 to pool {{(pid=102560) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Feb 08 18:17:49.688972 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1113e648-f84f-4c20-a99d-b5e12de5d33d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-64531704'] for segment (acdceaea-bf94-4e23-8e9f-0f5d9197e75f), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: Traceback (most recent call last): Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: timer() Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: cb(*args, **kw) Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: return func(*args, **kwargs) Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: self._notify() Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: self.callback(batched_events) Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: event.method(event) Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: aggregate_uuid = self.p_client.list_aggregates( Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: return f(self, *a, **k) Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: return self._get(url).json() Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: return self._client.get(url, endpoint_filter=self._ks_filter, Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: return self.request(url, 'GET', **kwargs) Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: base_url = self.get_endpoint(auth, allow=allow, Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 08 18:17:49.690651 dv-cinder-773985-21-iscsi neutron-server[102560]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 08 18:17:49.739747 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-707957bf-989f-42bb-9c6b-c4be2bcbe960 req-4df4d27b-4c35-488e-8c89-a9b879d0b211 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:49.740949 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-707957bf-989f-42bb-9c6b-c4be2bcbe960 req-4df4d27b-4c35-488e-8c89-a9b879d0b211 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=58f829ef-859d-415d-b810-791456a616fc HTTP/1.1" status: 200 len: 848 time: 0.0974698 Feb 08 18:17:49.751082 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device fe9dfbe9-83a8-472c-b3a3-9537d424939b no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:17:49.771706 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: fe9dfbe9-83a8-472c-b3a3-9537d424939b {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:17:49.772044 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device fe9dfbe9-83a8-472c-b3a3-9537d424939b not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:17:49.772458 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device e32a7e0c-0045-4331-a9ac-7dc7ba90cadf no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:17:49.781054 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1113e648-f84f-4c20-a99d-b5e12de5d33d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1721777', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-560760'] for network (e430084e-9b28-426f-9937-61346814b135), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:49.786562 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1113e648-f84f-4c20-a99d-b5e12de5d33d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:49.789778 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-1113e648-f84f-4c20-a99d-b5e12de5d33d admin admin] 10.222.0.118 "DELETE /v2.0/networks/e430084e-9b28-426f-9937-61346814b135 HTTP/1.1" status: 204 len: 168 time: 1.2866321 Feb 08 18:17:49.791504 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: e32a7e0c-0045-4331-a9ac-7dc7ba90cadf {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:17:49.791846 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device e32a7e0c-0045-4331-a9ac-7dc7ba90cadf not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:17:49.792336 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device ae5f46f2-7729-4ab9-95e0-646bf67653f0 no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:17:49.804375 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1113e648-f84f-4c20-a99d-b5e12de5d33d admin admin] Pushing event deleted for resources: {'Network': ['ID=e430084e-9b28-426f-9937-61346814b135,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:49.815579 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-707957bf-989f-42bb-9c6b-c4be2bcbe960 req-df8734d7-1a41-4fb4-90f6-3b8bf8a803f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:49.816249 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: ae5f46f2-7729-4ab9-95e0-646bf67653f0 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:17:49.816594 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device ae5f46f2-7729-4ab9-95e0-646bf67653f0 not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:17:49.817098 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-707957bf-989f-42bb-9c6b-c4be2bcbe960 req-df8734d7-1a41-4fb4-90f6-3b8bf8a803f3 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=ad3e14dd-35bd-4c6d-8d94-5b851458e927&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0694132 Feb 08 18:17:49.907716 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 42660) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:49.910153 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-707957bf-989f-42bb-9c6b-c4be2bcbe960 req-2f8a572f-bc99-46a1-8e4f-c37bf63e45b1 service neutron] 10.222.0.109 "GET /v2.0/networks/ad3e14dd-35bd-4c6d-8d94-5b851458e927?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0830567 Feb 08 18:17:49.946955 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-012dd956-82db-4293-847c-2e9658b6ea9b admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=630172c388404c75bda3d0ba2d9d5834&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0380428 Feb 08 18:17:49.949571 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 42662) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:49.995806 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-dcb7daad-9f77-408d-ab8b-be241c6bef5e admin admin] Publish callbacks [] for security_group (bac1a928-adf4-482b-b92b-1646f13f5125), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:50.005684 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-707957bf-989f-42bb-9c6b-c4be2bcbe960 req-4e0929cc-d425-4443-8890-4e9bf9e64d13 service neutron] 10.222.0.109 "GET /v2.0/networks/ad3e14dd-35bd-4c6d-8d94-5b851458e927?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0858796 Feb 08 18:17:50.016606 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-dcb7daad-9f77-408d-ab8b-be241c6bef5e admin admin] Publish callbacks [] for security_group (bac1a928-adf4-482b-b92b-1646f13f5125), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:50.068725 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-dcb7daad-9f77-408d-ab8b-be241c6bef5e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (bac1a928-adf4-482b-b92b-1646f13f5125), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:50.072619 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-dcb7daad-9f77-408d-ab8b-be241c6bef5e admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:50.076602 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-dcb7daad-9f77-408d-ab8b-be241c6bef5e admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/bac1a928-adf4-482b-b92b-1646f13f5125 HTTP/1.1" status: 204 len: 168 time: 0.1232581 Feb 08 18:17:50.083193 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcb7daad-9f77-408d-ab8b-be241c6bef5e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bac1a928-adf4-482b-b92b-1646f13f5125,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:50.119524 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:50.361618 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d39c1d56-ef8f-4610-a7aa-a5e5478e6f41 req-453ef6cd-5be4-4de5-8d0e-8ff07e6560c0 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:50.363062 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52c914c0-4f15-4c1b-aebe-cee31488f0a7 req-bc48d8c7-398a-483b-a5a7-944dd47ae422 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:50.363977 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d39c1d56-ef8f-4610-a7aa-a5e5478e6f41 req-453ef6cd-5be4-4de5-8d0e-8ff07e6560c0 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 944 time: 0.0584555 Feb 08 18:17:50.364552 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-52c914c0-4f15-4c1b-aebe-cee31488f0a7 req-bc48d8c7-398a-483b-a5a7-944dd47ae422 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=357dab3d3db74ef9a8ee50fdd8a8bdcd&device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 1129 time: 0.0823634 Feb 08 18:17:50.417339 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d39c1d56-ef8f-4610-a7aa-a5e5478e6f41 req-0c6fc45f-20dd-4386-ad1b-ee823fb5f28c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0470555 Feb 08 18:17:50.485255 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-117cc112-5b0a-4218-bd41-e718baec6190 req-9c2d90c3-8beb-4737-9a71-672b0b2a038f tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:50.486708 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-117cc112-5b0a-4218-bd41-e718baec6190 req-9c2d90c3-8beb-4737-9a71-672b0b2a038f tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.1212800 Feb 08 18:17:50.508148 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52c914c0-4f15-4c1b-aebe-cee31488f0a7 req-3d8a6337-00d8-45c2-886b-d300bd5c2332 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:50.509566 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-52c914c0-4f15-4c1b-aebe-cee31488f0a7 req-3d8a6337-00d8-45c2-886b-d300bd5c2332 service neutron] 10.222.0.109 "GET /v2.0/networks?id=7a854399-3ce6-42bd-bfc4-061132ecb9c2 HTTP/1.1" status: 200 len: 918 time: 0.1354539 Feb 08 18:17:50.577129 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-117cc112-5b0a-4218-bd41-e718baec6190 req-3d2b7623-b73e-4a78-a005-2497b863a51f tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0845721 Feb 08 18:17:50.604446 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-52c914c0-4f15-4c1b-aebe-cee31488f0a7 req-885d7a46-bd54-41c4-be30-e5cef7c68a52 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=50b2e85d-5914-4f54-9939-14603e53f04e HTTP/1.1" status: 200 len: 1000 time: 0.0874460 Feb 08 18:17:50.653935 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52c914c0-4f15-4c1b-aebe-cee31488f0a7 req-1de0e05a-c5a4-42b2-a79f-c02090eab5a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:50.655476 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-52c914c0-4f15-4c1b-aebe-cee31488f0a7 req-1de0e05a-c5a4-42b2-a79f-c02090eab5a8 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=73de7865-d87d-4a2a-a702-160c400f145f HTTP/1.1" status: 200 len: 855 time: 0.0437424 Feb 08 18:17:50.704122 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52c914c0-4f15-4c1b-aebe-cee31488f0a7 req-9d0d23ba-2ace-440d-8491-e304f6e9c64d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:50.705479 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-52c914c0-4f15-4c1b-aebe-cee31488f0a7 req-9d0d23ba-2ace-440d-8491-e304f6e9c64d service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=7a854399-3ce6-42bd-bfc4-061132ecb9c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0435431 Feb 08 18:17:50.796072 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-52c914c0-4f15-4c1b-aebe-cee31488f0a7 req-b5d6e0cf-acf6-4027-83d5-ee43a9e63104 service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0841694 Feb 08 18:17:50.881815 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-52c914c0-4f15-4c1b-aebe-cee31488f0a7 req-ec9593b4-0cab-483c-872d-410db0c1e360 service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0798075 Feb 08 18:17:51.549517 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04001228-31d6-4c8c-8aae-8bd7ddd39977 req-3e2fbbd3-c0d0-4741-9881-bb01a895901d tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:51.550996 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-04001228-31d6-4c8c-8aae-8bd7ddd39977 req-3e2fbbd3-c0d0-4741-9881-bb01a895901d tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 944 time: 0.0549176 Feb 08 18:17:51.616164 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-04001228-31d6-4c8c-8aae-8bd7ddd39977 req-051b6318-d7d4-4c0c-a9a0-7cda1c0830fe tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0562117 Feb 08 18:17:51.662659 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:51.710244 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75c8f385-d23b-42d5-b3ad-0e8e8f86032c req-bf9a3deb-3617-4136-80d4-9d24d2b2259e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:51.711647 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-75c8f385-d23b-42d5-b3ad-0e8e8f86032c req-bf9a3deb-3617-4136-80d4-9d24d2b2259e tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0538948 Feb 08 18:17:51.761023 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-75c8f385-d23b-42d5-b3ad-0e8e8f86032c req-467fe4ee-5e0f-4f29-83d0-5252ad52aafc tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436876 Feb 08 18:17:52.737879 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-373b7e09-f359-4119-bd00-fddb24a60184 req-7b5b354b-f454-4fd6-b33f-ca6a14b90502 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:52.739413 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-373b7e09-f359-4119-bd00-fddb24a60184 req-7b5b354b-f454-4fd6-b33f-ca6a14b90502 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 944 time: 0.0547991 Feb 08 18:17:52.789661 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-373b7e09-f359-4119-bd00-fddb24a60184 req-10206b0f-1bc3-4973-bfda-3ffe1aee5faf tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445302 Feb 08 18:17:52.902403 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cd95bff-bd5b-4b41-8575-bd4b40075efc req-499081ab-5b24-4989-8780-74806c1a5b3a tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:52.903892 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-4cd95bff-bd5b-4b41-8575-bd4b40075efc req-499081ab-5b24-4989-8780-74806c1a5b3a tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 945 time: 0.0611968 Feb 08 18:17:52.955100 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-4cd95bff-bd5b-4b41-8575-bd4b40075efc req-cc89b3ee-22f6-4475-8927-36593e9ff5b9 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429246 Feb 08 18:17:53.919870 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56d9c77a-ec54-4ba8-9919-c593334ca942 req-1e27c854-df18-49fb-a501-c17e9c0a132b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:53.921761 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-56d9c77a-ec54-4ba8-9919-c593334ca942 req-1e27c854-df18-49fb-a501-c17e9c0a132b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 944 time: 0.0539672 Feb 08 18:17:53.968971 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-56d9c77a-ec54-4ba8-9919-c593334ca942 req-7722ce93-e394-4dc2-bb1c-a35f05eba032 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0414419 Feb 08 18:17:54.356185 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 50b2e85d-5914-4f54-9939-14603e53f04e no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:17:54.436454 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 50b2e85d-5914-4f54-9939-14603e53f04e is: ACTIVE; New status is: DOWN {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:54.436844 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:54.462263 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '097f7b21-9f4e-4341-831a-307f6b722f44', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '50b2e85d-5914-4f54-9939-14603e53f04e'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:17:54.464533 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ca40434c-0cdd-4480-ac20-9e362d04c0fb" -d '{"events": [{"server_uuid": "097f7b21-9f4e-4341-831a-307f6b722f44", "name": "network-vif-unplugged", "status": "completed", "tag": "50b2e85d-5914-4f54-9939-14603e53f04e"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:17:54.477120 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 50b2e85d-5914-4f54-9939-14603e53f04e, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=50b2e85d-5914-4f54-9939-14603e53f04e,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:17:54.482705 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:54.529473 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=50b2e85d-5914-4f54-9939-14603e53f04e,revision_number=8']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:54.558326 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [207] Connection: close Content-Length: 182 Content-Type: application/json Date: Tue, 08 Feb 2022 18:17:54 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-451cd70a-bc45-4094-906c-cdf4fb4a9953 x-openstack-request-id: req-451cd70a-bc45-4094-906c-cdf4fb4a9953 {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:17:54.558618 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "097f7b21-9f4e-4341-831a-307f6b722f44", "name": "network-vif-unplugged", "status": "failed", "tag": "50b2e85d-5914-4f54-9939-14603e53f04e", "code": 422}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:17:54.558896 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-451cd70a-bc45-4094-906c-cdf4fb4a9953 {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:17:54.559303 dv-cinder-773985-21-iscsi neutron-server[102561]: WARNING neutron.notifiers.nova [-] Nova event: {'server_uuid': '097f7b21-9f4e-4341-831a-307f6b722f44', 'name': 'network-vif-unplugged', 'status': 'failed', 'tag': '50b2e85d-5914-4f54-9939-14603e53f04e', 'code': 422} returned with failed status Feb 08 18:17:55.100656 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49bbad17-cdee-4209-8781-9bd493da8286 req-8f1dfb76-7a9a-4eb5-89d9-cfc8943b84b2 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:55.102102 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-49bbad17-cdee-4209-8781-9bd493da8286 req-8f1dfb76-7a9a-4eb5-89d9-cfc8943b84b2 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 944 time: 0.0639088 Feb 08 18:17:55.152101 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-49bbad17-cdee-4209-8781-9bd493da8286 req-43a73800-ead3-4102-bc40-279aa96d67f9 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418167 Feb 08 18:17:55.579156 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ebc707a-ece7-417a-9bde-89dec6aadcb6 req-5ca745db-eb1f-48e0-9e8b-4d294647d32b tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:55.580913 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6ebc707a-ece7-417a-9bde-89dec6aadcb6 req-5ca745db-eb1f-48e0-9e8b-4d294647d32b tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 943 time: 0.0539179 Feb 08 18:17:55.627364 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6ebc707a-ece7-417a-9bde-89dec6aadcb6 req-f005ca69-4bc3-4e31-ba2a-106deffb4063 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404041 Feb 08 18:17:55.851085 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 42804) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:55.941811 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8baee9ba-7d6d-4018-b161-fe99c8d641d6 req-4f1dc35a-56c2-4ee2-810a-f769138c2ca4 service neutron] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0895298 Feb 08 18:17:55.950409 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [req-8baee9ba-7d6d-4018-b161-fe99c8d641d6 req-5c588060-c618-4dc1-9fbd-40b513f7bbb8 service neutron] http://10.222.0.118:9696/v2.0/extensions returned with HTTP 200 {{(pid=102560) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 08 18:17:55.951399 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8baee9ba-7d6d-4018-b161-fe99c8d641d6 req-5c588060-c618-4dc1-9fbd-40b513f7bbb8 service neutron] 10.222.0.118 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0049155 Feb 08 18:17:56.272595 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a98f353f-f31b-4d41-95be-39611a8b7034 req-f2f556ce-b1bd-407d-8ecb-98cbc6f4a2fb tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:56.274104 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a98f353f-f31b-4d41-95be-39611a8b7034 req-f2f556ce-b1bd-407d-8ecb-98cbc6f4a2fb tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 944 time: 0.0543637 Feb 08 18:17:56.346200 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a98f353f-f31b-4d41-95be-39611a8b7034 req-b3c4eada-a0d8-4fd1-892b-677a660c0aa0 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0633206 Feb 08 18:17:56.826737 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53ceca3e-614e-4c05-bead-c530ea80a9c7 req-63dd9966-de9a-4027-9bac-548465939b23 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:56.828232 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-53ceca3e-614e-4c05-bead-c530ea80a9c7 req-63dd9966-de9a-4027-9bac-548465939b23 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 943 time: 0.1136014 Feb 08 18:17:56.837206 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8baee9ba-7d6d-4018-b161-fe99c8d641d6 req-2965837a-596d-4b52-aadb-874e40f0bc09 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:56.838585 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8baee9ba-7d6d-4018-b161-fe99c8d641d6 req-2965837a-596d-4b52-aadb-874e40f0bc09 service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44&tenant_id=357dab3d3db74ef9a8ee50fdd8a8bdcd HTTP/1.1" status: 200 len: 1127 time: 0.0969982 Feb 08 18:17:56.901907 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-53ceca3e-614e-4c05-bead-c530ea80a9c7 req-0ad1a40c-e063-4ad6-8479-c599a447b470 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0673008 Feb 08 18:17:56.917129 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8baee9ba-7d6d-4018-b161-fe99c8d641d6 req-6785a7b8-966e-43ed-810c-aa26680f26f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:56.918589 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8baee9ba-7d6d-4018-b161-fe99c8d641d6 req-6785a7b8-966e-43ed-810c-aa26680f26f2 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=357dab3d3db74ef9a8ee50fdd8a8bdcd&device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 1127 time: 0.0558453 Feb 08 18:17:57.014996 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8baee9ba-7d6d-4018-b161-fe99c8d641d6 req-f33748dd-d5f0-4d4c-b5d7-eda220f0bab7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:57.016470 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8baee9ba-7d6d-4018-b161-fe99c8d641d6 req-f33748dd-d5f0-4d4c-b5d7-eda220f0bab7 service neutron] 10.222.0.109 "GET /v2.0/networks?id=7a854399-3ce6-42bd-bfc4-061132ecb9c2 HTTP/1.1" status: 200 len: 918 time: 0.0924540 Feb 08 18:17:57.084346 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8baee9ba-7d6d-4018-b161-fe99c8d641d6 req-d4df1df8-affe-493e-878b-25a73b977ba0 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=50b2e85d-5914-4f54-9939-14603e53f04e HTTP/1.1" status: 200 len: 998 time: 0.0612199 Feb 08 18:17:57.141091 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8baee9ba-7d6d-4018-b161-fe99c8d641d6 req-40be951b-9116-4d69-be77-0ef427b24afb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:57.143161 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8baee9ba-7d6d-4018-b161-fe99c8d641d6 req-40be951b-9116-4d69-be77-0ef427b24afb service neutron] 10.222.0.109 "GET /v2.0/subnets?id=73de7865-d87d-4a2a-a702-160c400f145f HTTP/1.1" status: 200 len: 855 time: 0.0514781 Feb 08 18:17:57.196327 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8baee9ba-7d6d-4018-b161-fe99c8d641d6 req-ae6f1fa3-1f89-4699-a8c6-9bf30414db80 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:57.197827 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8baee9ba-7d6d-4018-b161-fe99c8d641d6 req-ae6f1fa3-1f89-4699-a8c6-9bf30414db80 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=7a854399-3ce6-42bd-bfc4-061132ecb9c2&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0486710 Feb 08 18:17:57.284428 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8baee9ba-7d6d-4018-b161-fe99c8d641d6 req-3767cc92-87c9-4cde-860d-545eab862e2a service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0807633 Feb 08 18:17:57.382997 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8baee9ba-7d6d-4018-b161-fe99c8d641d6 req-45deaabb-4e51-40b1-a838-d8e3dd3b884e service neutron] 10.222.0.109 "GET /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0920191 Feb 08 18:17:57.437042 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 012af0ea-fa3b-4267-a4da-80c767055b16 details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:17:57.472701 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92f7dc01-a9ed-4c24-abf2-151c455450ab req-02115af5-9ea9-4c71-bd17-80eb91bb19ed tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:57.474172 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-92f7dc01-a9ed-4c24-abf2-151c455450ab req-02115af5-9ea9-4c71-bd17-80eb91bb19ed tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 944 time: 0.0539694 Feb 08 18:17:57.523020 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-92f7dc01-a9ed-4c24-abf2-151c455450ab req-5bb1fd3f-af83-4910-9a2a-7551f78a00d3 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0428517 Feb 08 18:17:57.544343 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 012af0ea-fa3b-4267-a4da-80c767055b16, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=012af0ea-fa3b-4267-a4da-80c767055b16,segment=NetworkSegment(2daf4609-3228-47d5-8b2b-536e57ae3977),segment_id=2daf4609-3228-47d5-8b2b-536e57ae3977)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:17:57.555570 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': '012af0ea-fa3b-4267-a4da-80c767055b16', 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927', 'port_id': '012af0ea-fa3b-4267-a4da-80c767055b16', 'mac_address': 'fa:16:3e:4c:d6:fc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1065, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '58f829ef-859d-415d-b810-791456a616fc', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:17:57.591448 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 012af0ea-fa3b-4267-a4da-80c767055b16 is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:57.591839 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (012af0ea-fa3b-4267-a4da-80c767055b16), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:57.604902 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 012af0ea-fa3b-4267-a4da-80c767055b16 {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:17:57.623681 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 012af0ea-fa3b-4267-a4da-80c767055b16, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=012af0ea-fa3b-4267-a4da-80c767055b16,segment=NetworkSegment(2daf4609-3228-47d5-8b2b-536e57ae3977),segment_id=2daf4609-3228-47d5-8b2b-536e57ae3977)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:17:57.627633 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (012af0ea-fa3b-4267-a4da-80c767055b16), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:57.678847 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=012af0ea-fa3b-4267-a4da-80c767055b16,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:57.841726 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['012af0ea-fa3b-4267-a4da-80c767055b16'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:17:58.111181 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12130a68-f328-4ad8-a603-159144fcc023 req-e07f038a-fa16-4478-b8e4-442fe4461af3 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:58.112680 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-12130a68-f328-4ad8-a603-159144fcc023 req-e07f038a-fa16-4478-b8e4-442fe4461af3 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 943 time: 0.1226084 Feb 08 18:17:58.227809 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-12130a68-f328-4ad8-a603-159144fcc023 req-df89d23c-8d25-4524-9218-89bf7a3121dc tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1057158 Feb 08 18:17:58.557266 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 42872) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:58.664930 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80502a3f-6a1e-4e8f-b699-2e5a44bee72a req-ac622d34-8a57-47d4-add3-a976132989eb tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:58.666304 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-80502a3f-6a1e-4e8f-b699-2e5a44bee72a req-ac622d34-8a57-47d4-add3-a976132989eb tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 945 time: 0.0619373 Feb 08 18:17:58.687024 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-408bd1f2-7e0a-4b17-9e78-0835dc66dd84 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:58.743674 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-80502a3f-6a1e-4e8f-b699-2e5a44bee72a req-8e31b702-3316-40ce-9950-d1451118d79e tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0694306 Feb 08 18:17:58.808217 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-408bd1f2-7e0a-4b17-9e78-0835dc66dd84 admin admin] Publish callbacks [] for security_group (e6c2120e-1909-4f9c-8b20-d4fc3b1d21f7), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:58.812784 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-408bd1f2-7e0a-4b17-9e78-0835dc66dd84 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (e6c2120e-1909-4f9c-8b20-d4fc3b1d21f7), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:58.852413 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-408bd1f2-7e0a-4b17-9e78-0835dc66dd84 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=becdadd680874fa1915d2bd2ee5f48da&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2939608 Feb 08 18:17:58.853124 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-408bd1f2-7e0a-4b17-9e78-0835dc66dd84 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e6c2120e-1909-4f9c-8b20-d4fc3b1d21f7,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:58.855120 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 42876) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:17:58.905683 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-acb09a76-03ca-4d97-967f-ff35ba581d18 admin admin] Publish callbacks [] for security_group (e6c2120e-1909-4f9c-8b20-d4fc3b1d21f7), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:58.929505 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-acb09a76-03ca-4d97-967f-ff35ba581d18 admin admin] Publish callbacks [] for security_group (e6c2120e-1909-4f9c-8b20-d4fc3b1d21f7), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:58.978877 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-acb09a76-03ca-4d97-967f-ff35ba581d18 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (e6c2120e-1909-4f9c-8b20-d4fc3b1d21f7), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:58.981518 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-acb09a76-03ca-4d97-967f-ff35ba581d18 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:58.982724 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-acb09a76-03ca-4d97-967f-ff35ba581d18 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/e6c2120e-1909-4f9c-8b20-d4fc3b1d21f7 HTTP/1.1" status: 204 len: 168 time: 0.1266220 Feb 08 18:17:58.991172 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acb09a76-03ca-4d97-967f-ff35ba581d18 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e6c2120e-1909-4f9c-8b20-d4fc3b1d21f7,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:59.392359 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-166863de-bde2-4c2c-9218-eed0ec97da8a req-d09fbb4a-3ce1-4f09-b155-9f063dcad346 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:59.393861 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-166863de-bde2-4c2c-9218-eed0ec97da8a req-d09fbb4a-3ce1-4f09-b155-9f063dcad346 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 943 time: 0.0635960 Feb 08 18:17:59.453345 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-166863de-bde2-4c2c-9218-eed0ec97da8a req-4338fa05-299e-45c7-8ddd-4da481e6abf1 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0536358 Feb 08 18:17:59.458248 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 012af0ea-fa3b-4267-a4da-80c767055b16 up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:17:59.545187 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning for port 012af0ea-fa3b-4267-a4da-80c767055b16 completed by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Feb 08 18:17:59.559257 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port 012af0ea-fa3b-4267-a4da-80c767055b16 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:17:59.559814 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (012af0ea-fa3b-4267-a4da-80c767055b16), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:59.681767 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 012af0ea-fa3b-4267-a4da-80c767055b16 is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:17:59.682280 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (012af0ea-fa3b-4267-a4da-80c767055b16), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:59.711489 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd5ab9458-bd5e-49a0-b97b-1e388bb5af81', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '012af0ea-fa3b-4267-a4da-80c767055b16'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:17:59.714092 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e6b38703-030b-4172-a9f1-bee8280446ba" -d '{"events": [{"server_uuid": "d5ab9458-bd5e-49a0-b97b-1e388bb5af81", "name": "network-vif-plugged", "status": "completed", "tag": "012af0ea-fa3b-4267-a4da-80c767055b16"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:17:59.748642 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 012af0ea-fa3b-4267-a4da-80c767055b16, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=012af0ea-fa3b-4267-a4da-80c767055b16,segment=NetworkSegment(2daf4609-3228-47d5-8b2b-536e57ae3977),segment_id=2daf4609-3228-47d5-8b2b-536e57ae3977)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:17:59.754400 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (012af0ea-fa3b-4267-a4da-80c767055b16), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:17:59.784032 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:17:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e30b1482-c91d-44e0-9e5b-77cfd8fbe9cb x-openstack-request-id: req-e30b1482-c91d-44e0-9e5b-77cfd8fbe9cb {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:17:59.784320 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d5ab9458-bd5e-49a0-b97b-1e388bb5af81", "name": "network-vif-plugged", "status": "completed", "tag": "012af0ea-fa3b-4267-a4da-80c767055b16", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:17:59.784567 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-e30b1482-c91d-44e0-9e5b-77cfd8fbe9cb {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:17:59.784949 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd5ab9458-bd5e-49a0-b97b-1e388bb5af81', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '012af0ea-fa3b-4267-a4da-80c767055b16', 'code': 200} Feb 08 18:17:59.856008 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=012af0ea-fa3b-4267-a4da-80c767055b16,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:17:59.906692 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dadb9b4b-e5e1-4ba5-9e26-7b57c0822714 req-cdd0b6a6-a38e-4d30-b590-14d3c7852468 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:17:59.908496 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-dadb9b4b-e5e1-4ba5-9e26-7b57c0822714 req-cdd0b6a6-a38e-4d30-b590-14d3c7852468 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0763707 Feb 08 18:17:59.978376 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-dadb9b4b-e5e1-4ba5-9e26-7b57c0822714 req-e85b07c0-682f-416c-b9c6-b37e92c2bda0 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0580902 Feb 08 18:18:00.634197 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02110716-cfdc-4d9f-bb45-c3f6dc3c686d req-c58837af-3926-4abb-9dfc-41ec6e61784b tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:00.635772 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-02110716-cfdc-4d9f-bb45-c3f6dc3c686d req-c58837af-3926-4abb-9dfc-41ec6e61784b tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 943 time: 0.0728233 Feb 08 18:18:00.690114 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-02110716-cfdc-4d9f-bb45-c3f6dc3c686d req-e25d2090-f1da-487e-89d4-473b3a85a2bb tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0480685 Feb 08 18:18:01.095544 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64600747-4d7f-41b8-8d41-5e39f08473b2 req-ac666019-1576-4d46-a1c9-dae195752c16 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:01.097270 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-64600747-4d7f-41b8-8d41-5e39f08473b2 req-ac666019-1576-4d46-a1c9-dae195752c16 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0596447 Feb 08 18:18:01.153124 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-64600747-4d7f-41b8-8d41-5e39f08473b2 req-dc9c890d-a8d3-4590-83cc-47112eaa8b65 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0494227 Feb 08 18:18:01.819620 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46022882-ae15-46ce-aebb-50988d5db298 req-172ed82e-0bdd-4944-a4ab-fdf09834c1af tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:01.821470 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-46022882-ae15-46ce-aebb-50988d5db298 req-172ed82e-0bdd-4944-a4ab-fdf09834c1af tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 943 time: 0.0568583 Feb 08 18:18:01.874673 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-46022882-ae15-46ce-aebb-50988d5db298 req-5b6f7ec7-2ad4-40fd-9a5d-28197e922fd3 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426443 Feb 08 18:18:02.279066 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83c06ee3-289b-4ddf-b96b-a521b3fabb5c req-402f97de-42e7-45d2-99eb-50006c2cecf1 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:02.280686 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-83c06ee3-289b-4ddf-b96b-a521b3fabb5c req-402f97de-42e7-45d2-99eb-50006c2cecf1 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0542614 Feb 08 18:18:02.339321 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-83c06ee3-289b-4ddf-b96b-a521b3fabb5c req-07fa5a01-910d-48f0-b0a2-802ff6d5fb74 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0528908 Feb 08 18:18:03.009995 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cefb5817-474e-4d0e-9f26-c1ceede1c500 req-aac32169-d13b-428b-a10d-af8d12ba5a86 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:03.011500 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-cefb5817-474e-4d0e-9f26-c1ceede1c500 req-aac32169-d13b-428b-a10d-af8d12ba5a86 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 943 time: 0.0587955 Feb 08 18:18:03.061917 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-cefb5817-474e-4d0e-9f26-c1ceede1c500 req-e44227cd-6b09-463f-900a-389ca804b238 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446184 Feb 08 18:18:03.472427 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-debdefa5-8ec1-4aee-b981-09a4906227ea req-fe171a3a-207a-424d-93ae-87e1c3b58472 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:03.474120 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-debdefa5-8ec1-4aee-b981-09a4906227ea req-fe171a3a-207a-424d-93ae-87e1c3b58472 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0582557 Feb 08 18:18:03.530390 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-debdefa5-8ec1-4aee-b981-09a4906227ea req-80c4be29-da97-4e77-b0b8-383b16515eb3 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0502238 Feb 08 18:18:04.202290 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2ebd041-d4ed-49ac-a0ee-1818a4cb57a3 req-eb714647-bddc-4c7f-875f-88a012c9e7b5 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:04.203811 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d2ebd041-d4ed-49ac-a0ee-1818a4cb57a3 req-eb714647-bddc-4c7f-875f-88a012c9e7b5 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 943 time: 0.0649958 Feb 08 18:18:04.255487 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d2ebd041-d4ed-49ac-a0ee-1818a4cb57a3 req-8e4548fa-0348-4012-8913-175b2242c02c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458169 Feb 08 18:18:04.663853 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beafee0f-645b-42bf-9f00-630c184fcb21 req-dc8dd263-1957-4c0c-855f-c0eef2141945 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:04.665486 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-beafee0f-645b-42bf-9f00-630c184fcb21 req-dc8dd263-1957-4c0c-855f-c0eef2141945 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0622702 Feb 08 18:18:04.726613 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-beafee0f-645b-42bf-9f00-630c184fcb21 req-5e465bd1-be9e-482a-b4c0-45d0dece21ed tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0544155 Feb 08 18:18:05.384189 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5033cc19-51f2-4ae0-a689-af930621eb51 req-4c244a1e-cc32-468e-98ee-eb5fd649ee0b tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:05.385710 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5033cc19-51f2-4ae0-a689-af930621eb51 req-4c244a1e-cc32-468e-98ee-eb5fd649ee0b tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 943 time: 0.0544100 Feb 08 18:18:05.447488 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5033cc19-51f2-4ae0-a689-af930621eb51 req-23697b59-545f-41fd-accf-c7bb9ea5e815 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0558505 Feb 08 18:18:05.848633 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c3a5aae-69dd-4549-aa78-1d79366285d5 req-f9b79523-0e38-4132-9aa6-4cf9b7fdfa33 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:05.850549 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-4c3a5aae-69dd-4549-aa78-1d79366285d5 req-f9b79523-0e38-4132-9aa6-4cf9b7fdfa33 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0562716 Feb 08 18:18:05.901879 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-4c3a5aae-69dd-4549-aa78-1d79366285d5 req-042e3aeb-cadd-4785-945d-12717a26c82c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454371 Feb 08 18:18:06.595246 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca591fd1-c100-44ba-8bd2-493a76ab6933 req-50424af9-50ad-4147-b10f-8df948b78fcd tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:06.597013 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ca591fd1-c100-44ba-8bd2-493a76ab6933 req-50424af9-50ad-4147-b10f-8df948b78fcd tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 943 time: 0.0622802 Feb 08 18:18:06.650375 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ca591fd1-c100-44ba-8bd2-493a76ab6933 req-1b8aea18-644d-4dca-af07-824a6f43c5c2 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0473418 Feb 08 18:18:06.752448 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2551ce7-f0ae-48af-acd5-01437959a882 req-9cff6b61-177d-4639-8b27-c86b10c6b3ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:06.753973 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e2551ce7-f0ae-48af-acd5-01437959a882 req-9cff6b61-177d-4639-8b27-c86b10c6b3ef service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 1130 time: 0.0540640 Feb 08 18:18:06.809387 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e2551ce7-f0ae-48af-acd5-01437959a882 req-dbb32d82-74fa-4778-a73b-d986113186cd service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0489657 Feb 08 18:18:07.031166 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d76ded85-6ddd-4af0-ae37-2963ef73d590 req-83cd40b5-7231-4b38-8d1e-f875020e36ed tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:07.032669 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d76ded85-6ddd-4af0-ae37-2963ef73d590 req-83cd40b5-7231-4b38-8d1e-f875020e36ed tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0623858 Feb 08 18:18:07.082946 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d76ded85-6ddd-4af0-ae37-2963ef73d590 req-76e594c3-964c-44f8-976c-913f39f9b890 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444062 Feb 08 18:18:07.794594 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a468c94-5d1a-4ad2-8a7f-9182691dbd81 req-c9e5e637-a6e4-4d3d-8ac9-f7542af1d427 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:07.796442 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8a468c94-5d1a-4ad2-8a7f-9182691dbd81 req-c9e5e637-a6e4-4d3d-8ac9-f7542af1d427 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 943 time: 0.0556846 Feb 08 18:18:07.845688 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8a468c94-5d1a-4ad2-8a7f-9182691dbd81 req-9c6c680a-3c01-4248-b553-079b7c79c901 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434196 Feb 08 18:18:08.217010 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-485b3081-bdd0-4458-a287-fbc2295988f6 req-23cda97c-90ad-4771-be84-0ee6edb6b97f tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:08.218538 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-485b3081-bdd0-4458-a287-fbc2295988f6 req-23cda97c-90ad-4771-be84-0ee6edb6b97f tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0563567 Feb 08 18:18:08.269827 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-485b3081-bdd0-4458-a287-fbc2295988f6 req-acd3cc56-8238-4a9b-a297-57a5bf524c5d tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446689 Feb 08 18:18:08.393201 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcb64249-a591-41a4-8b45-ac46003e1cbb req-4f7ace19-df43-4fb8-9b32-d266ec81403d tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:08.394674 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-dcb64249-a591-41a4-8b45-ac46003e1cbb req-4f7ace19-df43-4fb8-9b32-d266ec81403d tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0581708 Feb 08 18:18:08.443605 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-dcb64249-a591-41a4-8b45-ac46003e1cbb req-98e7ea75-6eab-4564-9d35-5551908b02b1 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0426555 Feb 08 18:18:08.470345 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 43014) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:18:08.675364 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c1a8f10f-2851-4d1f-a56f-dacde2d99749 tempest-TestShelveInstance-349535197 tempest-TestShelveInstance-349535197-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:08.676907 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-c1a8f10f-2851-4d1f-a56f-dacde2d99749 tempest-TestShelveInstance-349535197 tempest-TestShelveInstance-349535197-project-admin] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 1125 time: 0.2055223 Feb 08 18:18:08.680159 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 43018) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:18:08.684443 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-861eb1bc-0e88-422c-ac4c-672bb18f5e8b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Request body: {'floatingip': {'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'port_id': '012af0ea-fa3b-4267-a4da-80c767055b16', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'fixed_ip_address': '172.20.0.12'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:18:08.709710 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-861eb1bc-0e88-422c-ac4c-672bb18f5e8b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for floatingip (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:08.811454 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-861eb1bc-0e88-422c-ac4c-672bb18f5e8b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:08.917525 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_common [None req-861eb1bc-0e88-422c-ac4c-672bb18f5e8b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Allocated IP 172.27.1.198 (77055816-7c88-403d-8f8a-9be2c1faa10d/18547c52-7b23-42cd-bb53-214663ed102b/746ac0fb-244a-4f8e-9866-d7f1d1fb96ff) {{(pid=102560) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:18:08.980719 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce0f5d24-8a02-4562-b321-b6375fb85944 req-399c6adc-c3e8-4017-ba44-3d34c7c19a44 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:08.982169 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ce0f5d24-8a02-4562-b321-b6375fb85944 req-399c6adc-c3e8-4017-ba44-3d34c7c19a44 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 943 time: 0.0540619 Feb 08 18:18:09.018000 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-861eb1bc-0e88-422c-ac4c-672bb18f5e8b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for port (746ac0fb-244a-4f8e-9866-d7f1d1fb96ff), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:09.035366 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ce0f5d24-8a02-4562-b321-b6375fb85944 req-74128e18-64df-49e5-bf6b-3c41315f42ae tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472276 Feb 08 18:18:09.059423 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-861eb1bc-0e88-422c-ac4c-672bb18f5e8b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (746ac0fb-244a-4f8e-9866-d7f1d1fb96ff), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:09.092485 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-861eb1bc-0e88-422c-ac4c-672bb18f5e8b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Network 77055816-7c88-403d-8f8a-9be2c1faa10d is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:18:09.095525 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-861eb1bc-0e88-422c-ac4c-672bb18f5e8b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:18:09.101027 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [None req-861eb1bc-0e88-422c-ac4c-672bb18f5e8b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Received port after_create {{(pid=102560) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:18:09.128694 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-861eb1bc-0e88-422c-ac4c-672bb18f5e8b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Pushing event updated for resources: {'Port': ['ID=746ac0fb-244a-4f8e-9866-d7f1d1fb96ff,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:09.514737 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 50b2e85d-5914-4f54-9939-14603e53f04e details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:18:09.622045 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 50b2e85d-5914-4f54-9939-14603e53f04e, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=50b2e85d-5914-4f54-9939-14603e53f04e,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:18:09.633946 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': '50b2e85d-5914-4f54-9939-14603e53f04e', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'port_id': '50b2e85d-5914-4f54-9939-14603e53f04e', 'mac_address': 'fa:16:3e:8f:67:4b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1053, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '73de7865-d87d-4a2a-a702-160c400f145f', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:18:09.672507 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 50b2e85d-5914-4f54-9939-14603e53f04e is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:18:09.672890 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:09.687229 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 50b2e85d-5914-4f54-9939-14603e53f04e {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:18:09.707274 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 50b2e85d-5914-4f54-9939-14603e53f04e, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=50b2e85d-5914-4f54-9939-14603e53f04e,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:18:09.711918 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:09.723311 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-861eb1bc-0e88-422c-ac4c-672bb18f5e8b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for floatingip (74b63cc7-953c-4d03-8bb5-c84b365acf62), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:09.766827 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=50b2e85d-5914-4f54-9939-14603e53f04e,revision_number=9']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:09.793517 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-861eb1bc-0e88-422c-ac4c-672bb18f5e8b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (746ac0fb-244a-4f8e-9866-d7f1d1fb96ff), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:09.940324 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['50b2e85d-5914-4f54-9939-14603e53f04e'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:18:09.941486 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-861eb1bc-0e88-422c-ac4c-672bb18f5e8b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for port (746ac0fb-244a-4f8e-9866-d7f1d1fb96ff), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:09.948528 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-861eb1bc-0e88-422c-ac4c-672bb18f5e8b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-64531588'] for port (746ac0fb-244a-4f8e-9866-d7f1d1fb96ff), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:10.016417 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-861eb1bc-0e88-422c-ac4c-672bb18f5e8b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Pushing event updated for resources: {'Port': ['ID=746ac0fb-244a-4f8e-9866-d7f1d1fb96ff,revision_number=2']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:10.033175 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-861eb1bc-0e88-422c-ac4c-672bb18f5e8b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-560746'] for floatingip (74b63cc7-953c-4d03-8bb5-c84b365acf62), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:10.165095 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.l3_db [None req-861eb1bc-0e88-422c-ac4c-672bb18f5e8b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Floating IP 74b63cc7-953c-4d03-8bb5-c84b365acf62 associated. External IP: 172.27.1.198, port: 012af0ea-fa3b-4267-a4da-80c767055b16. Feb 08 18:18:10.207467 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dac1c59-2b8a-47e1-b113-f0665d7e7ee1 req-dfb84be8-1bad-48fd-9d7e-f5c900a165a9 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:10.208994 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1dac1c59-2b8a-47e1-b113-f0665d7e7ee1 req-dfb84be8-1bad-48fd-9d7e-f5c900a165a9 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 944 time: 0.0985942 Feb 08 18:18:10.298319 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1dac1c59-2b8a-47e1-b113-f0665d7e7ee1 req-3b1c3d75-2eba-454f-9603-c4fabb6532fc tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0600500 Feb 08 18:18:10.417816 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-861eb1bc-0e88-422c-ac4c-672bb18f5e8b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Router ca0e41d8-de98-4af8-80f4-29c2c72d8f6c has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:18:10.531261 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-861eb1bc-0e88-422c-ac4c-672bb18f5e8b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:18:10.545366 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c67a3210-893b-4609-8b44-6daf26a59a14 None None] Sync routers for ids ['ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'] in dv-cinder-773985-21-iscsi {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:18:10.556777 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-861eb1bc-0e88-422c-ac4c-672bb18f5e8b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for floatingip (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:10.557854 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c67a3210-893b-4609-8b44-6daf26a59a14 None None] Routers {'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:18:10.558467 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-c67a3210-893b-4609-8b44-6daf26a59a14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:17:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:18:10.586028 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-861eb1bc-0e88-422c-ac4c-672bb18f5e8b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.9048400 Feb 08 18:18:10.586630 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd5ab9458-bd5e-49a0-b97b-1e388bb5af81', 'tag': '012af0ea-fa3b-4267-a4da-80c767055b16'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:18:10.588908 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-87e0e7eb-348c-4a01-8bf1-9682fb7fa067" -d '{"events": [{"name": "network-changed", "server_uuid": "d5ab9458-bd5e-49a0-b97b-1e388bb5af81", "tag": "012af0ea-fa3b-4267-a4da-80c767055b16"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:18:10.624435 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:18:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c146766e-822a-44fa-be02-ec001606a241 x-openstack-request-id: req-c146766e-822a-44fa-be02-ec001606a241 {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:18:10.624756 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d5ab9458-bd5e-49a0-b97b-1e388bb5af81", "tag": "012af0ea-fa3b-4267-a4da-80c767055b16", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:18:10.624985 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-c146766e-822a-44fa-be02-ec001606a241 {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:18:10.625384 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd5ab9458-bd5e-49a0-b97b-1e388bb5af81', 'tag': '012af0ea-fa3b-4267-a4da-80c767055b16', 'status': 'completed', 'code': 200} Feb 08 18:18:10.664511 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-c67a3210-893b-4609-8b44-6daf26a59a14 None None] Set router ca0e41d8-de98-4af8-80f4-29c2c72d8f6c gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:18:10.691159 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87e0e7eb-348c-4a01-8bf1-9682fb7fa067 req-1741a565-dfaa-4d7b-8610-a075ad84f349 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:10.692791 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-87e0e7eb-348c-4a01-8bf1-9682fb7fa067 req-1741a565-dfaa-4d7b-8610-a075ad84f349 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=c504038b02a545d8a8b1873a4dfee655&device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 1130 time: 0.0457041 Feb 08 18:18:10.792732 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87e0e7eb-348c-4a01-8bf1-9682fb7fa067 req-ed033f59-51ec-437a-8a35-bdb2a3f7f605 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:10.794209 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-87e0e7eb-348c-4a01-8bf1-9682fb7fa067 req-ed033f59-51ec-437a-8a35-bdb2a3f7f605 service neutron] 10.222.0.109 "GET /v2.0/networks?id=ad3e14dd-35bd-4c6d-8d94-5b851458e927 HTTP/1.1" status: 200 len: 911 time: 0.0951760 Feb 08 18:18:10.860436 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-87e0e7eb-348c-4a01-8bf1-9682fb7fa067 req-fdaee82b-13a3-44cf-be5c-c7dbeef1da8f service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=012af0ea-fa3b-4267-a4da-80c767055b16 HTTP/1.1" status: 200 len: 1000 time: 0.0576441 Feb 08 18:18:10.884499 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-c67a3210-893b-4609-8b44-6daf26a59a14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'name': 'tempest-TestShelveInstance-1763644147-router', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:17Z', 'revision_number': 4, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'gw_port': {'id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:9d:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '74b63cc7-953c-4d03-8bb5-c84b365acf62', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'floating_ip_address': '172.27.1.198', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'port_id': '012af0ea-fa3b-4267-a4da-80c767055b16', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 563, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927', 'mac_address': 'fa:16:3e:4c:d6:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd5ab9458-bd5e-49a0-b97b-1e388bb5af81', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:18:09Z', 'updated_at': '2022-02-08T18:18:09Z', 'revision_number': 0, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fcd6795b-c979-4a72-b6dc-55c74ed312f1', 'name': '', 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'mac_address': 'fa:16:3e:3a:92:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': '58f829ef-859d-415d-b810-791456a616fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:17Z', 'updated_at': '2022-02-08T18:17:22Z', 'revision_number': 5, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'subnets': [{'id': '58f829ef-859d-415d-b810-791456a616fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:18:10.908381 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87e0e7eb-348c-4a01-8bf1-9682fb7fa067 req-65d89c81-a337-4744-bfdc-52d4fd2a5f26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:10.909837 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-87e0e7eb-348c-4a01-8bf1-9682fb7fa067 req-65d89c81-a337-4744-bfdc-52d4fd2a5f26 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=58f829ef-859d-415d-b810-791456a616fc HTTP/1.1" status: 200 len: 848 time: 0.0431070 Feb 08 18:18:10.913207 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c67a3210-893b-4609-8b44-6daf26a59a14 None None] Checking router: ca0e41d8-de98-4af8-80f4-29c2c72d8f6c for host: dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:18:10.921835 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c67a3210-893b-4609-8b44-6daf26a59a14 None None] Routers {'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:18:10.922433 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-c67a3210-893b-4609-8b44-6daf26a59a14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 7},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:17:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:18:10.963648 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87e0e7eb-348c-4a01-8bf1-9682fb7fa067 req-ce1f497d-4812-4054-b101-db2d4a8154fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:10.965145 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-87e0e7eb-348c-4a01-8bf1-9682fb7fa067 req-ce1f497d-4812-4054-b101-db2d4a8154fb service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=ad3e14dd-35bd-4c6d-8d94-5b851458e927&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0481408 Feb 08 18:18:11.022392 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-c67a3210-893b-4609-8b44-6daf26a59a14 None None] Set router ca0e41d8-de98-4af8-80f4-29c2c72d8f6c gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:18:11.057146 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-87e0e7eb-348c-4a01-8bf1-9682fb7fa067 req-2ff765c9-b270-4860-bd1a-0329b0f319cd service neutron] 10.222.0.109 "GET /v2.0/networks/ad3e14dd-35bd-4c6d-8d94-5b851458e927?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0843875 Feb 08 18:18:11.150663 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-87e0e7eb-348c-4a01-8bf1-9682fb7fa067 req-bf62dfd9-3636-43a2-85f0-7686c38c1a85 service neutron] 10.222.0.109 "GET /v2.0/networks/ad3e14dd-35bd-4c6d-8d94-5b851458e927?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0868905 Feb 08 18:18:11.255368 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-c67a3210-893b-4609-8b44-6daf26a59a14 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'name': 'tempest-TestShelveInstance-1763644147-router', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:17Z', 'revision_number': 4, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'gw_port': {'id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:9d:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '74b63cc7-953c-4d03-8bb5-c84b365acf62', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'floating_ip_address': '172.27.1.198', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'port_id': '012af0ea-fa3b-4267-a4da-80c767055b16', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 563, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927', 'mac_address': 'fa:16:3e:4c:d6:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd5ab9458-bd5e-49a0-b97b-1e388bb5af81', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:18:09Z', 'updated_at': '2022-02-08T18:18:09Z', 'revision_number': 0, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fcd6795b-c979-4a72-b6dc-55c74ed312f1', 'name': '', 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'mac_address': 'fa:16:3e:3a:92:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': '58f829ef-859d-415d-b810-791456a616fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:17Z', 'updated_at': '2022-02-08T18:17:22Z', 'revision_number': 5, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'subnets': [{'id': '58f829ef-859d-415d-b810-791456a616fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:18:11.280125 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c67a3210-893b-4609-8b44-6daf26a59a14 None None] The sync data for ids ['ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'] in dv-cinder-773985-21-iscsi is: [{'id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'name': 'tempest-TestShelveInstance-1763644147-router', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:17Z', 'revision_number': 4, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'gw_port': {'id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:9d:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '74b63cc7-953c-4d03-8bb5-c84b365acf62', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'floating_ip_address': '172.27.1.198', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'port_id': '012af0ea-fa3b-4267-a4da-80c767055b16', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 563, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927', 'mac_address': 'fa:16:3e:4c:d6:fc', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd5ab9458-bd5e-49a0-b97b-1e388bb5af81', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:18:09Z', 'updated_at': '2022-02-08T18:18:09Z', 'revision_number': 0, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'fcd6795b-c979-4a72-b6dc-55c74ed312f1', 'name': '', 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'mac_address': 'fa:16:3e:3a:92:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': '58f829ef-859d-415d-b810-791456a616fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:17Z', 'updated_at': '2022-02-08T18:17:22Z', 'revision_number': 5, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'subnets': [{'id': '58f829ef-859d-415d-b810-791456a616fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:18:11.425500 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edc58a4c-dde6-44a6-821e-bee6675c7c9f req-898f7b18-ef02-4fa8-957d-dd86ad864d04 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:11.428411 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-edc58a4c-dde6-44a6-821e-bee6675c7c9f req-898f7b18-ef02-4fa8-957d-dd86ad864d04 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 944 time: 0.0573192 Feb 08 18:18:11.478020 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-edc58a4c-dde6-44a6-821e-bee6675c7c9f req-84c598e5-abba-477a-826e-b1b296dd82fe tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438700 Feb 08 18:18:11.478880 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6e10b0e7-3f68-4e50-9d84-f4d87dbce5b2 None None] New status for floating IP 74b63cc7-953c-4d03-8bb5-c84b365acf62: ACTIVE {{(pid=102561) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Feb 08 18:18:11.531348 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 50b2e85d-5914-4f54-9939-14603e53f04e up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:18:11.654995 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port 50b2e85d-5914-4f54-9939-14603e53f04e triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:18:11.655363 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:11.734119 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 50b2e85d-5914-4f54-9939-14603e53f04e is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:18:11.734509 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:11.759717 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '097f7b21-9f4e-4341-831a-307f6b722f44', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '50b2e85d-5914-4f54-9939-14603e53f04e'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:18:11.761920 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d988c93a-4f08-4c06-acee-cb1c906c3c52" -d '{"events": [{"server_uuid": "097f7b21-9f4e-4341-831a-307f6b722f44", "name": "network-vif-plugged", "status": "completed", "tag": "50b2e85d-5914-4f54-9939-14603e53f04e"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:18:11.773776 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 50b2e85d-5914-4f54-9939-14603e53f04e, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=50b2e85d-5914-4f54-9939-14603e53f04e,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:18:11.778191 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:11.803702 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:18:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c483d6a8-9f04-4332-bb76-ebbda12db43c x-openstack-request-id: req-c483d6a8-9f04-4332-bb76-ebbda12db43c {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:18:11.803986 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "097f7b21-9f4e-4341-831a-307f6b722f44", "name": "network-vif-plugged", "status": "completed", "tag": "50b2e85d-5914-4f54-9939-14603e53f04e", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:18:11.804251 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-c483d6a8-9f04-4332-bb76-ebbda12db43c {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:18:11.804637 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '097f7b21-9f4e-4341-831a-307f6b722f44', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '50b2e85d-5914-4f54-9939-14603e53f04e', 'code': 200} Feb 08 18:18:11.829390 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=50b2e85d-5914-4f54-9939-14603e53f04e,revision_number=10']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:11.996179 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-422fa214-26dd-4b37-9178-5860f8bf0924 req-039e132e-aec4-4559-b342-7dae88930dc7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:11.997762 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-422fa214-26dd-4b37-9178-5860f8bf0924 req-039e132e-aec4-4559-b342-7dae88930dc7 service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 1130 time: 0.0448079 Feb 08 18:18:12.042460 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-422fa214-26dd-4b37-9178-5860f8bf0924 req-c0651a31-b003-40a4-8b86-d6d232dd33c9 service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0378976 Feb 08 18:18:12.619609 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85e2f543-5f85-4b94-b421-b5bf203f6036 req-629cfa02-0ac3-46d9-a618-d09f3a10e4b6 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:12.621079 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-85e2f543-5f85-4b94-b421-b5bf203f6036 req-629cfa02-0ac3-46d9-a618-d09f3a10e4b6 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 946 time: 0.0558748 Feb 08 18:18:12.669621 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-85e2f543-5f85-4b94-b421-b5bf203f6036 req-1fa33452-59d3-4813-a35f-0b175a230ca5 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404508 Feb 08 18:18:12.988810 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:18:13.798819 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cad2239-a40a-4259-8cc7-39487603ca87 req-f120c851-9e97-469b-819f-9c57fe4adc15 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:13.800214 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8cad2239-a40a-4259-8cc7-39487603ca87 req-f120c851-9e97-469b-819f-9c57fe4adc15 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 946 time: 0.0532873 Feb 08 18:18:13.851127 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8cad2239-a40a-4259-8cc7-39487603ca87 req-d61b9a2b-c434-4a6c-81c2-62284d1d9985 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449634 Feb 08 18:18:14.991905 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c595275-fc9b-48ed-b624-a4ba2db801a3 req-278d8f6f-1032-4adf-92eb-b21fad1ff96d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:14.993403 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4c595275-fc9b-48ed-b624-a4ba2db801a3 req-278d8f6f-1032-4adf-92eb-b21fad1ff96d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 946 time: 0.0620866 Feb 08 18:18:15.039909 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4c595275-fc9b-48ed-b624-a4ba2db801a3 req-b5eaf4c7-e5d9-4ee7-8b4f-2b4fcc747f5c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0406320 Feb 08 18:18:15.372685 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-63ecd748-80ac-4f51-aec2-805e6aa500c2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:16.759636 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 43120) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:18:16.869736 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8159a421-58ea-4a15-aef9-64014aab2d20 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:16.961661 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8159a421-58ea-4a15-aef9-64014aab2d20 admin admin] Publish callbacks [] for security_group (bd73d7f1-5a5b-479f-a00c-1861df9bb3a3), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:16.966937 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8159a421-58ea-4a15-aef9-64014aab2d20 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (bd73d7f1-5a5b-479f-a00c-1861df9bb3a3), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:17.004910 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-8159a421-58ea-4a15-aef9-64014aab2d20 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=8ef74c0e6fb4486599d94f1a8cc9f455&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2441983 Feb 08 18:18:17.006282 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8159a421-58ea-4a15-aef9-64014aab2d20 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bd73d7f1-5a5b-479f-a00c-1861df9bb3a3,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:17.007878 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 43124) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:18:17.057811 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6e1defa0-bf2f-42ff-80de-87ab08a06634 admin admin] Publish callbacks [] for security_group (bd73d7f1-5a5b-479f-a00c-1861df9bb3a3), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:17.079690 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6e1defa0-bf2f-42ff-80de-87ab08a06634 admin admin] Publish callbacks [] for security_group (bd73d7f1-5a5b-479f-a00c-1861df9bb3a3), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:17.128561 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6e1defa0-bf2f-42ff-80de-87ab08a06634 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (bd73d7f1-5a5b-479f-a00c-1861df9bb3a3), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:17.131271 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6e1defa0-bf2f-42ff-80de-87ab08a06634 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:17.132429 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-6e1defa0-bf2f-42ff-80de-87ab08a06634 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/bd73d7f1-5a5b-479f-a00c-1861df9bb3a3 HTTP/1.1" status: 204 len: 168 time: 0.1228199 Feb 08 18:18:17.140333 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e1defa0-bf2f-42ff-80de-87ab08a06634 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bd73d7f1-5a5b-479f-a00c-1861df9bb3a3,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:17.827237 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ea2f5caf-f520-4610-8a84-3318fbc8698c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:17.986998 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:18.513366 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:20.117422 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:21.671994 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:37.809933 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 43260) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:18:37.925595 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b1149672-67de-4e46-af5b-21f8296f827b admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:38.011828 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b1149672-67de-4e46-af5b-21f8296f827b admin admin] Publish callbacks [] for security_group (33b589a2-db9f-42b0-b810-249b4517d897), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:38.018259 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b1149672-67de-4e46-af5b-21f8296f827b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (33b589a2-db9f-42b0-b810-249b4517d897), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:38.055907 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-b1149672-67de-4e46-af5b-21f8296f827b admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=c0efd7df495b49c886c50d03d44476ac&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2449155 Feb 08 18:18:38.056738 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1149672-67de-4e46-af5b-21f8296f827b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=33b589a2-db9f-42b0-b810-249b4517d897,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:38.058575 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 43264) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:18:38.073895 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1149672-67de-4e46-af5b-21f8296f827b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:38.074240 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1149672-67de-4e46-af5b-21f8296f827b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:38.074567 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1149672-67de-4e46-af5b-21f8296f827b admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:38.074956 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1149672-67de-4e46-af5b-21f8296f827b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:38.075284 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1149672-67de-4e46-af5b-21f8296f827b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:38.075611 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1149672-67de-4e46-af5b-21f8296f827b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:38.075930 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1149672-67de-4e46-af5b-21f8296f827b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:38.076246 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1149672-67de-4e46-af5b-21f8296f827b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:38.076567 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1149672-67de-4e46-af5b-21f8296f827b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:38.076887 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1149672-67de-4e46-af5b-21f8296f827b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:38.077197 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1149672-67de-4e46-af5b-21f8296f827b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:38.077502 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1149672-67de-4e46-af5b-21f8296f827b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:38.077811 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b1149672-67de-4e46-af5b-21f8296f827b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:38.114465 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dec090-634a-491a-87dd-5e26eeeba945 admin admin] Publish callbacks [] for security_group (33b589a2-db9f-42b0-b810-249b4517d897), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:38.134782 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dec090-634a-491a-87dd-5e26eeeba945 admin admin] Publish callbacks [] for security_group (33b589a2-db9f-42b0-b810-249b4517d897), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:38.185780 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dec090-634a-491a-87dd-5e26eeeba945 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (33b589a2-db9f-42b0-b810-249b4517d897), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:38.189391 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f6dec090-634a-491a-87dd-5e26eeeba945 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:38.190543 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-f6dec090-634a-491a-87dd-5e26eeeba945 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/33b589a2-db9f-42b0-b810-249b4517d897 HTTP/1.1" status: 204 len: 168 time: 0.1310823 Feb 08 18:18:38.197894 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6dec090-634a-491a-87dd-5e26eeeba945 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=33b589a2-db9f-42b0-b810-249b4517d897,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:42.245585 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 43332) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:18:42.362209 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-cb2298b9-df9a-4f28-83ad-117c5b99b302 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:42.441725 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-cb2298b9-df9a-4f28-83ad-117c5b99b302 admin admin] Publish callbacks [] for security_group (93a8dbfe-2b20-446d-b7ee-6706a34734a5), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:42.446934 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-cb2298b9-df9a-4f28-83ad-117c5b99b302 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (93a8dbfe-2b20-446d-b7ee-6706a34734a5), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:42.482461 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cb2298b9-df9a-4f28-83ad-117c5b99b302 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=93a8dbfe-2b20-446d-b7ee-6706a34734a5,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:42.486122 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-cb2298b9-df9a-4f28-83ad-117c5b99b302 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=32c653da10b0406d80f9b0ee6cce79af&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2395301 Feb 08 18:18:42.489092 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 43338) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:18:42.492002 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb2298b9-df9a-4f28-83ad-117c5b99b302 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:42.492389 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb2298b9-df9a-4f28-83ad-117c5b99b302 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:42.492700 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb2298b9-df9a-4f28-83ad-117c5b99b302 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:42.493040 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb2298b9-df9a-4f28-83ad-117c5b99b302 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:42.493372 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb2298b9-df9a-4f28-83ad-117c5b99b302 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:42.493705 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb2298b9-df9a-4f28-83ad-117c5b99b302 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:42.494036 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb2298b9-df9a-4f28-83ad-117c5b99b302 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:42.494369 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb2298b9-df9a-4f28-83ad-117c5b99b302 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:42.494710 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb2298b9-df9a-4f28-83ad-117c5b99b302 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:42.495063 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb2298b9-df9a-4f28-83ad-117c5b99b302 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:42.495390 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb2298b9-df9a-4f28-83ad-117c5b99b302 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:42.495702 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb2298b9-df9a-4f28-83ad-117c5b99b302 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:42.496020 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-cb2298b9-df9a-4f28-83ad-117c5b99b302 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:18:42.537761 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f8f6c8f9-3ebe-410a-bca5-70ce1ed54d18 admin admin] Publish callbacks [] for security_group (93a8dbfe-2b20-446d-b7ee-6706a34734a5), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:42.560851 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f8f6c8f9-3ebe-410a-bca5-70ce1ed54d18 admin admin] Publish callbacks [] for security_group (93a8dbfe-2b20-446d-b7ee-6706a34734a5), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:42.612713 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f8f6c8f9-3ebe-410a-bca5-70ce1ed54d18 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (93a8dbfe-2b20-446d-b7ee-6706a34734a5), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:42.615330 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f8f6c8f9-3ebe-410a-bca5-70ce1ed54d18 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:42.616505 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-f8f6c8f9-3ebe-410a-bca5-70ce1ed54d18 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/93a8dbfe-2b20-446d-b7ee-6706a34734a5 HTTP/1.1" status: 204 len: 168 time: 0.1263082 Feb 08 18:18:42.624049 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8f6c8f9-3ebe-410a-bca5-70ce1ed54d18 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=93a8dbfe-2b20-446d-b7ee-6706a34734a5,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:45.380217 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-0055d4a9-1092-475c-b238-509290ba8d52 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:47.831535 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-0392034d-0033-44b2-96d4-e3e675ee03d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:48.000551 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:48.527178 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:49.993073 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:18:50.121569 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:50.699770 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 43466) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:18:50.817363 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9b31f3ae-212c-422d-8ca5-50b7697022b4 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:50.901333 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9b31f3ae-212c-422d-8ca5-50b7697022b4 admin admin] Publish callbacks [] for security_group (41af2053-fd92-4dbd-989f-b9bfc291c7d5), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:50.906049 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9b31f3ae-212c-422d-8ca5-50b7697022b4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (41af2053-fd92-4dbd-989f-b9bfc291c7d5), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:50.944101 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-9b31f3ae-212c-422d-8ca5-50b7697022b4 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=bc4b8b18137345bb92f245606ca030e4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2429769 Feb 08 18:18:50.944941 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b31f3ae-212c-422d-8ca5-50b7697022b4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=41af2053-fd92-4dbd-989f-b9bfc291c7d5,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:50.947080 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 43470) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:18:51.006947 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-37c7c3aa-679a-4679-91dd-488d75571738 admin admin] Publish callbacks [] for security_group (41af2053-fd92-4dbd-989f-b9bfc291c7d5), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:51.030224 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-37c7c3aa-679a-4679-91dd-488d75571738 admin admin] Publish callbacks [] for security_group (41af2053-fd92-4dbd-989f-b9bfc291c7d5), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:51.077990 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-37c7c3aa-679a-4679-91dd-488d75571738 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (41af2053-fd92-4dbd-989f-b9bfc291c7d5), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:51.080667 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-37c7c3aa-679a-4679-91dd-488d75571738 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:51.081825 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-37c7c3aa-679a-4679-91dd-488d75571738 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/41af2053-fd92-4dbd-989f-b9bfc291c7d5 HTTP/1.1" status: 204 len: 168 time: 0.1337211 Feb 08 18:18:51.089824 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37c7c3aa-679a-4679-91dd-488d75571738 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=41af2053-fd92-4dbd-989f-b9bfc291c7d5,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:51.357395 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 43476) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:18:51.370691 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-51f79855-7923-4f6d-874e-e7d13c295e92 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:51.446701 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-51f79855-7923-4f6d-874e-e7d13c295e92 admin admin] Publish callbacks [] for security_group (17ee272f-10cb-486b-91f9-9c219a48cb83), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:51.452092 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-51f79855-7923-4f6d-874e-e7d13c295e92 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (17ee272f-10cb-486b-91f9-9c219a48cb83), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:51.489729 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-51f79855-7923-4f6d-874e-e7d13c295e92 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=28ac477a96714ffcbfad04514ef54c00&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1312561 Feb 08 18:18:51.490684 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51f79855-7923-4f6d-874e-e7d13c295e92 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=17ee272f-10cb-486b-91f9-9c219a48cb83,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:51.492688 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 43478) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:18:51.540133 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-8fb369d2-eb31-40ad-b543-3ff36778008e admin admin] Publish callbacks [] for security_group (17ee272f-10cb-486b-91f9-9c219a48cb83), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:51.564497 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-8fb369d2-eb31-40ad-b543-3ff36778008e admin admin] Publish callbacks [] for security_group (17ee272f-10cb-486b-91f9-9c219a48cb83), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:51.613913 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-8fb369d2-eb31-40ad-b543-3ff36778008e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (17ee272f-10cb-486b-91f9-9c219a48cb83), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:51.616503 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-8fb369d2-eb31-40ad-b543-3ff36778008e admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:51.617647 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-8fb369d2-eb31-40ad-b543-3ff36778008e admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/17ee272f-10cb-486b-91f9-9c219a48cb83 HTTP/1.1" status: 204 len: 168 time: 0.1239793 Feb 08 18:18:51.625830 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8fb369d2-eb31-40ad-b543-3ff36778008e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=17ee272f-10cb-486b-91f9-9c219a48cb83,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:51.665524 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:51.949431 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 43484) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:18:51.962798 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4a175487-acd8-4fa6-a0cc-247ee5432767 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:52.045802 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4a175487-acd8-4fa6-a0cc-247ee5432767 admin admin] Publish callbacks [] for security_group (8bd97226-bc5b-4e57-a08a-03b7e6fd0f2b), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:52.051670 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-4a175487-acd8-4fa6-a0cc-247ee5432767 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (8bd97226-bc5b-4e57-a08a-03b7e6fd0f2b), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:52.089283 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-4a175487-acd8-4fa6-a0cc-247ee5432767 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=ce0ce0d6b76a4995bdf1b09db041d390&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1386783 Feb 08 18:18:52.090181 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a175487-acd8-4fa6-a0cc-247ee5432767 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8bd97226-bc5b-4e57-a08a-03b7e6fd0f2b,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:52.092274 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 43486) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:18:52.159195 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4e7ad9c7-6cc6-4013-8fc4-98f8efc0ded0 admin admin] Publish callbacks [] for security_group (8bd97226-bc5b-4e57-a08a-03b7e6fd0f2b), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:52.184203 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4e7ad9c7-6cc6-4013-8fc4-98f8efc0ded0 admin admin] Publish callbacks [] for security_group (8bd97226-bc5b-4e57-a08a-03b7e6fd0f2b), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:52.233542 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4e7ad9c7-6cc6-4013-8fc4-98f8efc0ded0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (8bd97226-bc5b-4e57-a08a-03b7e6fd0f2b), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:52.236232 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4e7ad9c7-6cc6-4013-8fc4-98f8efc0ded0 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:52.237382 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-4e7ad9c7-6cc6-4013-8fc4-98f8efc0ded0 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/8bd97226-bc5b-4e57-a08a-03b7e6fd0f2b HTTP/1.1" status: 204 len: 168 time: 0.1441250 Feb 08 18:18:52.244931 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e7ad9c7-6cc6-4013-8fc4-98f8efc0ded0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8bd97226-bc5b-4e57-a08a-03b7e6fd0f2b,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:52.963876 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 43508) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:18:53.062721 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-5e2b810f-85e4-4fec-be6e-c21e260bd63f admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-497740373-network', 'tenant_id': 'c50a1910195245ff8254b7cca4fdfbaa'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:18:53.084610 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5e2b810f-85e4-4fec-be6e-c21e260bd63f admin admin] Made reservation on behalf of c50a1910195245ff8254b7cca4fdfbaa for: {'network': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:18:53.087016 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5e2b810f-85e4-4fec-be6e-c21e260bd63f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for network (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:53.095959 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5e2b810f-85e4-4fec-be6e-c21e260bd63f admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:53.170885 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5e2b810f-85e4-4fec-be6e-c21e260bd63f admin admin] Publish callbacks [] for security_group (66081d7a-f07b-4f82-ad72-c8f7a5870dcd), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:53.175979 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5e2b810f-85e4-4fec-be6e-c21e260bd63f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (66081d7a-f07b-4f82-ad72-c8f7a5870dcd), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:53.202129 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5e2b810f-85e4-4fec-be6e-c21e260bd63f admin admin] vlan segment allocate from pool success with {'vlan_id': 1054, 'physical_network': 'physnet1'} {{(pid=102559) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Feb 08 18:18:53.208388 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e2b810f-85e4-4fec-be6e-c21e260bd63f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=66081d7a-f07b-4f82-ad72-c8f7a5870dcd,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:53.218195 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5e2b810f-85e4-4fec-be6e-c21e260bd63f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (dfda56ea-4f8f-4241-8424-b3ed264aa208), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:53.218451 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.db.segments_db [None req-5e2b810f-85e4-4fec-be6e-c21e260bd63f admin admin] Added segment dfda56ea-4f8f-4241-8424-b3ed264aa208 of type vlan for network 15a08cf2-cd5e-4df5-9cba-d45464825731 Feb 08 18:18:53.256421 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5e2b810f-85e4-4fec-be6e-c21e260bd63f admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8770558521384'] for network (15a08cf2-cd5e-4df5-9cba-d45464825731), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:53.282871 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5e2b810f-85e4-4fec-be6e-c21e260bd63f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for network (15a08cf2-cd5e-4df5-9cba-d45464825731), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:53.283765 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5e2b810f-85e4-4fec-be6e-c21e260bd63f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:53.284430 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5e2b810f-85e4-4fec-be6e-c21e260bd63f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:53.338410 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-5e2b810f-85e4-4fec-be6e-c21e260bd63f admin admin] 10.222.0.118 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.3733559 Feb 08 18:18:53.341697 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 43512) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:18:53.349053 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-83803994-7c13-4f69-aef3-6b33c8ad4034 admin admin] Request body: {'subnet': {'network_id': '15a08cf2-cd5e-4df5-9cba-d45464825731', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-497740373-subnet', 'tenant_id': 'c50a1910195245ff8254b7cca4fdfbaa', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:18:53.363454 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e2b810f-85e4-4fec-be6e-c21e260bd63f admin admin] Pushing event updated for resources: {'Network': ['ID=15a08cf2-cd5e-4df5-9cba-d45464825731,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:53.373702 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Network 15a08cf2-cd5e-4df5-9cba-d45464825731 details requested by agent ovs-agent-dv-cinder-773985-21-iscsi with host dv-cinder-773985-21-iscsi {{(pid=102561) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Feb 08 18:18:53.382556 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-83803994-7c13-4f69-aef3-6b33c8ad4034 admin admin] Made reservation on behalf of c50a1910195245ff8254b7cca4fdfbaa for: {'subnet': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:18:53.385152 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-83803994-7c13-4f69-aef3-6b33c8ad4034 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-63685351'] for subnet (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:53.551863 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-83803994-7c13-4f69-aef3-6b33c8ad4034 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-63856587', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-63685337'] for subnet (fe603f88-f21a-48c8-b9f7-c48877966ded), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:53.609728 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83803994-7c13-4f69-aef3-6b33c8ad4034 admin admin] Pushing event updated for resources: {'Subnet': ['ID=fe603f88-f21a-48c8-b9f7-c48877966ded,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:53.619760 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-83803994-7c13-4f69-aef3-6b33c8ad4034 admin admin] Checking segment: {'id': 'dfda56ea-4f8f-4241-8424-b3ed264aa208', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1054, 'network_id': '15a08cf2-cd5e-4df5-9cba-d45464825731'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102559) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:18:53.620116 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83803994-7c13-4f69-aef3-6b33c8ad4034 admin admin] Network hostable DHCP agents. Network: 15a08cf2-cd5e-4df5-9cba-d45464825731, hostable agents: ['006b5388-ac7d-4794-a124-14bb8e5d8fec'], hosted agents: [] {{(pid=102559) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Feb 08 18:18:53.637208 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-83803994-7c13-4f69-aef3-6b33c8ad4034 admin admin] Network 15a08cf2-cd5e-4df5-9cba-d45464825731 is scheduled to be hosted by DHCP agent 006b5388-ac7d-4794-a124-14bb8e5d8fec with binding_index 1 {{(pid=102559) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Feb 08 18:18:53.646842 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-83803994-7c13-4f69-aef3-6b33c8ad4034 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773985-21-iscsi, 15a08cf2-cd5e-4df5-9cba-d45464825731) {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:18:53.651363 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83803994-7c13-4f69-aef3-6b33c8ad4034 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:53.651969 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-83803994-7c13-4f69-aef3-6b33c8ad4034 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:53.657495 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1a018ea1-75bb-4152-baf8-b43aa7f430ab None None] Network 15a08cf2-cd5e-4df5-9cba-d45464825731 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:18:53.670360 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-83803994-7c13-4f69-aef3-6b33c8ad4034 admin admin] 10.222.0.118 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.3273184 Feb 08 18:18:53.758606 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d6d88233-f256-4b03-aa03-8bd34221a3a8 None None] Network 15a08cf2-cd5e-4df5-9cba-d45464825731 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:18:54.641687 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1509ce02-75c0-433f-b505-162669569c7b req-19e9e263-c1e2-4e82-8731-d3d98b5a89b5 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:54.643142 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1509ce02-75c0-433f-b505-162669569c7b req-19e9e263-c1e2-4e82-8731-d3d98b5a89b5 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 946 time: 0.0533888 Feb 08 18:18:54.694936 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1509ce02-75c0-433f-b505-162669569c7b req-b9762755-dd17-404d-bce3-6a9ff5328da9 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461411 Feb 08 18:18:55.448778 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-178604e1-91ad-4f18-9d3f-5f8da8c925dc tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:55.450286 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-178604e1-91ad-4f18-9d3f-5f8da8c925dc tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/networks?id=15a08cf2-cd5e-4df5-9cba-d45464825731 HTTP/1.1" status: 200 len: 813 time: 0.1172593 Feb 08 18:18:55.465744 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-acb99b0f-3502-4d40-9ba8-59271819e93f tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/quotas/c50a1910195245ff8254b7cca4fdfbaa HTTP/1.1" status: 200 len: 375 time: 0.0099480 Feb 08 18:18:55.502218 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-f057b03c-1cc0-4224-8438-777fd073c2d0 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?tenant_id=c50a1910195245ff8254b7cca4fdfbaa&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0312226 Feb 08 18:18:55.593582 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-be91f354-b548-4ad9-9a08-a9586653785f service neutron] 10.222.0.118 "GET /v2.0/networks/15a08cf2-cd5e-4df5-9cba-d45464825731?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0845869 Feb 08 18:18:55.681647 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-7ab9fc3b-0c79-4e6b-9151-33aa21a24020 service neutron] 10.222.0.118 "GET /v2.0/networks/15a08cf2-cd5e-4df5-9cba-d45464825731?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0825636 Feb 08 18:18:55.835578 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6491fc15-a317-4f85-aa12-6f0524525d25 req-9d96bd5b-5d9a-46d0-a6c8-d02910a0dd07 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:55.837054 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6491fc15-a317-4f85-aa12-6f0524525d25 req-9d96bd5b-5d9a-46d0-a6c8-d02910a0dd07 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 946 time: 0.0576265 Feb 08 18:18:55.846347 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-663dc3c6-b6fa-4452-ad2e-27ed755b2f39 req-c2852a42-42b5-42fa-87f5-7d29aaecf41d tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=82a87eac-3773-40e3-8cb3-4c5181dd42eb HTTP/1.1" status: 200 len: 210 time: 0.0299897 Feb 08 18:18:55.889314 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6491fc15-a317-4f85-aa12-6f0524525d25 req-f166ff89-a5e6-4314-a132-2ae1e8e30883 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups?id=625bb656-8167-4dc7-8c84-0415217847fb&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0463991 Feb 08 18:18:55.918028 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63cb6e9d-c809-4813-b9e1-202cac18b6a1 req-b8bfde6e-2cd2-405e-8d65-3932d3b898a2 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:55.919884 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-63cb6e9d-c809-4813-b9e1-202cac18b6a1 req-b8bfde6e-2cd2-405e-8d65-3932d3b898a2 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.109 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 946 time: 0.0608506 Feb 08 18:18:56.023117 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-63cb6e9d-c809-4813-b9e1-202cac18b6a1 req-33a3b53f-9205-4094-88fd-dde21c78121d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Deleting port 50b2e85d-5914-4f54-9939-14603e53f04e {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:18:56.023475 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-63cb6e9d-c809-4813-b9e1-202cac18b6a1 req-33a3b53f-9205-4094-88fd-dde21c78121d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:56.123175 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-63cb6e9d-c809-4813-b9e1-202cac18b6a1 req-33a3b53f-9205-4094-88fd-dde21c78121d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] For port 50b2e85d-5914-4f54-9939-14603e53f04e, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=50b2e85d-5914-4f54-9939-14603e53f04e,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:18:56.123593 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-63cb6e9d-c809-4813-b9e1-202cac18b6a1 req-33a3b53f-9205-4094-88fd-dde21c78121d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:56.297628 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-63cb6e9d-c809-4813-b9e1-202cac18b6a1 req-33a3b53f-9205-4094-88fd-dde21c78121d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for floatingip (None), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:56.298004 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-63cb6e9d-c809-4813-b9e1-202cac18b6a1 req-33a3b53f-9205-4094-88fd-dde21c78121d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-560746'] for floatingip (5fc12cc6-4f52-488c-9d27-d90b64bf94b3), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:56.298370 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.l3_db [req-63cb6e9d-c809-4813-b9e1-202cac18b6a1 req-33a3b53f-9205-4094-88fd-dde21c78121d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Floating IP 5fc12cc6-4f52-488c-9d27-d90b64bf94b3 disassociated. External IP: 172.27.1.57, port: 50b2e85d-5914-4f54-9939-14603e53f04e. Feb 08 18:18:56.298751 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-63cb6e9d-c809-4813-b9e1-202cac18b6a1 req-33a3b53f-9205-4094-88fd-dde21c78121d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Calling delete_port for 50b2e85d-5914-4f54-9939-14603e53f04e owned by compute:nova {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:18:56.432654 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-63cb6e9d-c809-4813-b9e1-202cac18b6a1 req-33a3b53f-9205-4094-88fd-dde21c78121d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (50b2e85d-5914-4f54-9939-14603e53f04e), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:56.459616 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33a3b53f-9205-4094-88fd-dde21c78121d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Pushing event deleted for resources: {'Port': ['ID=50b2e85d-5914-4f54-9939-14603e53f04e,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:56.578613 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [req-63cb6e9d-c809-4813-b9e1-202cac18b6a1 req-33a3b53f-9205-4094-88fd-dde21c78121d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Router 058f0c04-e3de-4d16-8a7a-a7247919133c has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:18:56.809585 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-1373ca36-fc5b-4fb6-80fc-328b319e1d83 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:56.811299 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-1373ca36-fc5b-4fb6-80fc-328b319e1d83 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.109 "GET /v2.0/networks?id=15a08cf2-cd5e-4df5-9cba-d45464825731 HTTP/1.1" status: 200 len: 813 time: 0.1224046 Feb 08 18:18:56.825176 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-7ca3c7b0-fdba-4c81-a972-2b5a82e727e0 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Request body: {'port': {'device_id': '82a87eac-3773-40e3-8cb3-4c5181dd42eb', 'network_id': '15a08cf2-cd5e-4df5-9cba-d45464825731', 'admin_state_up': True, 'tenant_id': 'c50a1910195245ff8254b7cca4fdfbaa'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:18:56.953228 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-7ca3c7b0-fdba-4c81-a972-2b5a82e727e0 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Made reservation on behalf of c50a1910195245ff8254b7cca4fdfbaa for: {'port': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:18:56.957990 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-7ca3c7b0-fdba-4c81-a972-2b5a82e727e0 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:56.991134 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8a77024f-356d-42de-812c-37d7bf609675 req-ea69b996-a264-4569-96b4-74b5829447f4 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=82a87eac-3773-40e3-8cb3-4c5181dd42eb HTTP/1.1" status: 200 len: 210 time: 0.0327420 Feb 08 18:18:57.021733 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a599801b-3696-4b1e-a076-b9d17b00742f req-cd305ba2-117e-490e-8a2e-609711e2587c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/ports?device_id=097f7b21-9f4e-4341-831a-307f6b722f44 HTTP/1.1" status: 200 len: 210 time: 0.0395660 Feb 08 18:18:57.041462 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-63cb6e9d-c809-4813-b9e1-202cac18b6a1 req-33a3b53f-9205-4094-88fd-dde21c78121d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:18:57.052551 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb4c3373-8ff0-4ce1-9283-6d70034db54a None None] Sync routers for ids ['058f0c04-e3de-4d16-8a7a-a7247919133c'] in dv-cinder-773985-21-iscsi {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:18:57.063265 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb4c3373-8ff0-4ce1-9283-6d70034db54a None None] Routers {'058f0c04-e3de-4d16-8a7a-a7247919133c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:18:57.063869 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-cb4c3373-8ff0-4ce1-9283-6d70034db54a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:18:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['058f0c04-e3de-4d16-8a7a-a7247919133c'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:18:57.085049 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [req-63cb6e9d-c809-4813-b9e1-202cac18b6a1 req-33a3b53f-9205-4094-88fd-dde21c78121d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] No DVR routers for this DVR port 50b2e85d-5914-4f54-9939-14603e53f04e on host hv-cinder-77398 {{(pid=102560) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:18:57.088115 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-63cb6e9d-c809-4813-b9e1-202cac18b6a1 req-33a3b53f-9205-4094-88fd-dde21c78121d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:57.091193 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-63cb6e9d-c809-4813-b9e1-202cac18b6a1 req-33a3b53f-9205-4094-88fd-dde21c78121d tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.109 "DELETE /v2.0/ports/50b2e85d-5914-4f54-9939-14603e53f04e HTTP/1.1" status: 204 len: 173 time: 1.1665416 Feb 08 18:18:57.091642 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '097f7b21-9f4e-4341-831a-307f6b722f44', 'name': 'network-vif-deleted', 'tag': '50b2e85d-5914-4f54-9939-14603e53f04e'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:18:57.094410 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-68ae3a01-989e-4772-9bee-07b9024db3f5" -d '{"events": [{"server_uuid": "097f7b21-9f4e-4341-831a-307f6b722f44", "name": "network-vif-deleted", "tag": "50b2e85d-5914-4f54-9939-14603e53f04e"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:18:57.129205 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-7ca3c7b0-fdba-4c81-a972-2b5a82e727e0 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Allocated IP 172.20.0.12 (15a08cf2-cd5e-4df5-9cba-d45464825731/fe603f88-f21a-48c8-b9f7-c48877966ded/037e84ed-14e6-4370-9a30-51a3144a8de4) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:18:57.133455 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:18:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9f8855e9-71a6-4b61-950d-66f204fc884f x-openstack-request-id: req-9f8855e9-71a6-4b61-950d-66f204fc884f {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:18:57.133730 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "097f7b21-9f4e-4341-831a-307f6b722f44", "name": "network-vif-deleted", "tag": "50b2e85d-5914-4f54-9939-14603e53f04e", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:18:57.134015 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-9f8855e9-71a6-4b61-950d-66f204fc884f {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:18:57.134458 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '097f7b21-9f4e-4341-831a-307f6b722f44', 'name': 'network-vif-deleted', 'tag': '50b2e85d-5914-4f54-9939-14603e53f04e', 'status': 'completed', 'code': 200} Feb 08 18:18:57.181115 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-cb4c3373-8ff0-4ce1-9283-6d70034db54a None None] Set router 058f0c04-e3de-4d16-8a7a-a7247919133c gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:18:57.282588 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-7ca3c7b0-fdba-4c81-a972-2b5a82e727e0 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Publish callbacks [] for port (037e84ed-14e6-4370-9a30-51a3144a8de4), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:57.316442 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-7ca3c7b0-fdba-4c81-a972-2b5a82e727e0 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (037e84ed-14e6-4370-9a30-51a3144a8de4), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:57.363605 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-7ca3c7b0-fdba-4c81-a972-2b5a82e727e0 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Network 15a08cf2-cd5e-4df5-9cba-d45464825731 is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:18:57.366898 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-7ca3c7b0-fdba-4c81-a972-2b5a82e727e0 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:18:57.370633 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-7ca3c7b0-fdba-4c81-a972-2b5a82e727e0 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:18:57.377161 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ca3c7b0-fdba-4c81-a972-2b5a82e727e0 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Pushing event updated for resources: {'Port': ['ID=037e84ed-14e6-4370-9a30-51a3144a8de4,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:57.378627 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-cb4c3373-8ff0-4ce1-9283-6d70034db54a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'name': 'tempest-AttachVolumeShelveTestJSON-785190803-router', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106'}], 'enable_snat': True}, 'gw_port_id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:11Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'gw_port': {'id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:49:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:14Z', 'updated_at': '2022-02-08T18:12:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'e29130bd-e04d-4042-835b-4ba71dbf114e', 'name': '', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'mac_address': 'fa:16:3e:aa:1e:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '73de7865-d87d-4a2a-a702-160c400f145f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:21Z', 'updated_at': '2022-02-08T18:12:30Z', 'revision_number': 5, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'subnets': [{'id': '73de7865-d87d-4a2a-a702-160c400f145f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:18:57.408625 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb4c3373-8ff0-4ce1-9283-6d70034db54a None None] Checking router: 058f0c04-e3de-4d16-8a7a-a7247919133c for host: dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:18:57.417557 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb4c3373-8ff0-4ce1-9283-6d70034db54a None None] Routers {'058f0c04-e3de-4d16-8a7a-a7247919133c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:18:57.418167 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-cb4c3373-8ff0-4ce1-9283-6d70034db54a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:18:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['058f0c04-e3de-4d16-8a7a-a7247919133c'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:18:57.421285 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-7ca3c7b0-fdba-4c81-a972-2b5a82e727e0 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:57.422031 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-7ca3c7b0-fdba-4c81-a972-2b5a82e727e0 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:57.437600 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-7ca3c7b0-fdba-4c81-a972-2b5a82e727e0 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.109 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6173208 Feb 08 18:18:57.450221 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] Request body: {'port': {'device_id': '82a87eac-3773-40e3-8cb3-4c5181dd42eb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77398'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:18:57.512367 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (037e84ed-14e6-4370-9a30-51a3144a8de4), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:57.620583 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-cb4c3373-8ff0-4ce1-9283-6d70034db54a None None] Set router 058f0c04-e3de-4d16-8a7a-a7247919133c gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:18:57.825085 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-cb4c3373-8ff0-4ce1-9283-6d70034db54a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'name': 'tempest-AttachVolumeShelveTestJSON-785190803-router', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106'}], 'enable_snat': True}, 'gw_port_id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:11Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'gw_port': {'id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:49:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:14Z', 'updated_at': '2022-02-08T18:12:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'e29130bd-e04d-4042-835b-4ba71dbf114e', 'name': '', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'mac_address': 'fa:16:3e:aa:1e:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '73de7865-d87d-4a2a-a702-160c400f145f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:21Z', 'updated_at': '2022-02-08T18:12:30Z', 'revision_number': 5, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'subnets': [{'id': '73de7865-d87d-4a2a-a702-160c400f145f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:18:57.851965 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb4c3373-8ff0-4ce1-9283-6d70034db54a None None] The sync data for ids ['058f0c04-e3de-4d16-8a7a-a7247919133c'] in dv-cinder-773985-21-iscsi is: [{'id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'name': 'tempest-AttachVolumeShelveTestJSON-785190803-router', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106'}], 'enable_snat': True}, 'gw_port_id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:11Z', 'updated_at': '2022-02-08T18:12:24Z', 'revision_number': 4, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'gw_port': {'id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:49:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:14Z', 'updated_at': '2022-02-08T18:12:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'e29130bd-e04d-4042-835b-4ba71dbf114e', 'name': '', 'network_id': '7a854399-3ce6-42bd-bfc4-061132ecb9c2', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'mac_address': 'fa:16:3e:aa:1e:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_interface', 'standard_attr_id': 99, 'fixed_ips': [{'subnet_id': '73de7865-d87d-4a2a-a702-160c400f145f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:21Z', 'updated_at': '2022-02-08T18:12:30Z', 'revision_number': 5, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'subnets': [{'id': '73de7865-d87d-4a2a-a702-160c400f145f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:18:58.022188 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 037e84ed-14e6-4370-9a30-51a3144a8de4 {{(pid=102559) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:18:58.031193 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] Publish callbacks [] for port (037e84ed-14e6-4370-9a30-51a3144a8de4), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:58.043531 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.provisioning_blocks [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] Transition to ACTIVE for port object 037e84ed-14e6-4370-9a30-51a3144a8de4 will not be triggered until provisioned by entity L2. {{(pid=102559) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Feb 08 18:18:58.049066 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-63856478'] for port (037e84ed-14e6-4370-9a30-51a3144a8de4), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:58.086951 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-94259b32-c4f4-4523-899d-8ca31c03c5a1 None None] New status for floating IP 5fc12cc6-4f52-488c-9d27-d90b64bf94b3: DOWN {{(pid=102561) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Feb 08 18:18:58.138340 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 43578) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:18:58.165725 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] Pushing event updated for resources: {'Port': ['ID=037e84ed-14e6-4370-9a30-51a3144a8de4,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:58.203570 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3cb9b01d-7562-4733-b611-90385263676c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group (625bb656-8167-4dc7-8c84-0415217847fb), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:58.205076 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25533520-0a1c-4582-ba1a-ca1cbd822dda req-d7459cdc-1f59-4db1-8f80-6b6bef7189a9 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:58.211376 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-25533520-0a1c-4582-ba1a-ca1cbd822dda req-d7459cdc-1f59-4db1-8f80-6b6bef7189a9 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=82a87eac-3773-40e3-8cb3-4c5181dd42eb HTTP/1.1" status: 200 len: 944 time: 0.1148996 Feb 08 18:18:58.229389 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3cb9b01d-7562-4733-b611-90385263676c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group (625bb656-8167-4dc7-8c84-0415217847fb), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:58.241514 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] Attempting to bind port 037e84ed-14e6-4370-9a30-51a3144a8de4 on host hv-cinder-77398 for vnic_type normal with profile {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:18:58.241850 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] Attempting to bind port 037e84ed-14e6-4370-9a30-51a3144a8de4 by drivers openvswitch,hyperv on host hv-cinder-77398 at level 0 using segments [{'id': 'dfda56ea-4f8f-4241-8424-b3ed264aa208', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1054, 'network_id': '15a08cf2-cd5e-4df5-9cba-d45464825731'}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:18:58.242177 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] Attempting to bind port 037e84ed-14e6-4370-9a30-51a3144a8de4 on network 15a08cf2-cd5e-4df5-9cba-d45464825731 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:18:58.254175 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] Port 037e84ed-14e6-4370-9a30-51a3144a8de4 on network 15a08cf2-cd5e-4df5-9cba-d45464825731 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77398 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Feb 08 18:18:58.254501 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] Attempting to bind port 037e84ed-14e6-4370-9a30-51a3144a8de4 on network 15a08cf2-cd5e-4df5-9cba-d45464825731 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:18:58.267947 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] Checking agent: {'id': '045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77398', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'started_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 18, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:18:58.268279 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] Checking segment: {'id': 'dfda56ea-4f8f-4241-8424-b3ed264aa208', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1054, 'network_id': '15a08cf2-cd5e-4df5-9cba-d45464825731'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102559) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:18:58.268657 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] Bound using segment: {'id': 'dfda56ea-4f8f-4241-8424-b3ed264aa208', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1054, 'network_id': '15a08cf2-cd5e-4df5-9cba-d45464825731'} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:18:58.269075 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] Bound port: 037e84ed-14e6-4370-9a30-51a3144a8de4, host: hv-cinder-77398, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dfda56ea-4f8f-4241-8424-b3ed264aa208', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1054, 'network_id': '15a08cf2-cd5e-4df5-9cba-d45464825731'}}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:18:58.269404 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (037e84ed-14e6-4370-9a30-51a3144a8de4), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:58.282225 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-25533520-0a1c-4582-ba1a-ca1cbd822dda req-7f7c9ac6-938c-4224-b65b-3df48b2ada49 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/security-groups?id=66081d7a-f07b-4f82-ad72-c8f7a5870dcd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0686824 Feb 08 18:18:58.291893 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3cb9b01d-7562-4733-b611-90385263676c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (625bb656-8167-4dc7-8c84-0415217847fb), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:58.300309 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3cb9b01d-7562-4733-b611-90385263676c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:58.300309 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-3cb9b01d-7562-4733-b611-90385263676c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "DELETE /v2.0/security-groups/625bb656-8167-4dc7-8c84-0415217847fb HTTP/1.1" status: 204 len: 168 time: 0.1607282 Feb 08 18:18:58.300975 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 43580) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:18:58.321183 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cb9b01d-7562-4733-b611-90385263676c tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=625bb656-8167-4dc7-8c84-0415217847fb,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:58.323371 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.api.v2.resource [None req-52f896f6-66bd-48f0-9644-9821cbb582ce tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] show failed (client error): The resource could not be found. Feb 08 18:18:58.324498 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-52f896f6-66bd-48f0-9644-9821cbb582ce tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "GET /v2.0/security-groups/625bb656-8167-4dc7-8c84-0415217847fb HTTP/1.1" status: 404 len: 347 time: 0.0196507 Feb 08 18:18:58.327456 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 43582) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:18:58.344713 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] For port 037e84ed-14e6-4370-9a30-51a3144a8de4, host hv-cinder-77398, cleared binding levels {{(pid=102559) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:18:58.348093 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] For port 037e84ed-14e6-4370-9a30-51a3144a8de4, host hv-cinder-77398, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=037e84ed-14e6-4370-9a30-51a3144a8de4,segment=NetworkSegment(dfda56ea-4f8f-4241-8424-b3ed264aa208),segment_id=dfda56ea-4f8f-4241-8424-b3ed264aa208)] {{(pid=102559) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:18:58.354478 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-63856478'] for port (037e84ed-14e6-4370-9a30-51a3144a8de4), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:58.388006 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:58.388732 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:58.390104 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] 10.222.0.109 "PUT /v2.0/ports/037e84ed-14e6-4370-9a30-51a3144a8de4 HTTP/1.1" status: 200 len: 1094 time: 0.9442909 Feb 08 18:18:58.390543 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '82a87eac-3773-40e3-8cb3-4c5181dd42eb', 'tag': '037e84ed-14e6-4370-9a30-51a3144a8de4'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:18:58.392905 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7a8246e3-104f-4ba6-bdb6-ac3b3b3f7d87" -d '{"events": [{"name": "network-changed", "server_uuid": "82a87eac-3773-40e3-8cb3-4c5181dd42eb", "tag": "037e84ed-14e6-4370-9a30-51a3144a8de4"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:18:58.423447 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31e19f0b-063a-456a-8d24-82f8cb28b452 service neutron] Pushing event updated for resources: {'Port': ['ID=037e84ed-14e6-4370-9a30-51a3144a8de4,revision_number=3']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:58.457097 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-44a786a9-b6c8-4300-9f21-3aab5e424539 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Deleting port d9e5f415-0716-41fd-b19f-2aad9f978ef5 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:18:58.457447 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-44a786a9-b6c8-4300-9f21-3aab5e424539 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (d9e5f415-0716-41fd-b19f-2aad9f978ef5), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:58.525714 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-707a69d3-1c4c-496c-850f-ce596b977472 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:58.527416 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-707a69d3-1c4c-496c-850f-ce596b977472 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=c50a1910195245ff8254b7cca4fdfbaa&device_id=82a87eac-3773-40e3-8cb3-4c5181dd42eb HTTP/1.1" status: 200 len: 1128 time: 0.0510705 Feb 08 18:18:58.534725 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-44a786a9-b6c8-4300-9f21-3aab5e424539 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (d9e5f415-0716-41fd-b19f-2aad9f978ef5), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:58.535116 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-44a786a9-b6c8-4300-9f21-3aab5e424539 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for floatingip (d9e5f415-0716-41fd-b19f-2aad9f978ef5), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:58.547771 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-44a786a9-b6c8-4300-9f21-3aab5e424539 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Calling delete_port for d9e5f415-0716-41fd-b19f-2aad9f978ef5 owned by network:floatingip {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:18:58.571643 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-b7cc6c0c-15a1-476f-89ae-a4a0e9d8b55c service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=037e84ed-14e6-4370-9a30-51a3144a8de4 HTTP/1.1" status: 200 len: 217 time: 0.0379753 Feb 08 18:18:58.586747 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:18:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f57b0e4b-d500-4e07-8d18-ec53b56013f5 x-openstack-request-id: req-f57b0e4b-d500-4e07-8d18-ec53b56013f5 {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:18:58.587127 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "82a87eac-3773-40e3-8cb3-4c5181dd42eb", "tag": "037e84ed-14e6-4370-9a30-51a3144a8de4", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:18:58.587367 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-f57b0e4b-d500-4e07-8d18-ec53b56013f5 {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:18:58.587754 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '82a87eac-3773-40e3-8cb3-4c5181dd42eb', 'tag': '037e84ed-14e6-4370-9a30-51a3144a8de4', 'status': 'completed', 'code': 200} Feb 08 18:18:58.624523 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-45e94472-33d9-4dd8-9433-6d4f91d99434 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:58.626028 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-45e94472-33d9-4dd8-9433-6d4f91d99434 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=fe603f88-f21a-48c8-b9f7-c48877966ded HTTP/1.1" status: 200 len: 853 time: 0.0491374 Feb 08 18:18:58.659763 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-88369482-cf3a-42e7-bfc6-1808701150f6 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=15a08cf2-cd5e-4df5-9cba-d45464825731&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0272305 Feb 08 18:18:58.682396 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-44a786a9-b6c8-4300-9f21-3aab5e424539 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (d9e5f415-0716-41fd-b19f-2aad9f978ef5), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:58.707460 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44a786a9-b6c8-4300-9f21-3aab5e424539 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Pushing event deleted for resources: {'Port': ['ID=d9e5f415-0716-41fd-b19f-2aad9f978ef5,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:18:58.751005 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-98b325f1-d8df-4caa-8bbd-cbd2a175dec3 service neutron] 10.222.0.109 "GET /v2.0/networks/15a08cf2-cd5e-4df5-9cba-d45464825731?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0852327 Feb 08 18:18:58.777578 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-44a786a9-b6c8-4300-9f21-3aab5e424539 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks [] for floatingip (5fc12cc6-4f52-488c-9d27-d90b64bf94b3), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:58.782142 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-44a786a9-b6c8-4300-9f21-3aab5e424539 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for floatingip (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:18:58.783380 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-44a786a9-b6c8-4300-9f21-3aab5e424539 tempest-AttachVolumeShelveTestJSON-1736065417 tempest-AttachVolumeShelveTestJSON-1736065417-project] 10.222.0.118 "DELETE /v2.0/floatingips/5fc12cc6-4f52-488c-9d27-d90b64bf94b3 HTTP/1.1" status: 204 len: 168 time: 0.4549706 Feb 08 18:18:58.848535 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d14401a2-41a9-498a-9c2d-b9cdd575545d req-d8206df3-0c7d-489f-8a82-4e2630df3a66 service neutron] 10.222.0.109 "GET /v2.0/networks/15a08cf2-cd5e-4df5-9cba-d45464825731?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0908086 Feb 08 18:18:58.941063 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a8246e3-104f-4ba6-bdb6-ac3b3b3f7d87 req-60e3b0d6-ee64-4356-830a-7d6ace76de3e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:58.943434 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7a8246e3-104f-4ba6-bdb6-ac3b3b3f7d87 req-60e3b0d6-ee64-4356-830a-7d6ace76de3e service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=c50a1910195245ff8254b7cca4fdfbaa&device_id=82a87eac-3773-40e3-8cb3-4c5181dd42eb HTTP/1.1" status: 200 len: 1128 time: 0.0493889 Feb 08 18:18:59.045614 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a8246e3-104f-4ba6-bdb6-ac3b3b3f7d87 req-5ec4157e-b352-47e3-b888-c31d3a8d455a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:59.047128 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7a8246e3-104f-4ba6-bdb6-ac3b3b3f7d87 req-5ec4157e-b352-47e3-b888-c31d3a8d455a service neutron] 10.222.0.109 "GET /v2.0/networks?id=15a08cf2-cd5e-4df5-9cba-d45464825731 HTTP/1.1" status: 200 len: 915 time: 0.0960352 Feb 08 18:18:59.088928 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7a8246e3-104f-4ba6-bdb6-ac3b3b3f7d87 req-c96f1ebc-2945-48a9-b30e-c4f8c9094fca service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=037e84ed-14e6-4370-9a30-51a3144a8de4 HTTP/1.1" status: 200 len: 217 time: 0.0351560 Feb 08 18:18:59.137722 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a8246e3-104f-4ba6-bdb6-ac3b3b3f7d87 req-5e3e17af-d796-4b25-8b0f-ae757a7608af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:59.139206 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7a8246e3-104f-4ba6-bdb6-ac3b3b3f7d87 req-5e3e17af-d796-4b25-8b0f-ae757a7608af service neutron] 10.222.0.109 "GET /v2.0/subnets?id=fe603f88-f21a-48c8-b9f7-c48877966ded HTTP/1.1" status: 200 len: 853 time: 0.0444376 Feb 08 18:18:59.172543 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7a8246e3-104f-4ba6-bdb6-ac3b3b3f7d87 req-b09af14b-96b3-4524-b6d2-64bbe394f635 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=15a08cf2-cd5e-4df5-9cba-d45464825731&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0268230 Feb 08 18:18:59.264508 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7a8246e3-104f-4ba6-bdb6-ac3b3b3f7d87 req-0a6fc348-5001-4a7e-bafa-2955fce46069 service neutron] 10.222.0.109 "GET /v2.0/networks/15a08cf2-cd5e-4df5-9cba-d45464825731?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0854573 Feb 08 18:18:59.366700 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7a8246e3-104f-4ba6-bdb6-ac3b3b3f7d87 req-0cdaf586-2035-47d8-9d51-d5c671b3c793 service neutron] 10.222.0.109 "GET /v2.0/networks/15a08cf2-cd5e-4df5-9cba-d45464825731?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0945840 Feb 08 18:18:59.410994 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa65d63f-2fad-4a38-959d-2d9651043cbe req-feba6282-7811-410e-ba3d-813cce27e208 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:18:59.412464 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-fa65d63f-2fad-4a38-959d-2d9651043cbe req-feba6282-7811-410e-ba3d-813cce27e208 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=82a87eac-3773-40e3-8cb3-4c5181dd42eb HTTP/1.1" status: 200 len: 944 time: 0.0620706 Feb 08 18:18:59.459960 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-fa65d63f-2fad-4a38-959d-2d9651043cbe req-ee746995-3727-4b4c-b7ce-950b23f6d64a tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/security-groups?id=66081d7a-f07b-4f82-ad72-c8f7a5870dcd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416646 Feb 08 18:18:59.733181 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 50b2e85d-5914-4f54-9939-14603e53f04e no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:18:59.757229 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] No Port match for: 50b2e85d-5914-4f54-9939-14603e53f04e {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:18:59.757571 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 50b2e85d-5914-4f54-9939-14603e53f04e not bound to the agent host hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:19:00.585154 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5821bcb3-105e-4044-aa85-ffcdab1f0c24 req-295ff717-9fe1-4f2c-b638-0751db500771 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:00.586479 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5821bcb3-105e-4044-aa85-ffcdab1f0c24 req-295ff717-9fe1-4f2c-b638-0751db500771 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=82a87eac-3773-40e3-8cb3-4c5181dd42eb HTTP/1.1" status: 200 len: 944 time: 0.0542765 Feb 08 18:19:00.639120 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5821bcb3-105e-4044-aa85-ffcdab1f0c24 req-0648d5e0-2019-4883-8bb1-9cf1db852100 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/security-groups?id=66081d7a-f07b-4f82-ad72-c8f7a5870dcd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0441732 Feb 08 18:19:01.228360 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 43612) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:01.645285 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d3867cc9-bfac-4c28-b198-ca94ac4c036b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-559978'] for router_interface (058f0c04-e3de-4d16-8a7a-a7247919133c), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:01.746789 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 037e84ed-14e6-4370-9a30-51a3144a8de4 details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:19:01.765505 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9d59c3b9-f26a-4a72-9368-89748fe366b6 req-a89ddfce-d2ab-4445-a3a6-be0a1b1804df tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:01.767066 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9d59c3b9-f26a-4a72-9368-89748fe366b6 req-a89ddfce-d2ab-4445-a3a6-be0a1b1804df tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=82a87eac-3773-40e3-8cb3-4c5181dd42eb HTTP/1.1" status: 200 len: 944 time: 0.0545449 Feb 08 18:19:01.815841 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9d59c3b9-f26a-4a72-9368-89748fe366b6 req-179e32aa-cc18-4454-9c7a-5a23daca2b1a tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/security-groups?id=66081d7a-f07b-4f82-ad72-c8f7a5870dcd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421717 Feb 08 18:19:01.859937 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 037e84ed-14e6-4370-9a30-51a3144a8de4, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=037e84ed-14e6-4370-9a30-51a3144a8de4,segment=NetworkSegment(dfda56ea-4f8f-4241-8424-b3ed264aa208),segment_id=dfda56ea-4f8f-4241-8424-b3ed264aa208)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:19:01.874147 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': '037e84ed-14e6-4370-9a30-51a3144a8de4', 'network_id': '15a08cf2-cd5e-4df5-9cba-d45464825731', 'port_id': '037e84ed-14e6-4370-9a30-51a3144a8de4', 'mac_address': 'fa:16:3e:de:42:89', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1054, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fe603f88-f21a-48c8-b9f7-c48877966ded', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:19:01.900130 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-d3867cc9-bfac-4c28-b198-ca94ac4c036b admin admin] Deleting port e29130bd-e04d-4042-835b-4ba71dbf114e {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:19:01.900346 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d3867cc9-bfac-4c28-b198-ca94ac4c036b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (e29130bd-e04d-4042-835b-4ba71dbf114e), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:01.922600 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 037e84ed-14e6-4370-9a30-51a3144a8de4 is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:19:01.923167 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (037e84ed-14e6-4370-9a30-51a3144a8de4), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:01.939993 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 037e84ed-14e6-4370-9a30-51a3144a8de4 {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:19:01.964576 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 037e84ed-14e6-4370-9a30-51a3144a8de4, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=037e84ed-14e6-4370-9a30-51a3144a8de4,segment=NetworkSegment(dfda56ea-4f8f-4241-8424-b3ed264aa208),segment_id=dfda56ea-4f8f-4241-8424-b3ed264aa208)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:19:01.970589 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (037e84ed-14e6-4370-9a30-51a3144a8de4), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:01.984174 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [None req-d3867cc9-bfac-4c28-b198-ca94ac4c036b admin admin] For port e29130bd-e04d-4042-835b-4ba71dbf114e, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=e29130bd-e04d-4042-835b-4ba71dbf114e,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:19:01.984535 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d3867cc9-bfac-4c28-b198-ca94ac4c036b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (e29130bd-e04d-4042-835b-4ba71dbf114e), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:01.997894 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-d3867cc9-bfac-4c28-b198-ca94ac4c036b admin admin] Calling delete_port for e29130bd-e04d-4042-835b-4ba71dbf114e owned by network:router_interface {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:19:02.026953 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=037e84ed-14e6-4370-9a30-51a3144a8de4,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:02.031962 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:02.032323 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:02.032672 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:02.033015 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:02.033354 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:02.033690 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:02.034026 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:02.034356 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:02.034701 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:02.035045 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:02.035368 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:02.035689 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:02.036009 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:02.183832 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d3867cc9-bfac-4c28-b198-ca94ac4c036b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (e29130bd-e04d-4042-835b-4ba71dbf114e), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:02.205590 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['037e84ed-14e6-4370-9a30-51a3144a8de4'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:19:02.212061 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3867cc9-bfac-4c28-b198-ca94ac4c036b admin admin] Pushing event deleted for resources: {'Port': ['ID=e29130bd-e04d-4042-835b-4ba71dbf114e,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:02.391265 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d3867cc9-bfac-4c28-b198-ca94ac4c036b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-631690', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-560126'] for router_interface (058f0c04-e3de-4d16-8a7a-a7247919133c), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:02.606190 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d3867cc9-bfac-4c28-b198-ca94ac4c036b admin admin] Router 058f0c04-e3de-4d16-8a7a-a7247919133c has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:19:02.709916 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d3867cc9-bfac-4c28-b198-ca94ac4c036b admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:19:02.714902 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-d3867cc9-bfac-4c28-b198-ca94ac4c036b admin admin] 10.222.0.118 "PUT /v2.0/routers/058f0c04-e3de-4d16-8a7a-a7247919133c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4855146 Feb 08 18:19:02.718117 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 43618) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:02.719159 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e9a974d-a7b7-4725-b5d0-ac5908d2ac27 None None] Sync routers for ids ['058f0c04-e3de-4d16-8a7a-a7247919133c'] in dv-cinder-773985-21-iscsi {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:19:02.730785 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e9a974d-a7b7-4725-b5d0-ac5908d2ac27 None None] Routers {'058f0c04-e3de-4d16-8a7a-a7247919133c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:19:02.731595 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-8e9a974d-a7b7-4725-b5d0-ac5908d2ac27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:18:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['058f0c04-e3de-4d16-8a7a-a7247919133c'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:19:02.822444 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7b3e1056-926a-4785-b9a0-fa2be8d3e152 admin admin] Publish callbacks [] for router (058f0c04-e3de-4d16-8a7a-a7247919133c), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:02.838558 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-8e9a974d-a7b7-4725-b5d0-ac5908d2ac27 None None] Set router 058f0c04-e3de-4d16-8a7a-a7247919133c gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:19:02.930537 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7b3e1056-926a-4785-b9a0-fa2be8d3e152 admin admin] Publish callbacks [] for router_gateway (058f0c04-e3de-4d16-8a7a-a7247919133c), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:02.939064 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e7853867-65a9-47fd-ac78-d51de1a060e8 req-2ddcefec-a17a-4017-a1f3-7091c81edad1 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:02.940674 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e7853867-65a9-47fd-ac78-d51de1a060e8 req-2ddcefec-a17a-4017-a1f3-7091c81edad1 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=82a87eac-3773-40e3-8cb3-4c5181dd42eb HTTP/1.1" status: 200 len: 945 time: 0.0577676 Feb 08 18:19:02.982879 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-7b3e1056-926a-4785-b9a0-fa2be8d3e152 admin admin] Deleting port 2aaec302-cd25-4e18-b85c-4834b2fc0c69 {{(pid=102559) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:19:02.983301 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7b3e1056-926a-4785-b9a0-fa2be8d3e152 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (2aaec302-cd25-4e18-b85c-4834b2fc0c69), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:02.988356 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e7853867-65a9-47fd-ac78-d51de1a060e8 req-91f9df48-8f93-447a-9296-3de6d35d46a0 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/security-groups?id=66081d7a-f07b-4f82-ad72-c8f7a5870dcd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0415587 Feb 08 18:19:03.030167 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-8e9a974d-a7b7-4725-b5d0-ac5908d2ac27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'name': 'tempest-AttachVolumeShelveTestJSON-785190803-router', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106'}], 'enable_snat': True}, 'gw_port_id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:11Z', 'updated_at': '2022-02-08T18:19:02Z', 'revision_number': 5, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'gw_port': {'id': '2aaec302-cd25-4e18-b85c-4834b2fc0c69', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:6f:49:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.106', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:12:14Z', 'updated_at': '2022-02-08T18:12:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:19:03.056462 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e9a974d-a7b7-4725-b5d0-ac5908d2ac27 None None] Checking router: 058f0c04-e3de-4d16-8a7a-a7247919133c for host: dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:19:03.063873 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [None req-7b3e1056-926a-4785-b9a0-fa2be8d3e152 admin admin] For port 2aaec302-cd25-4e18-b85c-4834b2fc0c69, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=2aaec302-cd25-4e18-b85c-4834b2fc0c69,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102559) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:19:03.064234 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7b3e1056-926a-4785-b9a0-fa2be8d3e152 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (2aaec302-cd25-4e18-b85c-4834b2fc0c69), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:03.065207 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8e9a974d-a7b7-4725-b5d0-ac5908d2ac27 None None] Routers {'058f0c04-e3de-4d16-8a7a-a7247919133c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:19:03.065803 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-8e9a974d-a7b7-4725-b5d0-ac5908d2ac27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:18:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['058f0c04-e3de-4d16-8a7a-a7247919133c'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:19:03.076883 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-7b3e1056-926a-4785-b9a0-fa2be8d3e152 admin admin] Calling delete_port for 2aaec302-cd25-4e18-b85c-4834b2fc0c69 owned by network:router_gateway {{(pid=102559) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:19:03.151263 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-8e9a974d-a7b7-4725-b5d0-ac5908d2ac27 None None] Set router 058f0c04-e3de-4d16-8a7a-a7247919133c gateway port host: None {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:19:03.204378 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-8e9a974d-a7b7-4725-b5d0-ac5908d2ac27 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'name': 'tempest-AttachVolumeShelveTestJSON-785190803-router', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:11Z', 'updated_at': '2022-02-08T18:19:02Z', 'revision_number': 6, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'gw_port_host': None}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:19:03.229739 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8e9a974d-a7b7-4725-b5d0-ac5908d2ac27 None None] The sync data for ids ['058f0c04-e3de-4d16-8a7a-a7247919133c'] in dv-cinder-773985-21-iscsi is: [{'id': '058f0c04-e3de-4d16-8a7a-a7247919133c', 'name': 'tempest-AttachVolumeShelveTestJSON-785190803-router', 'tenant_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:12:11Z', 'updated_at': '2022-02-08T18:19:02Z', 'revision_number': 6, 'project_id': '357dab3d3db74ef9a8ee50fdd8a8bdcd', 'gw_port_host': None}] {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:19:03.238677 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7b3e1056-926a-4785-b9a0-fa2be8d3e152 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (2aaec302-cd25-4e18-b85c-4834b2fc0c69), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:03.264594 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b3e1056-926a-4785-b9a0-fa2be8d3e152 admin admin] Pushing event deleted for resources: {'Port': ['ID=2aaec302-cd25-4e18-b85c-4834b2fc0c69,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:03.324645 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7b3e1056-926a-4785-b9a0-fa2be8d3e152 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-560668'] for router_gateway (058f0c04-e3de-4d16-8a7a-a7247919133c), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:03.415098 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7b3e1056-926a-4785-b9a0-fa2be8d3e152 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-557467', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6918'] for router (058f0c04-e3de-4d16-8a7a-a7247919133c), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:03.417197 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7b3e1056-926a-4785-b9a0-fa2be8d3e152 admin admin] Publish callbacks [] for router_controller (058f0c04-e3de-4d16-8a7a-a7247919133c), precommit_delete_associations {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:03.468226 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7b3e1056-926a-4785-b9a0-fa2be8d3e152 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-557452'] for router (058f0c04-e3de-4d16-8a7a-a7247919133c), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:03.468714 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7b3e1056-926a-4785-b9a0-fa2be8d3e152 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 058f0c04-e3de-4d16-8a7a-a7247919133c {{(pid=102559) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Feb 08 18:19:03.473536 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7b3e1056-926a-4785-b9a0-fa2be8d3e152 admin admin] Publish callbacks [] for router (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:03.474692 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-7b3e1056-926a-4785-b9a0-fa2be8d3e152 admin admin] 10.222.0.118 "DELETE /v2.0/routers/058f0c04-e3de-4d16-8a7a-a7247919133c HTTP/1.1" status: 204 len: 168 time: 0.7555244 Feb 08 18:19:03.478558 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 43622) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:03.522008 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_v2 [None req-f61c38f5-f0ef-46f5-aac6-63b41b992ed4 admin admin] Deleting subnet 73de7865-d87d-4a2a-a702-160c400f145f {{(pid=102559) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Feb 08 18:19:03.525282 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f61c38f5-f0ef-46f5-aac6-63b41b992ed4 admin admin] Publish callbacks [] for subnet (73de7865-d87d-4a2a-a702-160c400f145f), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:03.562661 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f61c38f5-f0ef-46f5-aac6-63b41b992ed4 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-63850237'] for subnet (73de7865-d87d-4a2a-a702-160c400f145f), precommit_delete_associations {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:03.657338 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f61c38f5-f0ef-46f5-aac6-63b41b992ed4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1801023'] for subnet (73de7865-d87d-4a2a-a702-160c400f145f), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:03.715404 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f61c38f5-f0ef-46f5-aac6-63b41b992ed4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1801156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-63856520', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-63685312'] for subnet (73de7865-d87d-4a2a-a702-160c400f145f), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:03.746450 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f61c38f5-f0ef-46f5-aac6-63b41b992ed4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=73de7865-d87d-4a2a-a702-160c400f145f,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:03.748375 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f61c38f5-f0ef-46f5-aac6-63b41b992ed4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:03.751643 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-f61c38f5-f0ef-46f5-aac6-63b41b992ed4 admin admin] 10.222.0.118 "DELETE /v2.0/subnets/73de7865-d87d-4a2a-a702-160c400f145f HTTP/1.1" status: 204 len: 168 time: 0.2721462 Feb 08 18:19:03.754550 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 43624) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:03.756551 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-de49dd54-a493-4861-8fe5-f10e5a3ddc68 None None] Network 7a854399-3ce6-42bd-bfc4-061132ecb9c2 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:19:03.771379 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 037e84ed-14e6-4370-9a30-51a3144a8de4 up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:19:03.825078 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ce07d10c-69c1-4bab-9c61-f5d9b9d5e10c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1860329'] for network (7a854399-3ce6-42bd-bfc4-061132ecb9c2), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:03.879705 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-ce07d10c-69c1-4bab-9c61-f5d9b9d5e10c admin admin] Deleting port d9374f34-b117-40ce-9bb7-744f0c221b6b {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:19:03.880317 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ce07d10c-69c1-4bab-9c61-f5d9b9d5e10c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (d9374f34-b117-40ce-9bb7-744f0c221b6b), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:03.883644 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning for port 037e84ed-14e6-4370-9a30-51a3144a8de4 completed by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Feb 08 18:19:03.887631 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port 037e84ed-14e6-4370-9a30-51a3144a8de4 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:19:03.888004 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (037e84ed-14e6-4370-9a30-51a3144a8de4), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:03.949042 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [None req-ce07d10c-69c1-4bab-9c61-f5d9b9d5e10c admin admin] For port d9374f34-b117-40ce-9bb7-744f0c221b6b, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=d9374f34-b117-40ce-9bb7-744f0c221b6b,segment=NetworkSegment(87601f46-1ba0-4a2e-93d3-e5859bcfbefa),segment_id=87601f46-1ba0-4a2e-93d3-e5859bcfbefa)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:19:03.949407 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ce07d10c-69c1-4bab-9c61-f5d9b9d5e10c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (d9374f34-b117-40ce-9bb7-744f0c221b6b), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:03.967616 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-ce07d10c-69c1-4bab-9c61-f5d9b9d5e10c admin admin] Calling delete_port for d9374f34-b117-40ce-9bb7-744f0c221b6b owned by network:dhcp {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:19:03.977550 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 037e84ed-14e6-4370-9a30-51a3144a8de4 is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:19:03.977944 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (037e84ed-14e6-4370-9a30-51a3144a8de4), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:03.990309 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-40db31cb-3afe-4d6b-b729-31c7b2683d3a None None] DHCP port deletion for 7a854399-3ce6-42bd-bfc4-061132ecb9c2 request from dv-cinder-773985-21-iscsi {{(pid=102561) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Feb 08 18:19:04.033747 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '82a87eac-3773-40e3-8cb3-4c5181dd42eb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '037e84ed-14e6-4370-9a30-51a3144a8de4'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:19:04.036745 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c3a3ed14-394f-43db-915a-2b4ef93cd76e" -d '{"events": [{"server_uuid": "82a87eac-3773-40e3-8cb3-4c5181dd42eb", "name": "network-vif-plugged", "status": "completed", "tag": "037e84ed-14e6-4370-9a30-51a3144a8de4"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:19:04.067497 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 037e84ed-14e6-4370-9a30-51a3144a8de4, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=037e84ed-14e6-4370-9a30-51a3144a8de4,segment=NetworkSegment(dfda56ea-4f8f-4241-8424-b3ed264aa208),segment_id=dfda56ea-4f8f-4241-8424-b3ed264aa208)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:19:04.071404 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 2aaec302-cd25-4e18-b85c-4834b2fc0c69 no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:19:04.091979 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ce07d10c-69c1-4bab-9c61-f5d9b9d5e10c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (d9374f34-b117-40ce-9bb7-744f0c221b6b), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:04.112011 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:19:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e06e1791-fe03-431b-bcf5-7a22bbb6950d x-openstack-request-id: req-e06e1791-fe03-431b-bcf5-7a22bbb6950d {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:19:04.112359 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "82a87eac-3773-40e3-8cb3-4c5181dd42eb", "name": "network-vif-plugged", "status": "completed", "tag": "037e84ed-14e6-4370-9a30-51a3144a8de4", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:19:04.112587 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-e06e1791-fe03-431b-bcf5-7a22bbb6950d {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:19:04.112964 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '82a87eac-3773-40e3-8cb3-4c5181dd42eb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '037e84ed-14e6-4370-9a30-51a3144a8de4', 'code': 200} Feb 08 18:19:04.113998 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (037e84ed-14e6-4370-9a30-51a3144a8de4), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:04.116552 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: 2aaec302-cd25-4e18-b85c-4834b2fc0c69 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:19:04.116885 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 2aaec302-cd25-4e18-b85c-4834b2fc0c69 not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:19:04.117465 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device e29130bd-e04d-4042-835b-4ba71dbf114e no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:19:04.120617 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce07d10c-69c1-4bab-9c61-f5d9b9d5e10c admin admin] Pushing event deleted for resources: {'Port': ['ID=d9374f34-b117-40ce-9bb7-744f0c221b6b,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:04.125210 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce07d10c-69c1-4bab-9c61-f5d9b9d5e10c admin admin] No DVR routers for this DVR port d9374f34-b117-40ce-9bb7-744f0c221b6b on host dv-cinder-773985-21-iscsi {{(pid=102560) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:19:04.165445 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: e29130bd-e04d-4042-835b-4ba71dbf114e {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:19:04.165783 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device e29130bd-e04d-4042-835b-4ba71dbf114e not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:19:04.166207 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device d9374f34-b117-40ce-9bb7-744f0c221b6b no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:19:04.196161 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97074ff8-0689-4223-a2ed-4395ebbc6d5f req-2cdcf5ba-eb90-4660-811f-41e7078a41f1 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:04.198810 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: d9374f34-b117-40ce-9bb7-744f0c221b6b {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:19:04.199514 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device d9374f34-b117-40ce-9bb7-744f0c221b6b not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:19:04.200051 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-97074ff8-0689-4223-a2ed-4395ebbc6d5f req-2cdcf5ba-eb90-4660-811f-41e7078a41f1 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=82a87eac-3773-40e3-8cb3-4c5181dd42eb HTTP/1.1" status: 200 len: 946 time: 0.1061220 Feb 08 18:19:04.205535 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ce07d10c-69c1-4bab-9c61-f5d9b9d5e10c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1721768', 'neutron.services.segments.db._delete_segments_for_network-8770558865089'] for network (7a854399-3ce6-42bd-bfc4-061132ecb9c2), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:04.210147 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-40db31cb-3afe-4d6b-b729-31c7b2683d3a None None] Deleting port d9374f34-b117-40ce-9bb7-744f0c221b6b {{(pid=102561) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:19:04.210664 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-40db31cb-3afe-4d6b-b729-31c7b2683d3a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (d9374f34-b117-40ce-9bb7-744f0c221b6b), before_delete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:04.230712 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-ce07d10c-69c1-4bab-9c61-f5d9b9d5e10c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7a854399-3ce6-42bd-bfc4-061132ecb9c2']}} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:19:04.242135 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=037e84ed-14e6-4370-9a30-51a3144a8de4,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:04.242618 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-ce07d10c-69c1-4bab-9c61-f5d9b9d5e10c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '87601f46-1ba0-4a2e-93d3-e5859bcfbefa') {'for_net_delete': True} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:19:04.242959 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-ce07d10c-69c1-4bab-9c61-f5d9b9d5e10c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '87601f46-1ba0-4a2e-93d3-e5859bcfbefa') {} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:19:04.254609 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ce07d10c-69c1-4bab-9c61-f5d9b9d5e10c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8770558866122', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-64533840'] for segment (87601f46-1ba0-4a2e-93d3-e5859bcfbefa), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:04.267041 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-97074ff8-0689-4223-a2ed-4395ebbc6d5f req-3124df06-eef8-4fe3-a9d5-d9811af48181 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/security-groups?id=66081d7a-f07b-4f82-ad72-c8f7a5870dcd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0532780 Feb 08 18:19:04.269441 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ce07d10c-69c1-4bab-9c61-f5d9b9d5e10c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (87601f46-1ba0-4a2e-93d3-e5859bcfbefa), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:04.276075 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-ce07d10c-69c1-4bab-9c61-f5d9b9d5e10c admin admin] Releasing vlan 1053 on physical network physnet1 to pool {{(pid=102560) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Feb 08 18:19:04.276465 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ce07d10c-69c1-4bab-9c61-f5d9b9d5e10c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-64531704'] for segment (87601f46-1ba0-4a2e-93d3-e5859bcfbefa), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: Traceback (most recent call last): Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: timer() Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: cb(*args, **kw) Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: return func(*args, **kwargs) Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: self._notify() Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: self.callback(batched_events) Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: event.method(event) Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: aggregate_uuid = self.p_client.list_aggregates( Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: return f(self, *a, **k) Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: return self._get(url).json() Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: return self._client.get(url, endpoint_filter=self._ks_filter, Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: return self.request(url, 'GET', **kwargs) Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: base_url = self.get_endpoint(auth, allow=allow, Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 08 18:19:04.278189 dv-cinder-773985-21-iscsi neutron-server[102560]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 08 18:19:04.336865 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90fe9e49-5ba4-4f51-8c6f-38a6608f450d req-ad5abfb4-8501-4247-a8ec-829d7a58e58c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:04.337129 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-40db31cb-3afe-4d6b-b729-31c7b2683d3a None None] For port d9374f34-b117-40ce-9bb7-744f0c221b6b, host dv-cinder-773985-21-iscsi, got binding levels [] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:19:04.338117 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-40db31cb-3afe-4d6b-b729-31c7b2683d3a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (d9374f34-b117-40ce-9bb7-744f0c221b6b), precommit_delete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:04.341702 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-90fe9e49-5ba4-4f51-8c6f-38a6608f450d req-ad5abfb4-8501-4247-a8ec-829d7a58e58c service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=82a87eac-3773-40e3-8cb3-4c5181dd42eb HTTP/1.1" status: 200 len: 1130 time: 0.0586479 Feb 08 18:19:04.343967 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ce07d10c-69c1-4bab-9c61-f5d9b9d5e10c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1721777', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-560760'] for network (7a854399-3ce6-42bd-bfc4-061132ecb9c2), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:04.353681 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-ce07d10c-69c1-4bab-9c61-f5d9b9d5e10c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:04.355035 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-40db31cb-3afe-4d6b-b729-31c7b2683d3a None None] Calling delete_port for d9374f34-b117-40ce-9bb7-744f0c221b6b owned by network:dhcp {{(pid=102561) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:19:04.357149 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-ce07d10c-69c1-4bab-9c61-f5d9b9d5e10c admin admin] 10.222.0.118 "DELETE /v2.0/networks/7a854399-3ce6-42bd-bfc4-061132ecb9c2 HTTP/1.1" status: 204 len: 168 time: 0.6015031 Feb 08 18:19:04.358345 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.ipam_backend_mixin [None req-40db31cb-3afe-4d6b-b729-31c7b2683d3a None None] Port d9374f34-b117-40ce-9bb7-744f0c221b6b was not found and therefore no delete operation was performed {{(pid=102561) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Feb 08 18:19:04.360101 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-40db31cb-3afe-4d6b-b729-31c7b2683d3a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442'] for port (d9374f34-b117-40ce-9bb7-744f0c221b6b), after_delete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:04.387443 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-40db31cb-3afe-4d6b-b729-31c7b2683d3a None None] Network 7a854399-3ce6-42bd-bfc4-061132ecb9c2 is not hosted by any dhcp agent {{(pid=102561) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Feb 08 18:19:04.388000 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-40db31cb-3afe-4d6b-b729-31c7b2683d3a None None] No DVR routers for this DVR port d9374f34-b117-40ce-9bb7-744f0c221b6b on host dv-cinder-773985-21-iscsi {{(pid=102561) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:19:04.389916 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40db31cb-3afe-4d6b-b729-31c7b2683d3a None None] Pushing event deleted for resources: {'Port': ['ID=d9374f34-b117-40ce-9bb7-744f0c221b6b,revision_number=None']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:04.391032 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce07d10c-69c1-4bab-9c61-f5d9b9d5e10c admin admin] Pushing event deleted for resources: {'Network': ['ID=7a854399-3ce6-42bd-bfc4-061132ecb9c2,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:04.404346 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-90fe9e49-5ba4-4f51-8c6f-38a6608f450d req-5ab81866-c45e-45c6-9866-7070db773adb service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=66081d7a-f07b-4f82-ad72-c8f7a5870dcd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0576353 Feb 08 18:19:04.490357 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 43632) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:04.531478 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-0ce8afa6-730e-443e-ab28-a0be9faf0d19 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=357dab3d3db74ef9a8ee50fdd8a8bdcd&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0398080 Feb 08 18:19:04.534040 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 43634) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:04.581994 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fd4ece2c-b5cd-4a92-a7a6-346e077e7685 admin admin] Publish callbacks [] for security_group (fe897b30-e023-4c28-9280-5753c32a5659), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:04.604417 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fd4ece2c-b5cd-4a92-a7a6-346e077e7685 admin admin] Publish callbacks [] for security_group (fe897b30-e023-4c28-9280-5753c32a5659), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:04.653911 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fd4ece2c-b5cd-4a92-a7a6-346e077e7685 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (fe897b30-e023-4c28-9280-5753c32a5659), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:04.656624 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-fd4ece2c-b5cd-4a92-a7a6-346e077e7685 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:04.657711 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-fd4ece2c-b5cd-4a92-a7a6-346e077e7685 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/fe897b30-e023-4c28-9280-5753c32a5659 HTTP/1.1" status: 204 len: 168 time: 0.1227424 Feb 08 18:19:04.665615 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd4ece2c-b5cd-4a92-a7a6-346e077e7685 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe897b30-e023-4c28-9280-5753c32a5659,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:05.401331 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98d78a54-af8e-48a8-88b8-30fbfb5a0655 req-14f8a879-229d-4550-9d4c-05b9302552f6 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:05.402809 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-98d78a54-af8e-48a8-88b8-30fbfb5a0655 req-14f8a879-229d-4550-9d4c-05b9302552f6 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=82a87eac-3773-40e3-8cb3-4c5181dd42eb HTTP/1.1" status: 200 len: 946 time: 0.0612333 Feb 08 18:19:05.449056 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-98d78a54-af8e-48a8-88b8-30fbfb5a0655 req-adf4d940-f345-40eb-91b8-d395e08c4b3c tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/security-groups?id=66081d7a-f07b-4f82-ad72-c8f7a5870dcd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402930 Feb 08 18:19:06.578812 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fbebecc-aef5-4651-92c2-26f6961d3c48 req-8b86eb8b-3131-473c-bd50-c0f3a721fe1f tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:06.580209 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-4fbebecc-aef5-4651-92c2-26f6961d3c48 req-8b86eb8b-3131-473c-bd50-c0f3a721fe1f tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=82a87eac-3773-40e3-8cb3-4c5181dd42eb HTTP/1.1" status: 200 len: 946 time: 0.0576036 Feb 08 18:19:06.626481 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-4fbebecc-aef5-4651-92c2-26f6961d3c48 req-cd7634c9-b6c8-4c9e-a0cd-d49ed8125e1c tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/security-groups?id=66081d7a-f07b-4f82-ad72-c8f7a5870dcd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0405135 Feb 08 18:19:09.182492 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 43788) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:09.307328 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5357dd22-5f7b-4434-9116-67d42fcf5dbb admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:09.384985 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5357dd22-5f7b-4434-9116-67d42fcf5dbb admin admin] Publish callbacks [] for security_group (6ccb71bb-6811-49cc-971d-0f46034c020a), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:09.390251 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5357dd22-5f7b-4434-9116-67d42fcf5dbb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (6ccb71bb-6811-49cc-971d-0f46034c020a), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:09.429041 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-5357dd22-5f7b-4434-9116-67d42fcf5dbb admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=77ff7395f05848a0b3f3ba2fa364f65c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2449901 Feb 08 18:19:09.429896 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5357dd22-5f7b-4434-9116-67d42fcf5dbb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6ccb71bb-6811-49cc-971d-0f46034c020a,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:09.431894 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 43794) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:09.479769 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-a3f22e2e-d29c-48c3-ad5e-b61b48135ecb admin admin] Publish callbacks [] for security_group (6ccb71bb-6811-49cc-971d-0f46034c020a), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:09.502577 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-a3f22e2e-d29c-48c3-ad5e-b61b48135ecb admin admin] Publish callbacks [] for security_group (6ccb71bb-6811-49cc-971d-0f46034c020a), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:09.553890 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-a3f22e2e-d29c-48c3-ad5e-b61b48135ecb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (6ccb71bb-6811-49cc-971d-0f46034c020a), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:09.556670 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-a3f22e2e-d29c-48c3-ad5e-b61b48135ecb admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:09.558007 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-a3f22e2e-d29c-48c3-ad5e-b61b48135ecb admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/6ccb71bb-6811-49cc-971d-0f46034c020a HTTP/1.1" status: 204 len: 168 time: 0.1249793 Feb 08 18:19:09.565872 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3f22e2e-d29c-48c3-ad5e-b61b48135ecb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6ccb71bb-6811-49cc-971d-0f46034c020a,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:09.842663 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 43800) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:09.856034 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9e43d0e9-f153-439f-8230-5cf18ec9d837 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:09.932509 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9e43d0e9-f153-439f-8230-5cf18ec9d837 admin admin] Publish callbacks [] for security_group (b81f78c2-9f20-4d80-9e49-34d65c5c3dbf), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:09.937720 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9e43d0e9-f153-439f-8230-5cf18ec9d837 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (b81f78c2-9f20-4d80-9e49-34d65c5c3dbf), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:09.976438 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-9e43d0e9-f153-439f-8230-5cf18ec9d837 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=4aba00ec9d184afc8b54f2eba9e4d949&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1326344 Feb 08 18:19:09.977357 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e43d0e9-f153-439f-8230-5cf18ec9d837 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b81f78c2-9f20-4d80-9e49-34d65c5c3dbf,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:09.979606 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 43802) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:10.029254 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2da3213e-53fb-4125-8a46-bcb3421b4e66 admin admin] Publish callbacks [] for security_group (b81f78c2-9f20-4d80-9e49-34d65c5c3dbf), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:10.052409 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2da3213e-53fb-4125-8a46-bcb3421b4e66 admin admin] Publish callbacks [] for security_group (b81f78c2-9f20-4d80-9e49-34d65c5c3dbf), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:10.106493 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2da3213e-53fb-4125-8a46-bcb3421b4e66 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (b81f78c2-9f20-4d80-9e49-34d65c5c3dbf), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:10.110269 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-2da3213e-53fb-4125-8a46-bcb3421b4e66 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:10.111856 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-2da3213e-53fb-4125-8a46-bcb3421b4e66 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/b81f78c2-9f20-4d80-9e49-34d65c5c3dbf HTTP/1.1" status: 204 len: 168 time: 0.1313033 Feb 08 18:19:10.120187 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2da3213e-53fb-4125-8a46-bcb3421b4e66 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b81f78c2-9f20-4d80-9e49-34d65c5c3dbf,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:11.814621 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 43856) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:11.940540 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7bb776d4-c7e5-458a-a6e4-2736f2ff5c79 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:12.023050 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7bb776d4-c7e5-458a-a6e4-2736f2ff5c79 admin admin] Publish callbacks [] for security_group (6bf4ba37-364b-47c4-877b-10080008e96a), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:12.028103 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7bb776d4-c7e5-458a-a6e4-2736f2ff5c79 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (6bf4ba37-364b-47c4-877b-10080008e96a), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:12.066867 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-7bb776d4-c7e5-458a-a6e4-2736f2ff5c79 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=a6546638c1184a86a335a02b3c42f321&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2510362 Feb 08 18:19:12.067750 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bb776d4-c7e5-458a-a6e4-2736f2ff5c79 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6bf4ba37-364b-47c4-877b-10080008e96a,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:12.069997 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 43860) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:12.124117 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1a31214d-0f2c-4d5d-afe1-353b241e3d0d admin admin] Publish callbacks [] for security_group (6bf4ba37-364b-47c4-877b-10080008e96a), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:12.147899 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1a31214d-0f2c-4d5d-afe1-353b241e3d0d admin admin] Publish callbacks [] for security_group (6bf4ba37-364b-47c4-877b-10080008e96a), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:12.202247 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1a31214d-0f2c-4d5d-afe1-353b241e3d0d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (6bf4ba37-364b-47c4-877b-10080008e96a), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:12.204847 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-1a31214d-0f2c-4d5d-afe1-353b241e3d0d admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:12.205981 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-1a31214d-0f2c-4d5d-afe1-353b241e3d0d admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/6bf4ba37-364b-47c4-877b-10080008e96a HTTP/1.1" status: 204 len: 168 time: 0.1349931 Feb 08 18:19:12.213527 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a31214d-0f2c-4d5d-afe1-353b241e3d0d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6bf4ba37-364b-47c4-877b-10080008e96a,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:12.484027 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 43874) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:12.496941 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-078c00bc-1740-4b98-9444-67ef416c1eb4 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:12.576765 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-078c00bc-1740-4b98-9444-67ef416c1eb4 admin admin] Publish callbacks [] for security_group (6beabb13-2151-4938-a3ff-252f27235145), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:12.581661 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-078c00bc-1740-4b98-9444-67ef416c1eb4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (6beabb13-2151-4938-a3ff-252f27235145), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:12.624405 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-078c00bc-1740-4b98-9444-67ef416c1eb4 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=08a1aec5a51d461dbe45662aed28845e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1392224 Feb 08 18:19:12.625572 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-078c00bc-1740-4b98-9444-67ef416c1eb4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6beabb13-2151-4938-a3ff-252f27235145,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:12.627374 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 43876) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:12.683142 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d359874e-ab1a-4882-92fd-51f3704adaa0 admin admin] Publish callbacks [] for security_group (6beabb13-2151-4938-a3ff-252f27235145), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:12.707157 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d359874e-ab1a-4882-92fd-51f3704adaa0 admin admin] Publish callbacks [] for security_group (6beabb13-2151-4938-a3ff-252f27235145), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:12.765869 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d359874e-ab1a-4882-92fd-51f3704adaa0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (6beabb13-2151-4938-a3ff-252f27235145), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:12.768844 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-d359874e-ab1a-4882-92fd-51f3704adaa0 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:12.770031 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-d359874e-ab1a-4882-92fd-51f3704adaa0 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/6beabb13-2151-4938-a3ff-252f27235145 HTTP/1.1" status: 204 len: 168 time: 0.1413181 Feb 08 18:19:12.778434 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d359874e-ab1a-4882-92fd-51f3704adaa0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6beabb13-2151-4938-a3ff-252f27235145,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:15.125674 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-19d91c46-e397-40fd-ba59-c1253d35dbdf tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1840993501&fields=id&tenant_id=768f50510c57419e8a49ed0988014174 HTTP/1.1" status: 200 len: 267 time: 0.0505731 Feb 08 18:19:15.236840 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-c255c8d1-be90-453c-9ba6-01dfe7d4e9fd tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:15.238816 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-c255c8d1-be90-453c-9ba6-01dfe7d4e9fd tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/networks?id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 HTTP/1.1" status: 200 len: 811 time: 0.1053569 Feb 08 18:19:15.253081 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-bd27c2fd-e431-4edd-98cf-ed26de3aa670 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/quotas/768f50510c57419e8a49ed0988014174 HTTP/1.1" status: 200 len: 375 time: 0.0093594 Feb 08 18:19:15.283373 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 43964) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:15.319239 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-51481bad-085d-4e6c-88af-5403b56c57bf tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?tenant_id=768f50510c57419e8a49ed0988014174&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0609384 Feb 08 18:19:15.373040 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-043a3f21-d474-4c92-bd00-043aafd00b8b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:15.389998 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-85c37248-b9e6-4039-ad0a-75e6d061123c admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:15.425172 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-22fab5bd-6f18-4a0a-b121-f377712c7c52 service neutron] 10.222.0.118 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0940404 Feb 08 18:19:15.484591 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-85c37248-b9e6-4039-ad0a-75e6d061123c admin admin] Publish callbacks [] for security_group (86495c04-16c0-443a-9968-18f101940c05), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:15.489107 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-85c37248-b9e6-4039-ad0a-75e6d061123c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (86495c04-16c0-443a-9968-18f101940c05), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:15.524979 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-751a640d-6ecc-45d5-b75e-b73e54e31eb5 service neutron] 10.222.0.118 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0917687 Feb 08 18:19:15.526585 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-85c37248-b9e6-4039-ad0a-75e6d061123c admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=eb59ab5e219b40729d2844c093825db4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2421005 Feb 08 18:19:15.528623 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85c37248-b9e6-4039-ad0a-75e6d061123c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=86495c04-16c0-443a-9968-18f101940c05,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:15.529388 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 43970) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:15.585314 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-40d561de-1291-410e-af71-41ec3d03ae9c admin admin] Publish callbacks [] for security_group (86495c04-16c0-443a-9968-18f101940c05), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:15.606225 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-40d561de-1291-410e-af71-41ec3d03ae9c admin admin] Publish callbacks [] for security_group (86495c04-16c0-443a-9968-18f101940c05), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:15.655754 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-40d561de-1291-410e-af71-41ec3d03ae9c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (86495c04-16c0-443a-9968-18f101940c05), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:15.658420 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-40d561de-1291-410e-af71-41ec3d03ae9c admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:15.659834 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-40d561de-1291-410e-af71-41ec3d03ae9c admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/86495c04-16c0-443a-9968-18f101940c05 HTTP/1.1" status: 204 len: 168 time: 0.1293502 Feb 08 18:19:15.670126 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-40d561de-1291-410e-af71-41ec3d03ae9c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=86495c04-16c0-443a-9968-18f101940c05,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:15.825336 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-fb0ae718-9e26-4c14-98af-9db2bf08d48b req-341139ac-c6ff-4fca-9060-03f6c286bdda tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 210 time: 0.0314167 Feb 08 18:19:15.955723 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 43990) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:15.970839 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-a0c77e1e-f613-4b5f-9f5f-5e2e2af9ed84 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:16.058242 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-a0c77e1e-f613-4b5f-9f5f-5e2e2af9ed84 admin admin] Publish callbacks [] for security_group (63c3a8c9-61cf-4fd9-90d4-00a10ef78ffc), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:16.062975 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-a0c77e1e-f613-4b5f-9f5f-5e2e2af9ed84 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (63c3a8c9-61cf-4fd9-90d4-00a10ef78ffc), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:16.101335 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-a0c77e1e-f613-4b5f-9f5f-5e2e2af9ed84 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=d6955c6c2abb45e98e9f5f63c02681b8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1442983 Feb 08 18:19:16.103266 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0c77e1e-f613-4b5f-9f5f-5e2e2af9ed84 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=63c3a8c9-61cf-4fd9-90d4-00a10ef78ffc,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:16.104189 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 43994) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:16.171725 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5139e61b-e4cf-4a92-a87f-c93ebf320c89 admin admin] Publish callbacks [] for security_group (63c3a8c9-61cf-4fd9-90d4-00a10ef78ffc), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:16.194069 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5139e61b-e4cf-4a92-a87f-c93ebf320c89 admin admin] Publish callbacks [] for security_group (63c3a8c9-61cf-4fd9-90d4-00a10ef78ffc), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:16.245651 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5139e61b-e4cf-4a92-a87f-c93ebf320c89 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (63c3a8c9-61cf-4fd9-90d4-00a10ef78ffc), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:16.248344 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5139e61b-e4cf-4a92-a87f-c93ebf320c89 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:16.249703 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-5139e61b-e4cf-4a92-a87f-c93ebf320c89 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/63c3a8c9-61cf-4fd9-90d4-00a10ef78ffc HTTP/1.1" status: 204 len: 168 time: 0.1417158 Feb 08 18:19:16.257609 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5139e61b-e4cf-4a92-a87f-c93ebf320c89 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=63c3a8c9-61cf-4fd9-90d4-00a10ef78ffc,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:16.819381 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-ab5c687d-2d31-4ab7-b500-4170d3c8e573 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:16.821036 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-ab5c687d-2d31-4ab7-b500-4170d3c8e573 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.109 "GET /v2.0/networks?id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 HTTP/1.1" status: 200 len: 811 time: 0.1197820 Feb 08 18:19:16.907298 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-0e69a272-fc22-410f-a617-a639ebfc391d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.109 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=768f50510c57419e8a49ed0988014174 HTTP/1.1" status: 200 len: 380 time: 0.0763104 Feb 08 18:19:16.917238 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-94233723-a1e3-421e-92fc-a3fc20637c44 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Request body: {'port': {'device_id': '0ef1fd50-983d-4e00-af14-294faf1027a4', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'admin_state_up': True, 'tenant_id': '768f50510c57419e8a49ed0988014174', 'security_groups': ['2d4a2503-75cd-4739-b472-f29476744b67']}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:19:16.927796 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-95d530e2-d864-438e-857f-e2431caa2af2 req-bfa4561e-61b8-41f2-94a6-bed8e66e3bb2 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 210 time: 0.0320256 Feb 08 18:19:17.034017 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-94233723-a1e3-421e-92fc-a3fc20637c44 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Made reservation on behalf of 768f50510c57419e8a49ed0988014174 for: {'port': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:19:17.037358 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-94233723-a1e3-421e-92fc-a3fc20637c44 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:17.171942 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-94233723-a1e3-421e-92fc-a3fc20637c44 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Allocated IP 172.20.0.8 (2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74/7b1e16de-d9af-4f50-86d7-ee22c9e14b1b/2901fd86-2fd5-4d64-a4c7-9a0ef0423bda) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:19:17.331465 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-94233723-a1e3-421e-92fc-a3fc20637c44 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for port (2901fd86-2fd5-4d64-a4c7-9a0ef0423bda), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:17.366585 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-94233723-a1e3-421e-92fc-a3fc20637c44 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (2901fd86-2fd5-4d64-a4c7-9a0ef0423bda), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:17.413696 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-94233723-a1e3-421e-92fc-a3fc20637c44 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Network 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:19:17.419355 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-94233723-a1e3-421e-92fc-a3fc20637c44 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:19:17.423264 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-94233723-a1e3-421e-92fc-a3fc20637c44 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:19:17.448769 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94233723-a1e3-421e-92fc-a3fc20637c44 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Pushing event updated for resources: {'Port': ['ID=2901fd86-2fd5-4d64-a4c7-9a0ef0423bda,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:17.482287 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-94233723-a1e3-421e-92fc-a3fc20637c44 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:17.483093 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-94233723-a1e3-421e-92fc-a3fc20637c44 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:17.504456 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-94233723-a1e3-421e-92fc-a3fc20637c44 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.109 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5931015 Feb 08 18:19:17.516708 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] Request body: {'port': {'device_id': '0ef1fd50-983d-4e00-af14-294faf1027a4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77398'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:19:17.585405 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (2901fd86-2fd5-4d64-a4c7-9a0ef0423bda), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:17.669076 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-0ac600d5-a4f8-4624-baa5-72d0b257bd38 None None] Provisioning complete for port 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:19:17.669612 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-0ac600d5-a4f8-4624-baa5-72d0b257bd38 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (2901fd86-2fd5-4d64-a4c7-9a0ef0423bda), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:17.704718 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-0ac600d5-a4f8-4624-baa5-72d0b257bd38 None None] Port 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:19:17.835166 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-79e88d7c-137b-49e9-b828-3dee4b745768 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:17.854431 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda {{(pid=102559) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:19:17.861973 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] Publish callbacks [] for port (2901fd86-2fd5-4d64-a4c7-9a0ef0423bda), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:17.873748 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.provisioning_blocks [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] Transition to ACTIVE for port object 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda will not be triggered until provisioned by entity L2. {{(pid=102559) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Feb 08 18:19:17.877996 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-63856478'] for port (2901fd86-2fd5-4d64-a4c7-9a0ef0423bda), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:17.930954 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] Pushing event updated for resources: {'Port': ['ID=2901fd86-2fd5-4d64-a4c7-9a0ef0423bda,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:18.010937 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:18.017051 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] Attempting to bind port 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda on host hv-cinder-77398 for vnic_type normal with profile {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:19:18.017409 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] Attempting to bind port 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda by drivers openvswitch,hyperv on host hv-cinder-77398 at level 0 using segments [{'id': 'fc5ec9ee-df90-46f3-bddf-aef0221d9066', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1066, 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74'}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:19:18.017742 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] Attempting to bind port 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda on network 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:19:18.023861 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] Port 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda on network 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77398 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Feb 08 18:19:18.024405 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] Attempting to bind port 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda on network 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:19:18.033198 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] Checking agent: {'id': '045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77398', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'started_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 19, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:19:18.033765 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] Checking segment: {'id': 'fc5ec9ee-df90-46f3-bddf-aef0221d9066', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1066, 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102559) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:19:18.034143 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] Bound using segment: {'id': 'fc5ec9ee-df90-46f3-bddf-aef0221d9066', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1066, 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74'} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:19:18.034568 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] Bound port: 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda, host: hv-cinder-77398, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'fc5ec9ee-df90-46f3-bddf-aef0221d9066', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1066, 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74'}}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:19:18.034966 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (2901fd86-2fd5-4d64-a4c7-9a0ef0423bda), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:18.146028 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19c8e5f2-cce3-491d-ad72-26c04464024b req-1fc2b32d-ecdb-4a63-9706-2b04bc605ca4 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:18.147658 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-19c8e5f2-cce3-491d-ad72-26c04464024b req-1fc2b32d-ecdb-4a63-9706-2b04bc605ca4 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 943 time: 0.1070747 Feb 08 18:19:18.150540 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] For port 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda, host hv-cinder-77398, cleared binding levels {{(pid=102559) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:19:18.154295 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] For port 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda, host hv-cinder-77398, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=2901fd86-2fd5-4d64-a4c7-9a0ef0423bda,segment=NetworkSegment(fc5ec9ee-df90-46f3-bddf-aef0221d9066),segment_id=fc5ec9ee-df90-46f3-bddf-aef0221d9066)] {{(pid=102559) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:19:18.171416 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-63856478'] for port (2901fd86-2fd5-4d64-a4c7-9a0ef0423bda), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:18.227655 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:18.228290 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:18.229733 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] 10.222.0.109 "PUT /v2.0/ports/2901fd86-2fd5-4d64-a4c7-9a0ef0423bda HTTP/1.1" status: 200 len: 1093 time: 0.7184768 Feb 08 18:19:18.230252 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0ef1fd50-983d-4e00-af14-294faf1027a4', 'tag': '2901fd86-2fd5-4d64-a4c7-9a0ef0423bda'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:19:18.232773 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7be2df9b-5e89-4fc9-9eeb-5131a2054a68" -d '{"events": [{"name": "network-changed", "server_uuid": "0ef1fd50-983d-4e00-af14-294faf1027a4", "tag": "2901fd86-2fd5-4d64-a4c7-9a0ef0423bda"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:19:18.271500 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-19c8e5f2-cce3-491d-ad72-26c04464024b req-34e4d31e-e973-4c10-99a3-6dd9705f652d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1155565 Feb 08 18:19:18.278807 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-876e20a6-0991-44e9-8173-bb82f024572c service neutron] Pushing event updated for resources: {'Port': ['ID=2901fd86-2fd5-4d64-a4c7-9a0ef0423bda,revision_number=3']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:18.300887 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:19:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-24089eca-b5a8-48dd-9852-fd3f27e3d52f x-openstack-request-id: req-24089eca-b5a8-48dd-9852-fd3f27e3d52f {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:19:18.301310 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0ef1fd50-983d-4e00-af14-294faf1027a4", "tag": "2901fd86-2fd5-4d64-a4c7-9a0ef0423bda", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:19:18.301683 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-24089eca-b5a8-48dd-9852-fd3f27e3d52f {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:19:18.302178 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0ef1fd50-983d-4e00-af14-294faf1027a4', 'tag': '2901fd86-2fd5-4d64-a4c7-9a0ef0423bda', 'status': 'completed', 'code': 200} Feb 08 18:19:18.347952 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-5bfb7f83-0fd5-49de-91dc-a186bb67ccc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:18.349583 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-5bfb7f83-0fd5-49de-91dc-a186bb67ccc4 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=768f50510c57419e8a49ed0988014174&device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 1127 time: 0.0720549 Feb 08 18:19:18.393876 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-d0fff5a1-97d2-46dd-9cad-098ca85d9384 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=2901fd86-2fd5-4d64-a4c7-9a0ef0423bda HTTP/1.1" status: 200 len: 217 time: 0.0360909 Feb 08 18:19:18.452860 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-29a00130-8b6c-4505-9ae4-e7271913b03e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:18.454661 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-29a00130-8b6c-4505-9ae4-e7271913b03e service neutron] 10.222.0.109 "GET /v2.0/subnets?id=7b1e16de-d9af-4f50-86d7-ee22c9e14b1b HTTP/1.1" status: 200 len: 850 time: 0.0527141 Feb 08 18:19:18.514866 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:18.519367 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-8c96fbb9-16f3-48de-a472-35a9c4835285 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:18.520919 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-8c96fbb9-16f3-48de-a472-35a9c4835285 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0489132 Feb 08 18:19:18.614513 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-9d22d850-cf5b-471a-bea4-40317f02b037 service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0850303 Feb 08 18:19:18.716460 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3da3245c-a4f4-4aa7-9d48-d3639f88104e req-38961a36-7a9b-4537-8ae3-5d2f889f7dd2 service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0879517 Feb 08 18:19:18.824817 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7be2df9b-5e89-4fc9-9eeb-5131a2054a68 req-cf935ca7-7a3e-422d-9d66-7e4424114d48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:18.826358 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7be2df9b-5e89-4fc9-9eeb-5131a2054a68 req-cf935ca7-7a3e-422d-9d66-7e4424114d48 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=768f50510c57419e8a49ed0988014174&device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 1127 time: 0.0512533 Feb 08 18:19:18.927816 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7be2df9b-5e89-4fc9-9eeb-5131a2054a68 req-ba56fbce-6d8c-4feb-9fd1-0ac389aedacb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:18.929303 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7be2df9b-5e89-4fc9-9eeb-5131a2054a68 req-ba56fbce-6d8c-4feb-9fd1-0ac389aedacb service neutron] 10.222.0.109 "GET /v2.0/networks?id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 HTTP/1.1" status: 200 len: 913 time: 0.0944517 Feb 08 18:19:18.972109 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7be2df9b-5e89-4fc9-9eeb-5131a2054a68 req-9624889e-6eb1-49bc-8106-d821e4d66a6b service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=2901fd86-2fd5-4d64-a4c7-9a0ef0423bda HTTP/1.1" status: 200 len: 217 time: 0.0344558 Feb 08 18:19:19.020812 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7be2df9b-5e89-4fc9-9eeb-5131a2054a68 req-7c731c23-cb2a-4291-b17a-9f0cd3bc8b7f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:19.022277 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7be2df9b-5e89-4fc9-9eeb-5131a2054a68 req-7c731c23-cb2a-4291-b17a-9f0cd3bc8b7f service neutron] 10.222.0.109 "GET /v2.0/subnets?id=7b1e16de-d9af-4f50-86d7-ee22c9e14b1b HTTP/1.1" status: 200 len: 850 time: 0.0427985 Feb 08 18:19:19.074512 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7be2df9b-5e89-4fc9-9eeb-5131a2054a68 req-6e270052-c13b-4b50-9372-c94174a7bc28 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:19.076017 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7be2df9b-5e89-4fc9-9eeb-5131a2054a68 req-6e270052-c13b-4b50-9372-c94174a7bc28 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0463266 Feb 08 18:19:19.179600 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7be2df9b-5e89-4fc9-9eeb-5131a2054a68 req-bcda6a9f-acd6-4af9-9bc0-09d9e288b44c service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0888405 Feb 08 18:19:19.282309 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7be2df9b-5e89-4fc9-9eeb-5131a2054a68 req-775d0064-430a-42d9-bc0c-f157e2bbedd5 service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0921431 Feb 08 18:19:19.399086 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da4b7eb8-c8ca-4558-a0b7-74b3a99042c8 req-f65c4813-9946-4680-9210-bb6fb29aa5c9 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:19.400544 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-da4b7eb8-c8ca-4558-a0b7-74b3a99042c8 req-f65c4813-9946-4680-9210-bb6fb29aa5c9 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 943 time: 0.0551004 Feb 08 18:19:19.457010 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-da4b7eb8-c8ca-4558-a0b7-74b3a99042c8 req-0d46c706-3b7f-4858-9f01-20e6a05b1312 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0503557 Feb 08 18:19:20.123053 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:20.602957 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfb90efe-f247-4c16-8c45-fbab9d188725 req-64843432-fc2e-4cc7-80cd-bae1d72a219e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:20.604414 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-dfb90efe-f247-4c16-8c45-fbab9d188725 req-64843432-fc2e-4cc7-80cd-bae1d72a219e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 943 time: 0.0694585 Feb 08 18:19:20.654582 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-dfb90efe-f247-4c16-8c45-fbab9d188725 req-32ff9024-59c8-48c4-8e13-6411649a6146 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443864 Feb 08 18:19:21.548143 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 44100) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:21.655860 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-888a9f13-612f-45d8-8ec7-7ac60ef908ba admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:21.668291 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:21.734609 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-888a9f13-612f-45d8-8ec7-7ac60ef908ba admin admin] Publish callbacks [] for security_group (cfa028f6-1711-4979-bc9e-c6f882b0b02b), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:21.740227 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-888a9f13-612f-45d8-8ec7-7ac60ef908ba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (cfa028f6-1711-4979-bc9e-c6f882b0b02b), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:21.786285 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1e34cda5-c420-4dde-b3d7-bf2b118abccb req-e372d58e-85b4-430e-b174-ef98e165f7eb tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:21.788052 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1e34cda5-c420-4dde-b3d7-bf2b118abccb req-e372d58e-85b4-430e-b174-ef98e165f7eb tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 943 time: 0.0545533 Feb 08 18:19:21.788456 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-888a9f13-612f-45d8-8ec7-7ac60ef908ba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cfa028f6-1711-4979-bc9e-c6f882b0b02b,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:21.795951 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-888a9f13-612f-45d8-8ec7-7ac60ef908ba admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=42d9016b6a634df1b3f74c1b9da79f29&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2440615 Feb 08 18:19:21.796454 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 44110) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:21.846072 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-67098f41-be7e-49bf-8cb9-fe10d231cf32 admin admin] Publish callbacks [] for security_group (cfa028f6-1711-4979-bc9e-c6f882b0b02b), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:21.846726 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1e34cda5-c420-4dde-b3d7-bf2b118abccb req-23cafca0-29b7-46cc-baa0-830e8e29295b tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0511303 Feb 08 18:19:21.870678 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-67098f41-be7e-49bf-8cb9-fe10d231cf32 admin admin] Publish callbacks [] for security_group (cfa028f6-1711-4979-bc9e-c6f882b0b02b), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:21.915959 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-67098f41-be7e-49bf-8cb9-fe10d231cf32 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (cfa028f6-1711-4979-bc9e-c6f882b0b02b), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:21.918881 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-67098f41-be7e-49bf-8cb9-fe10d231cf32 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:21.920056 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-67098f41-be7e-49bf-8cb9-fe10d231cf32 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/cfa028f6-1711-4979-bc9e-c6f882b0b02b HTTP/1.1" status: 204 len: 168 time: 0.1226490 Feb 08 18:19:21.928642 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67098f41-be7e-49bf-8cb9-fe10d231cf32 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cfa028f6-1711-4979-bc9e-c6f882b0b02b,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:22.218874 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 44124) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:22.231803 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5f8a28e0-1490-48cc-97de-b83a6dc4cdd6 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:22.306134 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5f8a28e0-1490-48cc-97de-b83a6dc4cdd6 admin admin] Publish callbacks [] for security_group (7ea89a43-d665-4615-b174-41eb666e8928), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:22.311875 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5f8a28e0-1490-48cc-97de-b83a6dc4cdd6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (7ea89a43-d665-4615-b174-41eb666e8928), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:22.354677 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-5f8a28e0-1490-48cc-97de-b83a6dc4cdd6 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=477d95dcd2a74bafa280db5377a8181c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1351571 Feb 08 18:19:22.355659 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f8a28e0-1490-48cc-97de-b83a6dc4cdd6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7ea89a43-d665-4615-b174-41eb666e8928,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:22.357656 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 44126) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:22.411297 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7e7fa2a5-6c99-4ab3-9c7f-92238e2a7d14 admin admin] Publish callbacks [] for security_group (7ea89a43-d665-4615-b174-41eb666e8928), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:22.432482 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7e7fa2a5-6c99-4ab3-9c7f-92238e2a7d14 admin admin] Publish callbacks [] for security_group (7ea89a43-d665-4615-b174-41eb666e8928), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:22.469320 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a55b9a5b-c920-4e57-8f12-2538dda9d7d9 req-979846ee-361a-4674-938b-727f8d4cd10a service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0459285 Feb 08 18:19:22.481714 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7e7fa2a5-6c99-4ab3-9c7f-92238e2a7d14 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (7ea89a43-d665-4615-b174-41eb666e8928), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:22.484403 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7e7fa2a5-6c99-4ab3-9c7f-92238e2a7d14 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:22.485634 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-7e7fa2a5-6c99-4ab3-9c7f-92238e2a7d14 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/7ea89a43-d665-4615-b174-41eb666e8928 HTTP/1.1" status: 204 len: 168 time: 0.1268952 Feb 08 18:19:22.495178 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7fa2a5-6c99-4ab3-9c7f-92238e2a7d14 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7ea89a43-d665-4615-b174-41eb666e8928,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:22.567530 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a55b9a5b-c920-4e57-8f12-2538dda9d7d9 req-98e7630c-c4ee-4771-b33b-a02a37411760 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:22.568955 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a55b9a5b-c920-4e57-8f12-2538dda9d7d9 req-98e7630c-c4ee-4771-b33b-a02a37411760 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=768f50510c57419e8a49ed0988014174&device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 1129 time: 0.0494378 Feb 08 18:19:22.671448 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a55b9a5b-c920-4e57-8f12-2538dda9d7d9 req-ae3cdbd5-8771-449e-9a97-5f3a513c65e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:22.672928 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a55b9a5b-c920-4e57-8f12-2538dda9d7d9 req-ae3cdbd5-8771-449e-9a97-5f3a513c65e8 service neutron] 10.222.0.109 "GET /v2.0/networks?id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 HTTP/1.1" status: 200 len: 913 time: 0.0834565 Feb 08 18:19:22.752876 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a55b9a5b-c920-4e57-8f12-2538dda9d7d9 req-94f9b632-1486-4ad7-8548-ed0b124d0a90 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 HTTP/1.1" status: 200 len: 1000 time: 0.0683672 Feb 08 18:19:22.804108 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a55b9a5b-c920-4e57-8f12-2538dda9d7d9 req-6483fe2e-787b-418b-bf13-a2b356feb668 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:22.805645 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a55b9a5b-c920-4e57-8f12-2538dda9d7d9 req-6483fe2e-787b-418b-bf13-a2b356feb668 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=7b1e16de-d9af-4f50-86d7-ee22c9e14b1b HTTP/1.1" status: 200 len: 850 time: 0.0446305 Feb 08 18:19:22.853594 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a55b9a5b-c920-4e57-8f12-2538dda9d7d9 req-4137968c-bb68-4ac1-b071-9c33ad324375 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:22.855137 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a55b9a5b-c920-4e57-8f12-2538dda9d7d9 req-4137968c-bb68-4ac1-b071-9c33ad324375 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0439768 Feb 08 18:19:22.953652 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a55b9a5b-c920-4e57-8f12-2538dda9d7d9 req-bf131ffe-0523-40ef-a17d-3907d188fc1f service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0928049 Feb 08 18:19:22.966542 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b9354d5-425a-4e23-b00d-12247553c9d7 req-3f07e029-516a-4029-904e-416afc566ec2 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:22.968162 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-2b9354d5-425a-4e23-b00d-12247553c9d7 req-3f07e029-516a-4029-904e-416afc566ec2 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 943 time: 0.0552607 Feb 08 18:19:23.035926 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-2b9354d5-425a-4e23-b00d-12247553c9d7 req-54d21cbb-1a5d-448e-aef6-e0a307f1fae4 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0611870 Feb 08 18:19:23.206605 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 44152) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:23.289703 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a55b9a5b-c920-4e57-8f12-2538dda9d7d9 req-94bef649-dcac-4ba0-a9f9-f0f1738716d5 service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3299651 Feb 08 18:19:23.305535 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-0cd6271d-2615-4ce8-b21d-94d74f9d7fe9 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-908430965-network', 'tenant_id': 'c5d4fcba9e9048fba6601a79d19e96bb'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:19:23.325800 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0cd6271d-2615-4ce8-b21d-94d74f9d7fe9 admin admin] Made reservation on behalf of c5d4fcba9e9048fba6601a79d19e96bb for: {'network': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:19:23.328126 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0cd6271d-2615-4ce8-b21d-94d74f9d7fe9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for network (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:23.337137 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0cd6271d-2615-4ce8-b21d-94d74f9d7fe9 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:23.410165 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0cd6271d-2615-4ce8-b21d-94d74f9d7fe9 admin admin] Publish callbacks [] for security_group (6004eaa9-5c33-40f2-aefa-709b7e32466f), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:23.415888 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0cd6271d-2615-4ce8-b21d-94d74f9d7fe9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (6004eaa9-5c33-40f2-aefa-709b7e32466f), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:23.440264 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0cd6271d-2615-4ce8-b21d-94d74f9d7fe9 admin admin] vlan segment allocate from pool success with {'vlan_id': 1087, 'physical_network': 'physnet1'} {{(pid=102560) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Feb 08 18:19:23.452148 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cd6271d-2615-4ce8-b21d-94d74f9d7fe9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6004eaa9-5c33-40f2-aefa-709b7e32466f,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:23.458004 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0cd6271d-2615-4ce8-b21d-94d74f9d7fe9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (13d5b676-de49-4978-bcd0-77f8a280ddfe), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:23.458341 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.segments_db [None req-0cd6271d-2615-4ce8-b21d-94d74f9d7fe9 admin admin] Added segment 13d5b676-de49-4978-bcd0-77f8a280ddfe of type vlan for network d9d306b6-f1ce-4d24-8c8b-cb17ece212e1 Feb 08 18:19:23.496281 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0cd6271d-2615-4ce8-b21d-94d74f9d7fe9 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8770558521384'] for network (d9d306b6-f1ce-4d24-8c8b-cb17ece212e1), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:23.521979 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0cd6271d-2615-4ce8-b21d-94d74f9d7fe9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for network (d9d306b6-f1ce-4d24-8c8b-cb17ece212e1), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:23.522956 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0cd6271d-2615-4ce8-b21d-94d74f9d7fe9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:23.523542 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0cd6271d-2615-4ce8-b21d-94d74f9d7fe9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:23.575269 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-0cd6271d-2615-4ce8-b21d-94d74f9d7fe9 admin admin] 10.222.0.118 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.3672547 Feb 08 18:19:23.578243 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 44156) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:23.582129 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cd6271d-2615-4ce8-b21d-94d74f9d7fe9 admin admin] Pushing event updated for resources: {'Network': ['ID=d9d306b6-f1ce-4d24-8c8b-cb17ece212e1,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:23.583611 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-73f9924c-4bdf-4eff-a3bd-0fe482b68aa8 admin admin] Request body: {'subnet': {'network_id': 'd9d306b6-f1ce-4d24-8c8b-cb17ece212e1', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-908430965-subnet', 'tenant_id': 'c5d4fcba9e9048fba6601a79d19e96bb', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:19:23.592371 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Network d9d306b6-f1ce-4d24-8c8b-cb17ece212e1 details requested by agent ovs-agent-dv-cinder-773985-21-iscsi with host dv-cinder-773985-21-iscsi {{(pid=102561) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Feb 08 18:19:23.602824 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-73f9924c-4bdf-4eff-a3bd-0fe482b68aa8 admin admin] Made reservation on behalf of c5d4fcba9e9048fba6601a79d19e96bb for: {'subnet': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:19:23.605029 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-73f9924c-4bdf-4eff-a3bd-0fe482b68aa8 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-63685351'] for subnet (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:23.792386 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-73f9924c-4bdf-4eff-a3bd-0fe482b68aa8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-63856587', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-63685337'] for subnet (d074d819-9d20-4e30-859d-2cb6eb0386d4), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:23.840589 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73f9924c-4bdf-4eff-a3bd-0fe482b68aa8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=d074d819-9d20-4e30-859d-2cb6eb0386d4,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:23.855613 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-73f9924c-4bdf-4eff-a3bd-0fe482b68aa8 admin admin] Checking segment: {'id': '13d5b676-de49-4978-bcd0-77f8a280ddfe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1087, 'network_id': 'd9d306b6-f1ce-4d24-8c8b-cb17ece212e1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102559) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:19:23.855967 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73f9924c-4bdf-4eff-a3bd-0fe482b68aa8 admin admin] Network hostable DHCP agents. Network: d9d306b6-f1ce-4d24-8c8b-cb17ece212e1, hostable agents: ['006b5388-ac7d-4794-a124-14bb8e5d8fec'], hosted agents: [] {{(pid=102559) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Feb 08 18:19:23.872973 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-73f9924c-4bdf-4eff-a3bd-0fe482b68aa8 admin admin] Network d9d306b6-f1ce-4d24-8c8b-cb17ece212e1 is scheduled to be hosted by DHCP agent 006b5388-ac7d-4794-a124-14bb8e5d8fec with binding_index 1 {{(pid=102559) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Feb 08 18:19:23.882203 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-73f9924c-4bdf-4eff-a3bd-0fe482b68aa8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773985-21-iscsi, d9d306b6-f1ce-4d24-8c8b-cb17ece212e1) {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:19:23.886963 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-73f9924c-4bdf-4eff-a3bd-0fe482b68aa8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:23.888046 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-73f9924c-4bdf-4eff-a3bd-0fe482b68aa8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:23.891755 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-36b9a5ef-9362-4e14-8919-3f4a7bf6faa2 None None] Network d9d306b6-f1ce-4d24-8c8b-cb17ece212e1 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:19:23.905040 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-73f9924c-4bdf-4eff-a3bd-0fe482b68aa8 admin admin] 10.222.0.118 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3257256 Feb 08 18:19:23.995142 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2dbc057c-f534-4d10-9a6b-296e02820b00 None None] Network d9d306b6-f1ce-4d24-8c8b-cb17ece212e1 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:19:24.166329 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aea3824-a289-43ae-ab01-64ddac089f18 req-816bdd75-e61f-45e5-8263-d53b28c00906 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:24.167815 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7aea3824-a289-43ae-ab01-64ddac089f18 req-816bdd75-e61f-45e5-8263-d53b28c00906 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 943 time: 0.0569835 Feb 08 18:19:24.219762 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7aea3824-a289-43ae-ab01-64ddac089f18 req-32315cca-97b1-429e-aa7d-ccf71a014d41 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451441 Feb 08 18:19:25.350179 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2234891-10f0-41d5-8e3b-ae1e54e72f1c req-69bcbf82-fb65-4543-9ad3-59ac1ccbe1a1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:25.352278 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a2234891-10f0-41d5-8e3b-ae1e54e72f1c req-69bcbf82-fb65-4543-9ad3-59ac1ccbe1a1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 943 time: 0.0556200 Feb 08 18:19:25.417666 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a2234891-10f0-41d5-8e3b-ae1e54e72f1c req-ec8f3a52-666a-4541-b333-a2ad4eb79015 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0597482 Feb 08 18:19:25.662080 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-2efc9aaf-abdf-4e9b-ad6a-a61aa423e2e1 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:25.663569 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-2efc9aaf-abdf-4e9b-ad6a-a61aa423e2e1 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/networks?id=d9d306b6-f1ce-4d24-8c8b-cb17ece212e1 HTTP/1.1" status: 200 len: 808 time: 0.1046088 Feb 08 18:19:25.678497 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-12d5d263-92d6-4597-9e49-dcb480b6b61a tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/quotas/c5d4fcba9e9048fba6601a79d19e96bb HTTP/1.1" status: 200 len: 375 time: 0.0091307 Feb 08 18:19:25.714019 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-88841edb-2fec-4802-b501-c8ef39525388 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?tenant_id=c5d4fcba9e9048fba6601a79d19e96bb&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0307219 Feb 08 18:19:25.855147 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:19:25.863935 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-fd4d75e0-a474-426f-a43a-0bd96e73ed21 service neutron] 10.222.0.118 "GET /v2.0/networks/d9d306b6-f1ce-4d24-8c8b-cb17ece212e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1432283 Feb 08 18:19:25.951995 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=2901fd86-2fd5-4d64-a4c7-9a0ef0423bda,segment=NetworkSegment(fc5ec9ee-df90-46f3-bddf-aef0221d9066),segment_id=fc5ec9ee-df90-46f3-bddf-aef0221d9066)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:19:25.958139 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-e196d203-7762-43d5-bc8a-028b5dce64af service neutron] 10.222.0.118 "GET /v2.0/networks/d9d306b6-f1ce-4d24-8c8b-cb17ece212e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0882344 Feb 08 18:19:25.963715 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': '2901fd86-2fd5-4d64-a4c7-9a0ef0423bda', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'port_id': '2901fd86-2fd5-4d64-a4c7-9a0ef0423bda', 'mac_address': 'fa:16:3e:23:4f:67', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1066, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:19:26.004160 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:19:26.004556 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (2901fd86-2fd5-4d64-a4c7-9a0ef0423bda), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:26.017469 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:19:26.038984 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=2901fd86-2fd5-4d64-a4c7-9a0ef0423bda,segment=NetworkSegment(fc5ec9ee-df90-46f3-bddf-aef0221d9066),segment_id=fc5ec9ee-df90-46f3-bddf-aef0221d9066)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:19:26.044326 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (2901fd86-2fd5-4d64-a4c7-9a0ef0423bda), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:26.094467 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=2901fd86-2fd5-4d64-a4c7-9a0ef0423bda,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:26.135004 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e4026b59-d3b9-46c5-90f1-3bd2d5e585c8 req-2143be10-9d50-497a-98f6-f6293389daa6 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=1d482d82-675c-454b-9157-64ddab27e016 HTTP/1.1" status: 200 len: 210 time: 0.0265183 Feb 08 18:19:26.284161 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['2901fd86-2fd5-4d64-a4c7-9a0ef0423bda'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:19:26.539556 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-161606e3-63fd-4ab8-bbf1-bd9822aa3907 req-37f784da-c56b-4db1-94ea-ff2e77795fdb tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:26.541099 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-161606e3-63fd-4ab8-bbf1-bd9822aa3907 req-37f784da-c56b-4db1-94ea-ff2e77795fdb tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 944 time: 0.0554230 Feb 08 18:19:26.592495 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-161606e3-63fd-4ab8-bbf1-bd9822aa3907 req-696b58ef-319a-49ac-a30f-58cf509edf10 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443432 Feb 08 18:19:26.994301 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:19:27.120262 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-c94ab5f7-687e-4ea7-ab6c-ee332cd59adf tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:27.121740 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-c94ab5f7-687e-4ea7-ab6c-ee332cd59adf tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.109 "GET /v2.0/networks?id=d9d306b6-f1ce-4d24-8c8b-cb17ece212e1 HTTP/1.1" status: 200 len: 808 time: 0.1051795 Feb 08 18:19:27.134343 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-2a369629-4bb5-4ca3-9444-2c91e5720ab7 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Request body: {'port': {'device_id': '1d482d82-675c-454b-9157-64ddab27e016', 'network_id': 'd9d306b6-f1ce-4d24-8c8b-cb17ece212e1', 'admin_state_up': True, 'tenant_id': 'c5d4fcba9e9048fba6601a79d19e96bb'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:19:27.231597 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1ecf4433-9ea5-4c8f-bcc7-684b30834a90 req-4e59ac90-a340-4120-9480-a64e93128d35 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=1d482d82-675c-454b-9157-64ddab27e016 HTTP/1.1" status: 200 len: 210 time: 0.0261548 Feb 08 18:19:27.239782 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-2a369629-4bb5-4ca3-9444-2c91e5720ab7 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Made reservation on behalf of c5d4fcba9e9048fba6601a79d19e96bb for: {'port': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:19:27.251606 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-2a369629-4bb5-4ca3-9444-2c91e5720ab7 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:27.372077 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-2a369629-4bb5-4ca3-9444-2c91e5720ab7 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Allocated IP 172.20.0.5 (d9d306b6-f1ce-4d24-8c8b-cb17ece212e1/d074d819-9d20-4e30-859d-2cb6eb0386d4/6d48f8f5-4396-45e5-84c8-0336ecc86369) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:19:27.526973 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-2a369629-4bb5-4ca3-9444-2c91e5720ab7 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Publish callbacks [] for port (6d48f8f5-4396-45e5-84c8-0336ecc86369), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:27.565882 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-2a369629-4bb5-4ca3-9444-2c91e5720ab7 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (6d48f8f5-4396-45e5-84c8-0336ecc86369), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:27.608634 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-2a369629-4bb5-4ca3-9444-2c91e5720ab7 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Network d9d306b6-f1ce-4d24-8c8b-cb17ece212e1 is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:19:27.611844 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-2a369629-4bb5-4ca3-9444-2c91e5720ab7 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:19:27.615613 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-2a369629-4bb5-4ca3-9444-2c91e5720ab7 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:19:27.621872 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a369629-4bb5-4ca3-9444-2c91e5720ab7 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Pushing event updated for resources: {'Port': ['ID=6d48f8f5-4396-45e5-84c8-0336ecc86369,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:27.668714 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-2a369629-4bb5-4ca3-9444-2c91e5720ab7 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:27.669427 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-2a369629-4bb5-4ca3-9444-2c91e5720ab7 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:27.713576 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-2a369629-4bb5-4ca3-9444-2c91e5720ab7 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.109 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5829148 Feb 08 18:19:27.729365 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] Request body: {'port': {'device_id': '1d482d82-675c-454b-9157-64ddab27e016', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77398'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:19:27.740168 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ef13394-4ed8-427b-996c-4bfc3696e139 req-c0decfdf-8599-4ac0-affe-6238cf637e3b tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:27.741628 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5ef13394-4ed8-427b-996c-4bfc3696e139 req-c0decfdf-8599-4ac0-affe-6238cf637e3b tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 944 time: 0.0792508 Feb 08 18:19:27.826296 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (6d48f8f5-4396-45e5-84c8-0336ecc86369), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:27.831258 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5ef13394-4ed8-427b-996c-4bfc3696e139 req-3f47f94b-619e-4237-9d02-a9741757b43d tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0741591 Feb 08 18:19:27.874519 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:19:27.923561 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning for port 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda completed by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Feb 08 18:19:27.927357 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:19:27.927717 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (2901fd86-2fd5-4d64-a4c7-9a0ef0423bda), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:28.013051 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:19:28.013442 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (2901fd86-2fd5-4d64-a4c7-9a0ef0423bda), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:28.037591 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0ef1fd50-983d-4e00-af14-294faf1027a4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2901fd86-2fd5-4d64-a4c7-9a0ef0423bda'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:19:28.039866 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c74a68cd-f2ea-4366-833f-d94d093b8356" -d '{"events": [{"server_uuid": "0ef1fd50-983d-4e00-af14-294faf1027a4", "name": "network-vif-plugged", "status": "completed", "tag": "2901fd86-2fd5-4d64-a4c7-9a0ef0423bda"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:19:28.056825 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=2901fd86-2fd5-4d64-a4c7-9a0ef0423bda,segment=NetworkSegment(fc5ec9ee-df90-46f3-bddf-aef0221d9066),segment_id=fc5ec9ee-df90-46f3-bddf-aef0221d9066)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:19:28.062151 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (2901fd86-2fd5-4d64-a4c7-9a0ef0423bda), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:28.088008 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:19:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d2534d21-8f9e-485d-9d82-53c23088aa4e x-openstack-request-id: req-d2534d21-8f9e-485d-9d82-53c23088aa4e {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:19:28.088216 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0ef1fd50-983d-4e00-af14-294faf1027a4", "name": "network-vif-plugged", "status": "completed", "tag": "2901fd86-2fd5-4d64-a4c7-9a0ef0423bda", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:19:28.088439 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-d2534d21-8f9e-485d-9d82-53c23088aa4e {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:19:28.088814 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0ef1fd50-983d-4e00-af14-294faf1027a4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2901fd86-2fd5-4d64-a4c7-9a0ef0423bda', 'code': 200} Feb 08 18:19:28.112149 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=2901fd86-2fd5-4d64-a4c7-9a0ef0423bda,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:28.115448 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 6d48f8f5-4396-45e5-84c8-0336ecc86369 {{(pid=102559) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:19:28.123369 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] Publish callbacks [] for port (6d48f8f5-4396-45e5-84c8-0336ecc86369), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:28.135495 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.provisioning_blocks [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] Transition to ACTIVE for port object 6d48f8f5-4396-45e5-84c8-0336ecc86369 will not be triggered until provisioned by entity L2. {{(pid=102559) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Feb 08 18:19:28.139711 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-63856478'] for port (6d48f8f5-4396-45e5-84c8-0336ecc86369), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:28.186702 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] Pushing event updated for resources: {'Port': ['ID=6d48f8f5-4396-45e5-84c8-0336ecc86369,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:28.256951 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] Attempting to bind port 6d48f8f5-4396-45e5-84c8-0336ecc86369 on host hv-cinder-77398 for vnic_type normal with profile {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:19:28.257336 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] Attempting to bind port 6d48f8f5-4396-45e5-84c8-0336ecc86369 by drivers openvswitch,hyperv on host hv-cinder-77398 at level 0 using segments [{'id': '13d5b676-de49-4978-bcd0-77f8a280ddfe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1087, 'network_id': 'd9d306b6-f1ce-4d24-8c8b-cb17ece212e1'}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:19:28.257612 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] Attempting to bind port 6d48f8f5-4396-45e5-84c8-0336ecc86369 on network d9d306b6-f1ce-4d24-8c8b-cb17ece212e1 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:19:28.262258 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] Port 6d48f8f5-4396-45e5-84c8-0336ecc86369 on network d9d306b6-f1ce-4d24-8c8b-cb17ece212e1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77398 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Feb 08 18:19:28.262608 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] Attempting to bind port 6d48f8f5-4396-45e5-84c8-0336ecc86369 on network d9d306b6-f1ce-4d24-8c8b-cb17ece212e1 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:19:28.267631 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] Checking agent: {'id': '045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77398', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'started_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 19, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:19:28.267971 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] Checking segment: {'id': '13d5b676-de49-4978-bcd0-77f8a280ddfe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1087, 'network_id': 'd9d306b6-f1ce-4d24-8c8b-cb17ece212e1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102559) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:19:28.268340 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] Bound using segment: {'id': '13d5b676-de49-4978-bcd0-77f8a280ddfe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1087, 'network_id': 'd9d306b6-f1ce-4d24-8c8b-cb17ece212e1'} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:19:28.268800 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] Bound port: 6d48f8f5-4396-45e5-84c8-0336ecc86369, host: hv-cinder-77398, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '13d5b676-de49-4978-bcd0-77f8a280ddfe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1087, 'network_id': 'd9d306b6-f1ce-4d24-8c8b-cb17ece212e1'}}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:19:28.269226 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (6d48f8f5-4396-45e5-84c8-0336ecc86369), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:28.325604 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a414cd7-1f14-4259-ab9f-6b233f0e52f7 req-494db67f-bb25-49d4-9c31-869cfc365323 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:28.327143 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8a414cd7-1f14-4259-ab9f-6b233f0e52f7 req-494db67f-bb25-49d4-9c31-869cfc365323 service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 1129 time: 0.0453582 Feb 08 18:19:28.364800 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] For port 6d48f8f5-4396-45e5-84c8-0336ecc86369, host hv-cinder-77398, cleared binding levels {{(pid=102559) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:19:28.369192 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] For port 6d48f8f5-4396-45e5-84c8-0336ecc86369, host hv-cinder-77398, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=6d48f8f5-4396-45e5-84c8-0336ecc86369,segment=NetworkSegment(13d5b676-de49-4978-bcd0-77f8a280ddfe),segment_id=13d5b676-de49-4978-bcd0-77f8a280ddfe)] {{(pid=102559) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:19:28.376321 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8a414cd7-1f14-4259-ab9f-6b233f0e52f7 req-fe38ed9c-bcf7-4265-bae0-865879700c04 service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419068 Feb 08 18:19:28.377688 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-63856478'] for port (6d48f8f5-4396-45e5-84c8-0336ecc86369), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:28.390617 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07749432-63b6-4ce0-a1ae-b1aa8d07ec5f req-87578f34-0bd7-40a6-82af-3a7b11caee95 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:28.392124 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-07749432-63b6-4ce0-a1ae-b1aa8d07ec5f req-87578f34-0bd7-40a6-82af-3a7b11caee95 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=1d482d82-675c-454b-9157-64ddab27e016 HTTP/1.1" status: 200 len: 943 time: 0.0866928 Feb 08 18:19:28.440875 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:28.441485 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:28.442921 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] 10.222.0.109 "PUT /v2.0/ports/6d48f8f5-4396-45e5-84c8-0336ecc86369 HTTP/1.1" status: 200 len: 1093 time: 0.7191811 Feb 08 18:19:28.444351 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1d482d82-675c-454b-9157-64ddab27e016', 'tag': '6d48f8f5-4396-45e5-84c8-0336ecc86369'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:19:28.446556 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-52322e7a-a10d-4d9a-9c0e-0d1472621319" -d '{"events": [{"name": "network-changed", "server_uuid": "1d482d82-675c-454b-9157-64ddab27e016", "tag": "6d48f8f5-4396-45e5-84c8-0336ecc86369"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:19:28.471828 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a0f276c-bf28-4dce-8e85-6175a33c14c0 service neutron] Pushing event updated for resources: {'Port': ['ID=6d48f8f5-4396-45e5-84c8-0336ecc86369,revision_number=3']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:28.489171 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-07749432-63b6-4ce0-a1ae-b1aa8d07ec5f req-81259ec9-d8f8-41f5-b85b-f0cd80cc3297 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0762763 Feb 08 18:19:28.490736 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:19:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b809d33f-40f1-44fd-9aaa-273b29f6a4d9 x-openstack-request-id: req-b809d33f-40f1-44fd-9aaa-273b29f6a4d9 {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:19:28.491048 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1d482d82-675c-454b-9157-64ddab27e016", "tag": "6d48f8f5-4396-45e5-84c8-0336ecc86369", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:19:28.491298 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-b809d33f-40f1-44fd-9aaa-273b29f6a4d9 {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:19:28.491687 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1d482d82-675c-454b-9157-64ddab27e016', 'tag': '6d48f8f5-4396-45e5-84c8-0336ecc86369', 'status': 'completed', 'code': 200} Feb 08 18:19:28.667829 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52322e7a-a10d-4d9a-9c0e-0d1472621319 req-661d53e4-8fd4-4322-93d3-5e756573c326 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:28.670145 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-52322e7a-a10d-4d9a-9c0e-0d1472621319 req-661d53e4-8fd4-4322-93d3-5e756573c326 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=c5d4fcba9e9048fba6601a79d19e96bb&device_id=1d482d82-675c-454b-9157-64ddab27e016 HTTP/1.1" status: 200 len: 1127 time: 0.0523264 Feb 08 18:19:28.776151 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52322e7a-a10d-4d9a-9c0e-0d1472621319 req-68df9050-ab71-4b3d-a63f-439f00d8da81 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:28.777627 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-52322e7a-a10d-4d9a-9c0e-0d1472621319 req-68df9050-ab71-4b3d-a63f-439f00d8da81 service neutron] 10.222.0.109 "GET /v2.0/networks?tenant_id=c5d4fcba9e9048fba6601a79d19e96bb&shared=False HTTP/1.1" status: 200 len: 910 time: 0.0970128 Feb 08 18:19:28.886885 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52322e7a-a10d-4d9a-9c0e-0d1472621319 req-39fe8617-a344-4e93-8248-7a7d1dcf73d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:28.888278 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-52322e7a-a10d-4d9a-9c0e-0d1472621319 req-39fe8617-a344-4e93-8248-7a7d1dcf73d5 service neutron] 10.222.0.109 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 871 time: 0.1040723 Feb 08 18:19:28.957649 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a297f17-1713-4e35-ae76-d700ac662d88 req-3a95fd1a-2a3b-4ce1-b61d-bf8c6bee3c87 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:28.959188 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-2a297f17-1713-4e35-ae76-d700ac662d88 req-3a95fd1a-2a3b-4ce1-b61d-bf8c6bee3c87 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 945 time: 0.0583289 Feb 08 18:19:28.971630 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-d7656210-44e1-4559-8a6d-c83186cdd375 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:28.973132 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-d7656210-44e1-4559-8a6d-c83186cdd375 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=c5d4fcba9e9048fba6601a79d19e96bb&device_id=1d482d82-675c-454b-9157-64ddab27e016 HTTP/1.1" status: 200 len: 1127 time: 0.0466275 Feb 08 18:19:29.018162 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-2a297f17-1713-4e35-ae76-d700ac662d88 req-2c2b7724-97bd-425f-a674-56f554ff1451 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0531745 Feb 08 18:19:29.021802 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-1a719947-c284-4281-beda-f17bd5566a91 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=6d48f8f5-4396-45e5-84c8-0336ecc86369 HTTP/1.1" status: 200 len: 217 time: 0.0395737 Feb 08 18:19:29.076053 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-0217cbc6-c941-477a-bf8d-ed09063dd58a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:29.077486 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-0217cbc6-c941-477a-bf8d-ed09063dd58a service neutron] 10.222.0.109 "GET /v2.0/subnets?id=d074d819-9d20-4e30-859d-2cb6eb0386d4 HTTP/1.1" status: 200 len: 848 time: 0.0474255 Feb 08 18:19:29.109912 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-771f3506-8b8f-4c69-91a4-d6e371d098aa service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=d9d306b6-f1ce-4d24-8c8b-cb17ece212e1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0254250 Feb 08 18:19:29.199427 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-5d2692dd-a0e9-475e-9a68-6ff948ac3e68 service neutron] 10.222.0.109 "GET /v2.0/networks/d9d306b6-f1ce-4d24-8c8b-cb17ece212e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0808797 Feb 08 18:19:29.297761 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e1dcc059-a027-44c5-88f5-81bf7ed1f0c3 req-7785da26-7a2e-489c-897e-95585688f61a service neutron] 10.222.0.109 "GET /v2.0/networks/d9d306b6-f1ce-4d24-8c8b-cb17ece212e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0915756 Feb 08 18:19:29.615511 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cb438dd-38a7-485b-b6eb-740a7966161d req-14a6c484-dca6-4cb3-b733-8a094d327da8 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:29.617059 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7cb438dd-38a7-485b-b6eb-740a7966161d req-14a6c484-dca6-4cb3-b733-8a094d327da8 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=1d482d82-675c-454b-9157-64ddab27e016 HTTP/1.1" status: 200 len: 943 time: 0.0581839 Feb 08 18:19:29.670970 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-7cb438dd-38a7-485b-b6eb-740a7966161d req-fa9954c1-8503-4485-b1da-ce93874a800c tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0477388 Feb 08 18:19:30.140462 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0326fde6-aacb-4564-8c34-b31fcb2b8010 req-c670e9c0-ae64-4598-a65a-6f03d9993010 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:30.141897 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0326fde6-aacb-4564-8c34-b31fcb2b8010 req-c670e9c0-ae64-4598-a65a-6f03d9993010 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 945 time: 0.0576026 Feb 08 18:19:30.191785 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0326fde6-aacb-4564-8c34-b31fcb2b8010 req-c12a150f-4c7a-4898-9886-31b38f0e5217 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0441351 Feb 08 18:19:30.319678 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b2af54a-004e-44ae-bb86-2ab284946beb req-03f4a4bf-b34d-4295-8d0f-73bcc1215224 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:30.321058 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3b2af54a-004e-44ae-bb86-2ab284946beb req-03f4a4bf-b34d-4295-8d0f-73bcc1215224 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 945 time: 0.0544901 Feb 08 18:19:30.372697 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3b2af54a-004e-44ae-bb86-2ab284946beb req-042300f6-f88a-4933-af8d-1919b8312b16 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459712 Feb 08 18:19:30.401293 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 44242) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:30.444966 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb6962aa-468d-4efd-a2b3-a977ddee06f3 tempest-TestVolumeBootPattern-667580451 tempest-TestVolumeBootPattern-667580451-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:30.446446 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-eb6962aa-468d-4efd-a2b3-a977ddee06f3 tempest-TestVolumeBootPattern-667580451 tempest-TestVolumeBootPattern-667580451-project-admin] 10.222.0.118 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 1124 time: 0.0442035 Feb 08 18:19:30.449192 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 44244) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:19:30.453358 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-9e249744-003c-49bf-97f0-c16db3be4167 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Request body: {'floatingip': {'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'port_id': '2901fd86-2fd5-4d64-a4c7-9a0ef0423bda', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'fixed_ip_address': '172.20.0.8'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:19:30.474974 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9e249744-003c-49bf-97f0-c16db3be4167 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for floatingip (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:30.574127 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9e249744-003c-49bf-97f0-c16db3be4167 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:30.677356 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [None req-9e249744-003c-49bf-97f0-c16db3be4167 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Allocated IP 172.27.1.70 (77055816-7c88-403d-8f8a-9be2c1faa10d/18547c52-7b23-42cd-bb53-214663ed102b/a3e62267-f1df-4632-b2cf-756e5f53e433) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:19:30.783687 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9e249744-003c-49bf-97f0-c16db3be4167 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for port (a3e62267-f1df-4632-b2cf-756e5f53e433), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:30.790635 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6f587d2-23b1-45f6-be81-3eb8279cafe8 req-fbfbe2b5-7013-40e1-b5d3-11ee587c1bc8 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:30.792145 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d6f587d2-23b1-45f6-be81-3eb8279cafe8 req-fbfbe2b5-7013-40e1-b5d3-11ee587c1bc8 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=1d482d82-675c-454b-9157-64ddab27e016 HTTP/1.1" status: 200 len: 943 time: 0.0535047 Feb 08 18:19:30.817751 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9e249744-003c-49bf-97f0-c16db3be4167 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (a3e62267-f1df-4632-b2cf-756e5f53e433), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:30.843297 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d6f587d2-23b1-45f6-be81-3eb8279cafe8 req-4091b158-77c6-41bd-8f33-1f0d788fa27a tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0444200 Feb 08 18:19:30.853013 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9e249744-003c-49bf-97f0-c16db3be4167 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Network 77055816-7c88-403d-8f8a-9be2c1faa10d is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:19:30.863981 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e249744-003c-49bf-97f0-c16db3be4167 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Pushing event updated for resources: {'Port': ['ID=a3e62267-f1df-4632-b2cf-756e5f53e433,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:30.867020 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-9e249744-003c-49bf-97f0-c16db3be4167 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:19:30.869370 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e249744-003c-49bf-97f0-c16db3be4167 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:19:31.301120 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9e249744-003c-49bf-97f0-c16db3be4167 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for floatingip (ae582062-974d-4f63-a11f-d5135353aa45), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:31.402582 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9e249744-003c-49bf-97f0-c16db3be4167 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (a3e62267-f1df-4632-b2cf-756e5f53e433), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:31.800669 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9e249744-003c-49bf-97f0-c16db3be4167 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for port (a3e62267-f1df-4632-b2cf-756e5f53e433), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:31.806373 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9e249744-003c-49bf-97f0-c16db3be4167 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-63856478'] for port (a3e62267-f1df-4632-b2cf-756e5f53e433), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:31.872640 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e249744-003c-49bf-97f0-c16db3be4167 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Pushing event updated for resources: {'Port': ['ID=a3e62267-f1df-4632-b2cf-756e5f53e433,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:31.885508 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9e249744-003c-49bf-97f0-c16db3be4167 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-560746'] for floatingip (ae582062-974d-4f63-a11f-d5135353aa45), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:32.023156 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6af4569b-3398-4006-a671-f384f1c9b7f4 req-0c4b762b-a72e-4fa7-87a3-59e39d2aec61 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:32.024539 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6af4569b-3398-4006-a671-f384f1c9b7f4 req-0c4b762b-a72e-4fa7-87a3-59e39d2aec61 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=1d482d82-675c-454b-9157-64ddab27e016 HTTP/1.1" status: 200 len: 943 time: 0.1039820 Feb 08 18:19:32.025998 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.db.l3_db [None req-9e249744-003c-49bf-97f0-c16db3be4167 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Floating IP ae582062-974d-4f63-a11f-d5135353aa45 associated. External IP: 172.27.1.70, port: 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda. Feb 08 18:19:32.172844 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6af4569b-3398-4006-a671-f384f1c9b7f4 req-d12f6fdb-1be4-4769-a06a-f43b697fde11 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1092820 Feb 08 18:19:32.297234 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9e249744-003c-49bf-97f0-c16db3be4167 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Router 72b4fd56-6775-4076-9195-fe85693f53aa has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102559) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:19:32.412223 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9e249744-003c-49bf-97f0-c16db3be4167 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102559) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:19:32.422675 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b26c88b-0102-449a-be2a-e9874e2e76fa None None] Sync routers for ids ['72b4fd56-6775-4076-9195-fe85693f53aa'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:19:32.434152 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9e249744-003c-49bf-97f0-c16db3be4167 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for floatingip (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:32.437196 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b26c88b-0102-449a-be2a-e9874e2e76fa None None] Routers {'72b4fd56-6775-4076-9195-fe85693f53aa'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:19:32.437815 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-9b26c88b-0102-449a-be2a-e9874e2e76fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:19:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['72b4fd56-6775-4076-9195-fe85693f53aa'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:19:32.475184 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-9e249744-003c-49bf-97f0-c16db3be4167 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 2.0248070 Feb 08 18:19:32.475866 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0ef1fd50-983d-4e00-af14-294faf1027a4', 'tag': '2901fd86-2fd5-4d64-a4c7-9a0ef0423bda'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:19:32.478188 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-14cd3bfd-2b1f-4853-958b-f9bcc0a42446" -d '{"events": [{"name": "network-changed", "server_uuid": "0ef1fd50-983d-4e00-af14-294faf1027a4", "tag": "2901fd86-2fd5-4d64-a4c7-9a0ef0423bda"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:19:32.514887 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:19:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b57b8620-2a66-419d-871b-1794c5910193 x-openstack-request-id: req-b57b8620-2a66-419d-871b-1794c5910193 {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:19:32.515176 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0ef1fd50-983d-4e00-af14-294faf1027a4", "tag": "2901fd86-2fd5-4d64-a4c7-9a0ef0423bda", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:19:32.515425 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-b57b8620-2a66-419d-871b-1794c5910193 {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:19:32.515872 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0ef1fd50-983d-4e00-af14-294faf1027a4', 'tag': '2901fd86-2fd5-4d64-a4c7-9a0ef0423bda', 'status': 'completed', 'code': 200} Feb 08 18:19:32.548914 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-9b26c88b-0102-449a-be2a-e9874e2e76fa None None] Set router 72b4fd56-6775-4076-9195-fe85693f53aa gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:19:32.831733 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 6d48f8f5-4396-45e5-84c8-0336ecc86369 details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:19:32.905490 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cd3bfd-2b1f-4853-958b-f9bcc0a42446 req-38eae615-7e04-49c7-bb08-db8b54b12dd1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:32.907032 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-14cd3bfd-2b1f-4853-958b-f9bcc0a42446 req-38eae615-7e04-49c7-bb08-db8b54b12dd1 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=768f50510c57419e8a49ed0988014174&device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 1129 time: 0.0445468 Feb 08 18:19:32.974355 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 6d48f8f5-4396-45e5-84c8-0336ecc86369, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=6d48f8f5-4396-45e5-84c8-0336ecc86369,segment=NetworkSegment(13d5b676-de49-4978-bcd0-77f8a280ddfe),segment_id=13d5b676-de49-4978-bcd0-77f8a280ddfe)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:19:32.988316 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': '6d48f8f5-4396-45e5-84c8-0336ecc86369', 'network_id': 'd9d306b6-f1ce-4d24-8c8b-cb17ece212e1', 'port_id': '6d48f8f5-4396-45e5-84c8-0336ecc86369', 'mac_address': 'fa:16:3e:16:4d:e1', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1087, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd074d819-9d20-4e30-859d-2cb6eb0386d4', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:19:32.997834 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-9b26c88b-0102-449a-be2a-e9874e2e76fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 4, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '8b5d25a6-20c1-4111-8cd4-527be842c81e', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'floating_ip_address': '172.27.1.78', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'port_id': '8f5b70dd-2b98-47c5-9288-4dabd9ca45e6', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 546, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'mac_address': 'fa:16:3e:61:f1:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b68b868-44af-459b-8cc4-7ec714415497', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:17:24Z', 'updated_at': '2022-02-08T18:17:26Z', 'revision_number': 1, 'project_id': '768f50510c57419e8a49ed0988014174', 'fixed_ip_address_scope': None}, {'id': 'ae582062-974d-4f63-a11f-d5135353aa45', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'floating_ip_address': '172.27.1.70', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'port_id': '2901fd86-2fd5-4d64-a4c7-9a0ef0423bda', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 654, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'mac_address': 'fa:16:3e:23:4f:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0ef1fd50-983d-4e00-af14-294faf1027a4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:19:31Z', 'updated_at': '2022-02-08T18:19:31Z', 'revision_number': 0, 'project_id': '768f50510c57419e8a49ed0988014174', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '13fcfd03-fc49-4bba-8574-ec74e795e2bd', 'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'mac_address': 'fa:16:3e:4b:7b:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:44Z', 'updated_at': '2022-02-08T18:13:51Z', 'revision_number': 5, 'project_id': '768f50510c57419e8a49ed0988014174', 'subnets': [{'id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:19:32.999958 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cd3bfd-2b1f-4853-958b-f9bcc0a42446 req-f6c1eac3-05ff-49e5-95d4-1f77ae54a9f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:33.001445 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-14cd3bfd-2b1f-4853-958b-f9bcc0a42446 req-f6c1eac3-05ff-49e5-95d4-1f77ae54a9f8 service neutron] 10.222.0.109 "GET /v2.0/networks?id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 HTTP/1.1" status: 200 len: 913 time: 0.0881174 Feb 08 18:19:33.044759 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b26c88b-0102-449a-be2a-e9874e2e76fa None None] Checking router: 72b4fd56-6775-4076-9195-fe85693f53aa for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:19:33.071993 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 6d48f8f5-4396-45e5-84c8-0336ecc86369 is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:19:33.072405 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (6d48f8f5-4396-45e5-84c8-0336ecc86369), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:33.074599 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9b26c88b-0102-449a-be2a-e9874e2e76fa None None] Routers {'72b4fd56-6775-4076-9195-fe85693f53aa'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:19:33.075314 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-9b26c88b-0102-449a-be2a-e9874e2e76fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:19:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['72b4fd56-6775-4076-9195-fe85693f53aa'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:19:33.082311 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-14cd3bfd-2b1f-4853-958b-f9bcc0a42446 req-cfeca095-dda3-47cb-bb57-70b791230d85 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=2901fd86-2fd5-4d64-a4c7-9a0ef0423bda HTTP/1.1" status: 200 len: 998 time: 0.0705748 Feb 08 18:19:33.133355 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cd3bfd-2b1f-4853-958b-f9bcc0a42446 req-d42fa15a-528c-4263-87f6-30946eb72360 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:33.134867 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-14cd3bfd-2b1f-4853-958b-f9bcc0a42446 req-d42fa15a-528c-4263-87f6-30946eb72360 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=7b1e16de-d9af-4f50-86d7-ee22c9e14b1b HTTP/1.1" status: 200 len: 850 time: 0.0437038 Feb 08 18:19:33.143891 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 6d48f8f5-4396-45e5-84c8-0336ecc86369 {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:19:33.177314 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 6d48f8f5-4396-45e5-84c8-0336ecc86369, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=6d48f8f5-4396-45e5-84c8-0336ecc86369,segment=NetworkSegment(13d5b676-de49-4978-bcd0-77f8a280ddfe),segment_id=13d5b676-de49-4978-bcd0-77f8a280ddfe)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:19:33.185828 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (6d48f8f5-4396-45e5-84c8-0336ecc86369), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:33.191183 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14cd3bfd-2b1f-4853-958b-f9bcc0a42446 req-57306854-fd11-425c-a203-fb2513a25375 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:33.192704 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-14cd3bfd-2b1f-4853-958b-f9bcc0a42446 req-57306854-fd11-425c-a203-fb2513a25375 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0506475 Feb 08 18:19:33.236504 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-9b26c88b-0102-449a-be2a-e9874e2e76fa None None] Set router 72b4fd56-6775-4076-9195-fe85693f53aa gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:19:33.274529 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=6d48f8f5-4396-45e5-84c8-0336ecc86369,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:33.323656 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-14cd3bfd-2b1f-4853-958b-f9bcc0a42446 req-54e7342c-62ca-4915-838b-917da062fc39 service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1187434 Feb 08 18:19:33.335780 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-723811d4-498f-4db0-a5ed-1195d35b7723 req-a1721726-5352-4107-ae37-a9c4f7a0937a tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:33.336754 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-723811d4-498f-4db0-a5ed-1195d35b7723 req-a1721726-5352-4107-ae37-a9c4f7a0937a tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=1d482d82-675c-454b-9157-64ddab27e016 HTTP/1.1" status: 200 len: 944 time: 0.0819821 Feb 08 18:19:33.437451 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-723811d4-498f-4db0-a5ed-1195d35b7723 req-ec4e3745-ec59-4ff9-a8be-24cfe530bd88 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0928721 Feb 08 18:19:33.461972 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-14cd3bfd-2b1f-4853-958b-f9bcc0a42446 req-92ff2e6c-1d64-4c98-97da-8b937699db83 service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1242480 Feb 08 18:19:33.473055 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['6d48f8f5-4396-45e5-84c8-0336ecc86369'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:19:33.520720 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-9b26c88b-0102-449a-be2a-e9874e2e76fa None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 4, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '8b5d25a6-20c1-4111-8cd4-527be842c81e', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'floating_ip_address': '172.27.1.78', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'port_id': '8f5b70dd-2b98-47c5-9288-4dabd9ca45e6', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 546, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'mac_address': 'fa:16:3e:61:f1:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b68b868-44af-459b-8cc4-7ec714415497', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:17:24Z', 'updated_at': '2022-02-08T18:17:26Z', 'revision_number': 1, 'project_id': '768f50510c57419e8a49ed0988014174', 'fixed_ip_address_scope': None}, {'id': 'ae582062-974d-4f63-a11f-d5135353aa45', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'floating_ip_address': '172.27.1.70', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'port_id': '2901fd86-2fd5-4d64-a4c7-9a0ef0423bda', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 654, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'mac_address': 'fa:16:3e:23:4f:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0ef1fd50-983d-4e00-af14-294faf1027a4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:19:31Z', 'updated_at': '2022-02-08T18:19:31Z', 'revision_number': 0, 'project_id': '768f50510c57419e8a49ed0988014174', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '13fcfd03-fc49-4bba-8574-ec74e795e2bd', 'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'mac_address': 'fa:16:3e:4b:7b:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:44Z', 'updated_at': '2022-02-08T18:13:51Z', 'revision_number': 5, 'project_id': '768f50510c57419e8a49ed0988014174', 'subnets': [{'id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:19:33.553925 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9b26c88b-0102-449a-be2a-e9874e2e76fa None None] The sync data for ids ['72b4fd56-6775-4076-9195-fe85693f53aa'] in dv-cinder-773985-21-iscsi is: [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 4, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '8b5d25a6-20c1-4111-8cd4-527be842c81e', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'floating_ip_address': '172.27.1.78', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'port_id': '8f5b70dd-2b98-47c5-9288-4dabd9ca45e6', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 546, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'mac_address': 'fa:16:3e:61:f1:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b68b868-44af-459b-8cc4-7ec714415497', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:17:24Z', 'updated_at': '2022-02-08T18:17:26Z', 'revision_number': 1, 'project_id': '768f50510c57419e8a49ed0988014174', 'fixed_ip_address_scope': None}, {'id': 'ae582062-974d-4f63-a11f-d5135353aa45', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'floating_ip_address': '172.27.1.70', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'port_id': '2901fd86-2fd5-4d64-a4c7-9a0ef0423bda', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 654, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'mac_address': 'fa:16:3e:23:4f:67', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0ef1fd50-983d-4e00-af14-294faf1027a4', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:19:31Z', 'updated_at': '2022-02-08T18:19:31Z', 'revision_number': 0, 'project_id': '768f50510c57419e8a49ed0988014174', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '13fcfd03-fc49-4bba-8574-ec74e795e2bd', 'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'mac_address': 'fa:16:3e:4b:7b:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:44Z', 'updated_at': '2022-02-08T18:13:51Z', 'revision_number': 5, 'project_id': '768f50510c57419e8a49ed0988014174', 'subnets': [{'id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:19:33.742749 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9c56a048-b13a-4dae-92a7-ec839d687aea None None] New status for floating IP ae582062-974d-4f63-a11f-d5135353aa45: ACTIVE {{(pid=102562) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Feb 08 18:19:34.582600 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-837f0687-0d6f-4de5-877d-f2e1b0fd035c req-5bbe738f-34b0-4d61-981a-c3a4833edab7 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:34.584093 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-837f0687-0d6f-4de5-877d-f2e1b0fd035c req-5bbe738f-34b0-4d61-981a-c3a4833edab7 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=1d482d82-675c-454b-9157-64ddab27e016 HTTP/1.1" status: 200 len: 944 time: 0.0642884 Feb 08 18:19:34.633925 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-837f0687-0d6f-4de5-877d-f2e1b0fd035c req-676fe097-99ac-4dcd-9169-9756e1763b2a tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0414481 Feb 08 18:19:35.137263 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 6d48f8f5-4396-45e5-84c8-0336ecc86369 up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:19:35.200788 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning for port 6d48f8f5-4396-45e5-84c8-0336ecc86369 completed by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Feb 08 18:19:35.204407 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port 6d48f8f5-4396-45e5-84c8-0336ecc86369 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:19:35.204783 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (6d48f8f5-4396-45e5-84c8-0336ecc86369), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:35.281834 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 6d48f8f5-4396-45e5-84c8-0336ecc86369 is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:19:35.282228 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (6d48f8f5-4396-45e5-84c8-0336ecc86369), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:35.308732 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1d482d82-675c-454b-9157-64ddab27e016', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6d48f8f5-4396-45e5-84c8-0336ecc86369'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:19:35.310924 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-78db043a-0699-459a-8873-7171f63f779d" -d '{"events": [{"server_uuid": "1d482d82-675c-454b-9157-64ddab27e016", "name": "network-vif-plugged", "status": "completed", "tag": "6d48f8f5-4396-45e5-84c8-0336ecc86369"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:19:35.323092 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 6d48f8f5-4396-45e5-84c8-0336ecc86369, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=6d48f8f5-4396-45e5-84c8-0336ecc86369,segment=NetworkSegment(13d5b676-de49-4978-bcd0-77f8a280ddfe),segment_id=13d5b676-de49-4978-bcd0-77f8a280ddfe)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:19:35.328164 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (6d48f8f5-4396-45e5-84c8-0336ecc86369), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:35.353164 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:19:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-eb136c27-d882-49b8-978d-72f34230f93f x-openstack-request-id: req-eb136c27-d882-49b8-978d-72f34230f93f {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:19:35.353456 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1d482d82-675c-454b-9157-64ddab27e016", "name": "network-vif-plugged", "status": "completed", "tag": "6d48f8f5-4396-45e5-84c8-0336ecc86369", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:19:35.353706 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-eb136c27-d882-49b8-978d-72f34230f93f {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:19:35.354095 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1d482d82-675c-454b-9157-64ddab27e016', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '6d48f8f5-4396-45e5-84c8-0336ecc86369', 'code': 200} Feb 08 18:19:35.379839 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=6d48f8f5-4396-45e5-84c8-0336ecc86369,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:35.770946 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f09940d-6f0e-470e-b40a-49df102aa9ab req-a7901017-ddf8-4a2d-a2fe-c70dce315d30 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:35.772500 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-7f09940d-6f0e-470e-b40a-49df102aa9ab req-a7901017-ddf8-4a2d-a2fe-c70dce315d30 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=1d482d82-675c-454b-9157-64ddab27e016 HTTP/1.1" status: 200 len: 945 time: 0.0580165 Feb 08 18:19:35.820004 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-7f09940d-6f0e-470e-b40a-49df102aa9ab req-bbcabbf2-6e66-4835-9f9e-027f1362c222 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0419164 Feb 08 18:19:36.955938 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b070edf3-e2e2-4dad-bde9-25f5fb825307 req-69206362-2ca3-48d8-abac-dbeffe07f6b8 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:36.957763 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b070edf3-e2e2-4dad-bde9-25f5fb825307 req-69206362-2ca3-48d8-abac-dbeffe07f6b8 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=1d482d82-675c-454b-9157-64ddab27e016 HTTP/1.1" status: 200 len: 945 time: 0.0594709 Feb 08 18:19:37.030382 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b070edf3-e2e2-4dad-bde9-25f5fb825307 req-2810c8b4-88b3-486d-93a7-60fecfbe2df6 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0652006 Feb 08 18:19:37.051884 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbec7b13-7544-4d8e-9405-b35d7eaf3d84 req-efbee688-ec0a-4b12-8c3e-9a0f37de378f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:37.053376 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-bbec7b13-7544-4d8e-9405-b35d7eaf3d84 req-efbee688-ec0a-4b12-8c3e-9a0f37de378f service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=1d482d82-675c-454b-9157-64ddab27e016 HTTP/1.1" status: 200 len: 1129 time: 0.0632741 Feb 08 18:19:37.098737 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-bbec7b13-7544-4d8e-9405-b35d7eaf3d84 req-769a8a0d-9675-43ac-9056-a1296bd4302f service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0369449 Feb 08 18:19:38.157467 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-beba9d0b-9bb2-4d65-8a62-510975a979bd req-a5751cc0-9e75-4653-8554-27a69450fe34 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:38.158961 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-beba9d0b-9bb2-4d65-8a62-510975a979bd req-a5751cc0-9e75-4653-8554-27a69450fe34 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=1d482d82-675c-454b-9157-64ddab27e016 HTTP/1.1" status: 200 len: 945 time: 0.0573461 Feb 08 18:19:38.206705 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-beba9d0b-9bb2-4d65-8a62-510975a979bd req-314ed5eb-930b-4922-bf70-66a3dc9e17e2 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421047 Feb 08 18:19:39.333295 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-961aa461-8cb8-4d43-a0af-2532ab66b85d req-1803765f-8546-4000-8199-705d0ecb46b2 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:39.334802 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-961aa461-8cb8-4d43-a0af-2532ab66b85d req-1803765f-8546-4000-8199-705d0ecb46b2 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=1d482d82-675c-454b-9157-64ddab27e016 HTTP/1.1" status: 200 len: 945 time: 0.0555983 Feb 08 18:19:39.390520 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-961aa461-8cb8-4d43-a0af-2532ab66b85d req-017892b0-70ff-4782-82d1-2b8e3d2533ba tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501578 Feb 08 18:19:41.838588 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5c8dc9d-3368-4780-b70d-09851028d89c req-d6962125-8bf1-45eb-a053-0d6de2c93088 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:41.839983 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a5c8dc9d-3368-4780-b70d-09851028d89c req-d6962125-8bf1-45eb-a053-0d6de2c93088 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=1d482d82-675c-454b-9157-64ddab27e016 HTTP/1.1" status: 200 len: 945 time: 0.0558116 Feb 08 18:19:41.889746 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a5c8dc9d-3368-4780-b70d-09851028d89c req-948fe410-7fcd-48b2-868c-29aa1c8062c2 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413945 Feb 08 18:19:43.015891 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1d209f2-2a95-45e0-8ab9-ef24aaf62194 req-9a6470cc-7824-4f37-b95d-bd70ad780d3c tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:43.017383 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e1d209f2-2a95-45e0-8ab9-ef24aaf62194 req-9a6470cc-7824-4f37-b95d-bd70ad780d3c tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=1d482d82-675c-454b-9157-64ddab27e016 HTTP/1.1" status: 200 len: 945 time: 0.0555632 Feb 08 18:19:43.065741 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e1d209f2-2a95-45e0-8ab9-ef24aaf62194 req-411e4d37-c0e2-4c41-a975-7e625bc7484f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423958 Feb 08 18:19:43.282626 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe42b87c-c9d0-4233-b663-51d0c2e8965f req-0dc0d03d-a9ce-476a-a1d8-a71f99afa359 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:43.284114 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-fe42b87c-c9d0-4233-b663-51d0c2e8965f req-0dc0d03d-a9ce-476a-a1d8-a71f99afa359 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.109 "GET /v2.0/ports?device_id=1d482d82-675c-454b-9157-64ddab27e016 HTTP/1.1" status: 200 len: 945 time: 0.0518353 Feb 08 18:19:43.382688 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [req-fe42b87c-c9d0-4233-b663-51d0c2e8965f req-de83f9b1-1c83-494b-840a-894e7354293f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Deleting port 6d48f8f5-4396-45e5-84c8-0336ecc86369 {{(pid=102559) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:19:43.383057 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-fe42b87c-c9d0-4233-b663-51d0c2e8965f req-de83f9b1-1c83-494b-840a-894e7354293f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (6d48f8f5-4396-45e5-84c8-0336ecc86369), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:43.478000 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-fe42b87c-c9d0-4233-b663-51d0c2e8965f req-de83f9b1-1c83-494b-840a-894e7354293f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] For port 6d48f8f5-4396-45e5-84c8-0336ecc86369, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=6d48f8f5-4396-45e5-84c8-0336ecc86369,segment=NetworkSegment(13d5b676-de49-4978-bcd0-77f8a280ddfe),segment_id=13d5b676-de49-4978-bcd0-77f8a280ddfe)] {{(pid=102559) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:19:43.478317 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-fe42b87c-c9d0-4233-b663-51d0c2e8965f req-de83f9b1-1c83-494b-840a-894e7354293f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (6d48f8f5-4396-45e5-84c8-0336ecc86369), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:43.491155 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [req-fe42b87c-c9d0-4233-b663-51d0c2e8965f req-de83f9b1-1c83-494b-840a-894e7354293f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Calling delete_port for 6d48f8f5-4396-45e5-84c8-0336ecc86369 owned by compute:nova {{(pid=102559) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:19:43.625397 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-fe42b87c-c9d0-4233-b663-51d0c2e8965f req-de83f9b1-1c83-494b-840a-894e7354293f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (6d48f8f5-4396-45e5-84c8-0336ecc86369), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:43.638336 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['6d48f8f5-4396-45e5-84c8-0336ecc86369'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:19:43.652578 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de83f9b1-1c83-494b-840a-894e7354293f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Pushing event deleted for resources: {'Port': ['ID=6d48f8f5-4396-45e5-84c8-0336ecc86369,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:43.664214 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de83f9b1-1c83-494b-840a-894e7354293f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:43.664561 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de83f9b1-1c83-494b-840a-894e7354293f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:43.664900 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de83f9b1-1c83-494b-840a-894e7354293f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:43.665247 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de83f9b1-1c83-494b-840a-894e7354293f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:43.665690 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de83f9b1-1c83-494b-840a-894e7354293f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:43.666014 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de83f9b1-1c83-494b-840a-894e7354293f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:43.666340 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de83f9b1-1c83-494b-840a-894e7354293f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:43.666655 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de83f9b1-1c83-494b-840a-894e7354293f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:43.666975 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de83f9b1-1c83-494b-840a-894e7354293f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:43.667358 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de83f9b1-1c83-494b-840a-894e7354293f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:43.667679 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de83f9b1-1c83-494b-840a-894e7354293f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:43.668339 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de83f9b1-1c83-494b-840a-894e7354293f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:43.668649 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-de83f9b1-1c83-494b-840a-894e7354293f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:19:43.706603 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [req-fe42b87c-c9d0-4233-b663-51d0c2e8965f req-de83f9b1-1c83-494b-840a-894e7354293f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] No DVR routers for this DVR port 6d48f8f5-4396-45e5-84c8-0336ecc86369 on host hv-cinder-77398 {{(pid=102559) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:19:43.709122 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-fe42b87c-c9d0-4233-b663-51d0c2e8965f req-de83f9b1-1c83-494b-840a-894e7354293f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:43.712443 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-fe42b87c-c9d0-4233-b663-51d0c2e8965f req-de83f9b1-1c83-494b-840a-894e7354293f tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.109 "DELETE /v2.0/ports/6d48f8f5-4396-45e5-84c8-0336ecc86369 HTTP/1.1" status: 204 len: 173 time: 0.4201667 Feb 08 18:19:43.712848 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1d482d82-675c-454b-9157-64ddab27e016', 'name': 'network-vif-deleted', 'tag': '6d48f8f5-4396-45e5-84c8-0336ecc86369'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:19:43.715094 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e72b5d0d-4de8-4b7b-8c62-e02e6848f329" -d '{"events": [{"server_uuid": "1d482d82-675c-454b-9157-64ddab27e016", "name": "network-vif-deleted", "tag": "6d48f8f5-4396-45e5-84c8-0336ecc86369"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:19:43.756657 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:19:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9c13e399-e2df-443b-a9b2-11e587c1cfa7 x-openstack-request-id: req-9c13e399-e2df-443b-a9b2-11e587c1cfa7 {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:19:43.756996 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1d482d82-675c-454b-9157-64ddab27e016", "name": "network-vif-deleted", "tag": "6d48f8f5-4396-45e5-84c8-0336ecc86369", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:19:43.757189 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-9c13e399-e2df-443b-a9b2-11e587c1cfa7 {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:19:43.757594 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1d482d82-675c-454b-9157-64ddab27e016', 'name': 'network-vif-deleted', 'tag': '6d48f8f5-4396-45e5-84c8-0336ecc86369', 'status': 'completed', 'code': 200} Feb 08 18:19:44.191468 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-67accc91-c9f6-46d4-95b6-158ddb82cc30 req-611a3135-81be-4b19-a6b1-a732fdc70d14 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=1d482d82-675c-454b-9157-64ddab27e016 HTTP/1.1" status: 200 len: 210 time: 0.0312152 Feb 08 18:19:45.379608 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-9eba5b63-42a8-4068-960a-5c3213063a37 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:45.466566 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-aa37be16-8bf2-4b32-8d63-3fb98bae1b98 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:45.468069 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-aa37be16-8bf2-4b32-8d63-3fb98bae1b98 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/networks?id=d9d306b6-f1ce-4d24-8c8b-cb17ece212e1 HTTP/1.1" status: 200 len: 808 time: 0.1048505 Feb 08 18:19:45.482932 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-13bdd21e-3eac-400a-bb53-d13920c7c386 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/quotas/c5d4fcba9e9048fba6601a79d19e96bb HTTP/1.1" status: 200 len: 375 time: 0.0094051 Feb 08 18:19:45.517106 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-68c7a922-8d91-428c-a1f7-81f85402f5b0 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?tenant_id=c5d4fcba9e9048fba6601a79d19e96bb&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0293028 Feb 08 18:19:45.608162 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-2bf41ab1-70f6-455f-9194-4c264da62831 service neutron] 10.222.0.118 "GET /v2.0/networks/d9d306b6-f1ce-4d24-8c8b-cb17ece212e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0842147 Feb 08 18:19:45.708622 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-9efb9ded-2ca9-4718-b829-dc8591b0bb9f service neutron] 10.222.0.118 "GET /v2.0/networks/d9d306b6-f1ce-4d24-8c8b-cb17ece212e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0922358 Feb 08 18:19:45.880427 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-d44b97b3-1b92-4340-b36e-c4d9348e1924 req-ea6c54da-9dd4-4114-a828-ef971b49eb28 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=88568324-0407-43a8-98b3-bc3d1e54c6f3 HTTP/1.1" status: 200 len: 210 time: 0.0361090 Feb 08 18:19:46.859890 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 6d48f8f5-4396-45e5-84c8-0336ecc86369 no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:19:46.886135 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] No Port match for: 6d48f8f5-4396-45e5-84c8-0336ecc86369 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:19:46.886625 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 6d48f8f5-4396-45e5-84c8-0336ecc86369 not bound to the agent host hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:19:46.976258 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-568b51f3-92da-4dc5-8022-a8921bff774c req-175d5537-621f-4d6a-9441-8b5ade014fa2 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=88568324-0407-43a8-98b3-bc3d1e54c6f3 HTTP/1.1" status: 200 len: 210 time: 0.0269520 Feb 08 18:19:47.057059 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-e3f607cc-0d22-4b46-b9c0-9d057c8803ab tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:47.058681 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-e3f607cc-0d22-4b46-b9c0-9d057c8803ab tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.109 "GET /v2.0/networks?id=d9d306b6-f1ce-4d24-8c8b-cb17ece212e1 HTTP/1.1" status: 200 len: 808 time: 0.1146102 Feb 08 18:19:47.071831 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-a1493b3b-6b20-4e6b-99f3-1458066bb999 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Request body: {'port': {'device_id': '88568324-0407-43a8-98b3-bc3d1e54c6f3', 'network_id': 'd9d306b6-f1ce-4d24-8c8b-cb17ece212e1', 'admin_state_up': True, 'tenant_id': 'c5d4fcba9e9048fba6601a79d19e96bb'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:19:47.184385 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-a1493b3b-6b20-4e6b-99f3-1458066bb999 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Made reservation on behalf of c5d4fcba9e9048fba6601a79d19e96bb for: {'port': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:19:47.187942 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-a1493b3b-6b20-4e6b-99f3-1458066bb999 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:47.267681 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e39ecf91-6bb8-40a7-b09a-756bc1a4cce4 req-b5c870c2-2dc6-4332-8be5-96f4ce425032 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:47.269161 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e39ecf91-6bb8-40a7-b09a-756bc1a4cce4 req-b5c870c2-2dc6-4332-8be5-96f4ce425032 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=82a87eac-3773-40e3-8cb3-4c5181dd42eb HTTP/1.1" status: 200 len: 946 time: 0.0516300 Feb 08 18:19:47.308966 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-a1493b3b-6b20-4e6b-99f3-1458066bb999 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Allocated IP 172.20.0.6 (d9d306b6-f1ce-4d24-8c8b-cb17ece212e1/d074d819-9d20-4e30-859d-2cb6eb0386d4/bc5ffaec-cfc8-446f-b23a-7393547c52f8) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:19:47.319300 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e39ecf91-6bb8-40a7-b09a-756bc1a4cce4 req-b31b667a-1fcc-470a-b483-2b7ce3ee9244 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/security-groups?id=66081d7a-f07b-4f82-ad72-c8f7a5870dcd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0443964 Feb 08 18:19:47.461732 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-a1493b3b-6b20-4e6b-99f3-1458066bb999 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Publish callbacks [] for port (bc5ffaec-cfc8-446f-b23a-7393547c52f8), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:47.497692 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-a1493b3b-6b20-4e6b-99f3-1458066bb999 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (bc5ffaec-cfc8-446f-b23a-7393547c52f8), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:47.543428 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-a1493b3b-6b20-4e6b-99f3-1458066bb999 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Network d9d306b6-f1ce-4d24-8c8b-cb17ece212e1 is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:19:47.546551 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-a1493b3b-6b20-4e6b-99f3-1458066bb999 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:19:47.550107 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-a1493b3b-6b20-4e6b-99f3-1458066bb999 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:19:47.556283 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1493b3b-6b20-4e6b-99f3-1458066bb999 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Pushing event updated for resources: {'Port': ['ID=bc5ffaec-cfc8-446f-b23a-7393547c52f8,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:47.601167 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-a1493b3b-6b20-4e6b-99f3-1458066bb999 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:47.601773 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-a1493b3b-6b20-4e6b-99f3-1458066bb999 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:47.619455 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-a1493b3b-6b20-4e6b-99f3-1458066bb999 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.109 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5515137 Feb 08 18:19:47.631691 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] Request body: {'port': {'device_id': '88568324-0407-43a8-98b3-bc3d1e54c6f3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77398'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:19:47.687936 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (bc5ffaec-cfc8-446f-b23a-7393547c52f8), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:47.840785 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-7b3d193a-c01d-472d-bc20-8609353bbfdd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:47.964011 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bc5ffaec-cfc8-446f-b23a-7393547c52f8 {{(pid=102559) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:19:47.971411 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] Publish callbacks [] for port (bc5ffaec-cfc8-446f-b23a-7393547c52f8), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:47.983073 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.provisioning_blocks [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] Transition to ACTIVE for port object bc5ffaec-cfc8-446f-b23a-7393547c52f8 will not be triggered until provisioned by entity L2. {{(pid=102559) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Feb 08 18:19:47.988633 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-63856478'] for port (bc5ffaec-cfc8-446f-b23a-7393547c52f8), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:48.037571 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:48.039104 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] Pushing event updated for resources: {'Port': ['ID=bc5ffaec-cfc8-446f-b23a-7393547c52f8,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:48.145109 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] Attempting to bind port bc5ffaec-cfc8-446f-b23a-7393547c52f8 on host hv-cinder-77398 for vnic_type normal with profile {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:19:48.145776 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] Attempting to bind port bc5ffaec-cfc8-446f-b23a-7393547c52f8 by drivers openvswitch,hyperv on host hv-cinder-77398 at level 0 using segments [{'id': '13d5b676-de49-4978-bcd0-77f8a280ddfe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1087, 'network_id': 'd9d306b6-f1ce-4d24-8c8b-cb17ece212e1'}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:19:48.145776 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] Attempting to bind port bc5ffaec-cfc8-446f-b23a-7393547c52f8 on network d9d306b6-f1ce-4d24-8c8b-cb17ece212e1 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:19:48.157528 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-671b0108-3e83-4aaf-9cc8-8f5e74ba1e6e req-c713557e-df84-408f-ac0f-7825fbe49c68 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:48.159008 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-671b0108-3e83-4aaf-9cc8-8f5e74ba1e6e req-c713557e-df84-408f-ac0f-7825fbe49c68 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=88568324-0407-43a8-98b3-bc3d1e54c6f3 HTTP/1.1" status: 200 len: 943 time: 0.0956895 Feb 08 18:19:48.159941 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] Port bc5ffaec-cfc8-446f-b23a-7393547c52f8 on network d9d306b6-f1ce-4d24-8c8b-cb17ece212e1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77398 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Feb 08 18:19:48.160288 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] Attempting to bind port bc5ffaec-cfc8-446f-b23a-7393547c52f8 on network d9d306b6-f1ce-4d24-8c8b-cb17ece212e1 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:19:48.166337 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] Checking agent: {'id': '045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77398', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'started_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 19, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:19:48.166663 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] Checking segment: {'id': '13d5b676-de49-4978-bcd0-77f8a280ddfe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1087, 'network_id': 'd9d306b6-f1ce-4d24-8c8b-cb17ece212e1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102559) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:19:48.167063 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] Bound using segment: {'id': '13d5b676-de49-4978-bcd0-77f8a280ddfe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1087, 'network_id': 'd9d306b6-f1ce-4d24-8c8b-cb17ece212e1'} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:19:48.167475 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] Bound port: bc5ffaec-cfc8-446f-b23a-7393547c52f8, host: hv-cinder-77398, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '13d5b676-de49-4978-bcd0-77f8a280ddfe', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1087, 'network_id': 'd9d306b6-f1ce-4d24-8c8b-cb17ece212e1'}}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:19:48.168178 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (bc5ffaec-cfc8-446f-b23a-7393547c52f8), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:48.242905 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-671b0108-3e83-4aaf-9cc8-8f5e74ba1e6e req-abc40e57-6574-4244-8372-6e8f1bcabb2b tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0775983 Feb 08 18:19:48.258439 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] For port bc5ffaec-cfc8-446f-b23a-7393547c52f8, host hv-cinder-77398, cleared binding levels {{(pid=102559) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:19:48.261515 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] For port bc5ffaec-cfc8-446f-b23a-7393547c52f8, host hv-cinder-77398, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=bc5ffaec-cfc8-446f-b23a-7393547c52f8,segment=NetworkSegment(13d5b676-de49-4978-bcd0-77f8a280ddfe),segment_id=13d5b676-de49-4978-bcd0-77f8a280ddfe)] {{(pid=102559) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:19:48.269288 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-63856478'] for port (bc5ffaec-cfc8-446f-b23a-7393547c52f8), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:48.305270 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:48.305880 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:48.307261 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] 10.222.0.109 "PUT /v2.0/ports/bc5ffaec-cfc8-446f-b23a-7393547c52f8 HTTP/1.1" status: 200 len: 1093 time: 0.6796002 Feb 08 18:19:48.307706 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '88568324-0407-43a8-98b3-bc3d1e54c6f3', 'tag': 'bc5ffaec-cfc8-446f-b23a-7393547c52f8'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:19:48.309949 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-14a67408-8541-4db9-89f1-f93492b95bb5" -d '{"events": [{"name": "network-changed", "server_uuid": "88568324-0407-43a8-98b3-bc3d1e54c6f3", "tag": "bc5ffaec-cfc8-446f-b23a-7393547c52f8"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:19:48.334445 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f84b442-73cc-4a4d-acd7-cbf6b1ff644a service neutron] Pushing event updated for resources: {'Port': ['ID=bc5ffaec-cfc8-446f-b23a-7393547c52f8,revision_number=3']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:48.349398 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:19:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ed59f58e-bde7-4b9c-b1ba-690308f77528 x-openstack-request-id: req-ed59f58e-bde7-4b9c-b1ba-690308f77528 {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:19:48.349752 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "88568324-0407-43a8-98b3-bc3d1e54c6f3", "tag": "bc5ffaec-cfc8-446f-b23a-7393547c52f8", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:19:48.350163 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-ed59f58e-bde7-4b9c-b1ba-690308f77528 {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:19:48.350757 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '88568324-0407-43a8-98b3-bc3d1e54c6f3', 'tag': 'bc5ffaec-cfc8-446f-b23a-7393547c52f8', 'status': 'completed', 'code': 200} Feb 08 18:19:48.446420 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7a9c67e4-afa3-4785-bc96-2f50beef8cc5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:48.447925 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-7a9c67e4-afa3-4785-bc96-2f50beef8cc5 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=c5d4fcba9e9048fba6601a79d19e96bb&device_id=88568324-0407-43a8-98b3-bc3d1e54c6f3 HTTP/1.1" status: 200 len: 1127 time: 0.0753646 Feb 08 18:19:48.467395 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e69c46ff-e8a6-493b-9ad2-227a5a30ada2 req-0a8d8396-34ce-47f9-a69f-656be1ba0539 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:48.468757 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e69c46ff-e8a6-493b-9ad2-227a5a30ada2 req-0a8d8396-34ce-47f9-a69f-656be1ba0539 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=82a87eac-3773-40e3-8cb3-4c5181dd42eb HTTP/1.1" status: 200 len: 946 time: 0.0704486 Feb 08 18:19:48.506238 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-e5e45309-b27e-4cdf-9d89-7c7f8637d9c5 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bc5ffaec-cfc8-446f-b23a-7393547c52f8 HTTP/1.1" status: 200 len: 217 time: 0.0511911 Feb 08 18:19:48.518274 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:48.575190 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e69c46ff-e8a6-493b-9ad2-227a5a30ada2 req-e508d7f3-c6ca-4dbb-87c5-7cadbe5ec108 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/security-groups?id=66081d7a-f07b-4f82-ad72-c8f7a5870dcd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0754197 Feb 08 18:19:48.576641 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-493c13a3-ea68-471d-ba07-b25ba4c79097 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:48.577956 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-493c13a3-ea68-471d-ba07-b25ba4c79097 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=d074d819-9d20-4e30-859d-2cb6eb0386d4 HTTP/1.1" status: 200 len: 848 time: 0.0639064 Feb 08 18:19:48.616430 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-62dbbd4c-177c-4b7d-9414-94d13f3da555 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=d9d306b6-f1ce-4d24-8c8b-cb17ece212e1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0270891 Feb 08 18:19:48.708882 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-8c21a446-2300-45cf-8192-e522caba8fa0 service neutron] 10.222.0.109 "GET /v2.0/networks/d9d306b6-f1ce-4d24-8c8b-cb17ece212e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0853796 Feb 08 18:19:48.804801 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-634b804c-d8b1-4e9a-966e-fb7f917102a1 req-43fcdd35-62b4-49b4-b2eb-97ffa45f6303 service neutron] 10.222.0.109 "GET /v2.0/networks/d9d306b6-f1ce-4d24-8c8b-cb17ece212e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0880930 Feb 08 18:19:48.892756 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9062c5ad-28af-42d7-9ae8-6ba23e69058e req-681b0529-9e28-4cf0-9c81-d5f76781895d tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:48.894278 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9062c5ad-28af-42d7-9ae8-6ba23e69058e req-681b0529-9e28-4cf0-9c81-d5f76781895d tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.109 "GET /v2.0/ports?device_id=82a87eac-3773-40e3-8cb3-4c5181dd42eb HTTP/1.1" status: 200 len: 946 time: 0.0523531 Feb 08 18:19:48.901340 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14a67408-8541-4db9-89f1-f93492b95bb5 req-78fb993e-1d02-48d1-ad23-84bf1a6e8a8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:48.902881 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-14a67408-8541-4db9-89f1-f93492b95bb5 req-78fb993e-1d02-48d1-ad23-84bf1a6e8a8d service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=c5d4fcba9e9048fba6601a79d19e96bb&device_id=88568324-0407-43a8-98b3-bc3d1e54c6f3 HTTP/1.1" status: 200 len: 1127 time: 0.0448487 Feb 08 18:19:48.992757 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [req-9062c5ad-28af-42d7-9ae8-6ba23e69058e req-d2efd593-0244-46cb-bf7e-a78083478842 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Deleting port 037e84ed-14e6-4370-9a30-51a3144a8de4 {{(pid=102559) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:19:48.992981 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-9062c5ad-28af-42d7-9ae8-6ba23e69058e req-d2efd593-0244-46cb-bf7e-a78083478842 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (037e84ed-14e6-4370-9a30-51a3144a8de4), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:48.993955 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14a67408-8541-4db9-89f1-f93492b95bb5 req-f9672608-ce42-4df1-8bb5-1798f5b98946 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:48.995482 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-14a67408-8541-4db9-89f1-f93492b95bb5 req-f9672608-ce42-4df1-8bb5-1798f5b98946 service neutron] 10.222.0.109 "GET /v2.0/networks?id=d9d306b6-f1ce-4d24-8c8b-cb17ece212e1 HTTP/1.1" status: 200 len: 910 time: 0.0867078 Feb 08 18:19:49.040624 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-14a67408-8541-4db9-89f1-f93492b95bb5 req-d2667d9b-2bc1-481f-a487-c73e728f7aaa service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.6&port_id=bc5ffaec-cfc8-446f-b23a-7393547c52f8 HTTP/1.1" status: 200 len: 217 time: 0.0366793 Feb 08 18:19:49.081831 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-9062c5ad-28af-42d7-9ae8-6ba23e69058e req-d2efd593-0244-46cb-bf7e-a78083478842 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] For port 037e84ed-14e6-4370-9a30-51a3144a8de4, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=037e84ed-14e6-4370-9a30-51a3144a8de4,segment=NetworkSegment(dfda56ea-4f8f-4241-8424-b3ed264aa208),segment_id=dfda56ea-4f8f-4241-8424-b3ed264aa208)] {{(pid=102559) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:19:49.082185 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-9062c5ad-28af-42d7-9ae8-6ba23e69058e req-d2efd593-0244-46cb-bf7e-a78083478842 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (037e84ed-14e6-4370-9a30-51a3144a8de4), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:49.091414 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14a67408-8541-4db9-89f1-f93492b95bb5 req-7df01431-7420-437c-8ce4-6d3092495999 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:49.092910 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-14a67408-8541-4db9-89f1-f93492b95bb5 req-7df01431-7420-437c-8ce4-6d3092495999 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=d074d819-9d20-4e30-859d-2cb6eb0386d4 HTTP/1.1" status: 200 len: 848 time: 0.0458610 Feb 08 18:19:49.098801 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [req-9062c5ad-28af-42d7-9ae8-6ba23e69058e req-d2efd593-0244-46cb-bf7e-a78083478842 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Calling delete_port for 037e84ed-14e6-4370-9a30-51a3144a8de4 owned by compute:nova {{(pid=102559) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:19:49.124321 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-14a67408-8541-4db9-89f1-f93492b95bb5 req-b0dcaddb-b971-4d28-83d7-b593dde399fd service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=d9d306b6-f1ce-4d24-8c8b-cb17ece212e1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0249949 Feb 08 18:19:49.214941 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-14a67408-8541-4db9-89f1-f93492b95bb5 req-8450cd8c-b686-4bb2-be2f-e1248d7da292 service neutron] 10.222.0.109 "GET /v2.0/networks/d9d306b6-f1ce-4d24-8c8b-cb17ece212e1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0831881 Feb 08 18:19:49.223626 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-9062c5ad-28af-42d7-9ae8-6ba23e69058e req-d2efd593-0244-46cb-bf7e-a78083478842 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (037e84ed-14e6-4370-9a30-51a3144a8de4), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:49.236115 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['037e84ed-14e6-4370-9a30-51a3144a8de4'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:19:49.252222 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2efd593-0244-46cb-bf7e-a78083478842 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Pushing event deleted for resources: {'Port': ['ID=037e84ed-14e6-4370-9a30-51a3144a8de4,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:49.297724 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [req-9062c5ad-28af-42d7-9ae8-6ba23e69058e req-d2efd593-0244-46cb-bf7e-a78083478842 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] No DVR routers for this DVR port 037e84ed-14e6-4370-9a30-51a3144a8de4 on host hv-cinder-77398 {{(pid=102559) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:19:49.300694 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-9062c5ad-28af-42d7-9ae8-6ba23e69058e req-d2efd593-0244-46cb-bf7e-a78083478842 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:49.304129 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9062c5ad-28af-42d7-9ae8-6ba23e69058e req-d2efd593-0244-46cb-bf7e-a78083478842 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.109 "DELETE /v2.0/ports/037e84ed-14e6-4370-9a30-51a3144a8de4 HTTP/1.1" status: 204 len: 173 time: 0.4029856 Feb 08 18:19:49.318312 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-14a67408-8541-4db9-89f1-f93492b95bb5 req-250211c0-fddd-4019-8b89-9335e69e9bc1 service neutron] 10.222.0.109 "GET /v2.0/networks/d9d306b6-f1ce-4d24-8c8b-cb17ece212e1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0933149 Feb 08 18:19:49.370567 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d41b92e-272f-472f-92d7-087bf9a61890 req-f32b29ab-dff4-48e0-aa0b-ada475a5a201 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:49.372070 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5d41b92e-272f-472f-92d7-087bf9a61890 req-f32b29ab-dff4-48e0-aa0b-ada475a5a201 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=88568324-0407-43a8-98b3-bc3d1e54c6f3 HTTP/1.1" status: 200 len: 943 time: 0.0528698 Feb 08 18:19:49.418914 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5d41b92e-272f-472f-92d7-087bf9a61890 req-b9ee88ce-a5c6-4047-8c90-b8be8d06e21a tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409000 Feb 08 18:19:49.709157 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9b531a2d-534b-4550-b127-30891890c3f3 req-dbb364f9-f623-4fb1-b2bb-09b97eadcfd2 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=82a87eac-3773-40e3-8cb3-4c5181dd42eb HTTP/1.1" status: 200 len: 210 time: 0.0374484 Feb 08 18:19:50.134444 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:50.352808 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '82a87eac-3773-40e3-8cb3-4c5181dd42eb', 'name': 'network-vif-deleted', 'tag': '037e84ed-14e6-4370-9a30-51a3144a8de4'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:19:50.356502 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a9b31650-c5cf-4d5c-ba5b-1715cd2d92ad" -d '{"events": [{"server_uuid": "82a87eac-3773-40e3-8cb3-4c5181dd42eb", "name": "network-vif-deleted", "tag": "037e84ed-14e6-4370-9a30-51a3144a8de4"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:19:50.403835 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:19:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-63f76b87-0829-4828-b660-872739cbeeeb x-openstack-request-id: req-63f76b87-0829-4828-b660-872739cbeeeb {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:19:50.404120 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "82a87eac-3773-40e3-8cb3-4c5181dd42eb", "name": "network-vif-deleted", "tag": "037e84ed-14e6-4370-9a30-51a3144a8de4", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:19:50.404357 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-63f76b87-0829-4828-b660-872739cbeeeb {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:19:50.404755 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '82a87eac-3773-40e3-8cb3-4c5181dd42eb', 'name': 'network-vif-deleted', 'tag': '037e84ed-14e6-4370-9a30-51a3144a8de4', 'status': 'completed', 'code': 200} Feb 08 18:19:50.551004 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c895e79-d156-445a-b023-211a93595127 req-a92e4d6a-f7d0-4ac9-9668-02cab9cb6acc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:50.552448 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2c895e79-d156-445a-b023-211a93595127 req-a92e4d6a-f7d0-4ac9-9668-02cab9cb6acc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=88568324-0407-43a8-98b3-bc3d1e54c6f3 HTTP/1.1" status: 200 len: 943 time: 0.0607293 Feb 08 18:19:50.602194 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2c895e79-d156-445a-b023-211a93595127 req-a5ed801c-f3c1-4cb3-a120-e08e180d7124 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413918 Feb 08 18:19:50.884078 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device bc5ffaec-cfc8-446f-b23a-7393547c52f8 details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:19:50.984009 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port bc5ffaec-cfc8-446f-b23a-7393547c52f8, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=bc5ffaec-cfc8-446f-b23a-7393547c52f8,segment=NetworkSegment(13d5b676-de49-4978-bcd0-77f8a280ddfe),segment_id=13d5b676-de49-4978-bcd0-77f8a280ddfe)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:19:50.995413 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': 'bc5ffaec-cfc8-446f-b23a-7393547c52f8', 'network_id': 'd9d306b6-f1ce-4d24-8c8b-cb17ece212e1', 'port_id': 'bc5ffaec-cfc8-446f-b23a-7393547c52f8', 'mac_address': 'fa:16:3e:84:31:5f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1087, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'd074d819-9d20-4e30-859d-2cb6eb0386d4', 'ip_address': '172.20.0.6'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:19:51.035720 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port bc5ffaec-cfc8-446f-b23a-7393547c52f8 is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:19:51.036111 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (bc5ffaec-cfc8-446f-b23a-7393547c52f8), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:51.049766 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bc5ffaec-cfc8-446f-b23a-7393547c52f8 {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:19:51.069024 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port bc5ffaec-cfc8-446f-b23a-7393547c52f8, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=bc5ffaec-cfc8-446f-b23a-7393547c52f8,segment=NetworkSegment(13d5b676-de49-4978-bcd0-77f8a280ddfe),segment_id=13d5b676-de49-4978-bcd0-77f8a280ddfe)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:19:51.074258 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (bc5ffaec-cfc8-446f-b23a-7393547c52f8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:51.125278 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=bc5ffaec-cfc8-446f-b23a-7393547c52f8,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:51.676597 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:51.741086 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74454547-2d20-4e65-9b71-ede206e32a60 req-a022c306-6b05-4241-9659-4d1783fe2b26 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:51.742678 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-74454547-2d20-4e65-9b71-ede206e32a60 req-a022c306-6b05-4241-9659-4d1783fe2b26 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=88568324-0407-43a8-98b3-bc3d1e54c6f3 HTTP/1.1" status: 200 len: 944 time: 0.0573983 Feb 08 18:19:52.047907 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-74454547-2d20-4e65-9b71-ede206e32a60 req-f57726bd-fdba-4dfa-ae33-b5e345422ffe tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2991519 Feb 08 18:19:52.914838 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 037e84ed-14e6-4370-9a30-51a3144a8de4 no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:19:52.944271 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] No Port match for: 037e84ed-14e6-4370-9a30-51a3144a8de4 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:19:52.944610 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 037e84ed-14e6-4370-9a30-51a3144a8de4 not bound to the agent host hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:19:53.191308 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6cb2869-17cf-41a5-9dda-7a5927995e13 req-5c3471ee-9613-40dd-80d5-3bf759eab10a tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:53.192679 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e6cb2869-17cf-41a5-9dda-7a5927995e13 req-5c3471ee-9613-40dd-80d5-3bf759eab10a tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=88568324-0407-43a8-98b3-bc3d1e54c6f3 HTTP/1.1" status: 200 len: 944 time: 0.0635095 Feb 08 18:19:53.243294 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e6cb2869-17cf-41a5-9dda-7a5927995e13 req-2943e47e-e2c4-497e-9d6f-a9482e11cde0 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448391 Feb 08 18:19:53.962826 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['bc5ffaec-cfc8-446f-b23a-7393547c52f8'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:19:54.412347 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f58029dc-0fe6-49d6-b425-be5222e8d75c req-81a91ace-b86f-4621-8ff6-53ad0770367d tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:54.413795 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f58029dc-0fe6-49d6-b425-be5222e8d75c req-81a91ace-b86f-4621-8ff6-53ad0770367d tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=88568324-0407-43a8-98b3-bc3d1e54c6f3 HTTP/1.1" status: 200 len: 944 time: 0.0751350 Feb 08 18:19:54.461995 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f58029dc-0fe6-49d6-b425-be5222e8d75c req-10630db3-2152-4b36-9180-8fb861ee2f95 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0395741 Feb 08 18:19:54.902260 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device bc5ffaec-cfc8-446f-b23a-7393547c52f8 up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:19:54.963398 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning for port bc5ffaec-cfc8-446f-b23a-7393547c52f8 completed by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Feb 08 18:19:54.967394 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port bc5ffaec-cfc8-446f-b23a-7393547c52f8 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:19:54.967771 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (bc5ffaec-cfc8-446f-b23a-7393547c52f8), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:55.046209 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port bc5ffaec-cfc8-446f-b23a-7393547c52f8 is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:19:55.046606 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (bc5ffaec-cfc8-446f-b23a-7393547c52f8), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:55.069789 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '88568324-0407-43a8-98b3-bc3d1e54c6f3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bc5ffaec-cfc8-446f-b23a-7393547c52f8'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:19:55.072103 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-75e96cf4-8516-4eb2-9f8a-01ac8644bdfb" -d '{"events": [{"server_uuid": "88568324-0407-43a8-98b3-bc3d1e54c6f3", "name": "network-vif-plugged", "status": "completed", "tag": "bc5ffaec-cfc8-446f-b23a-7393547c52f8"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:19:55.090182 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port bc5ffaec-cfc8-446f-b23a-7393547c52f8, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=bc5ffaec-cfc8-446f-b23a-7393547c52f8,segment=NetworkSegment(13d5b676-de49-4978-bcd0-77f8a280ddfe),segment_id=13d5b676-de49-4978-bcd0-77f8a280ddfe)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:19:55.095598 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (bc5ffaec-cfc8-446f-b23a-7393547c52f8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:19:55.121554 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:19:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6612dd3d-a8a2-4142-8dd4-b92f19cbf717 x-openstack-request-id: req-6612dd3d-a8a2-4142-8dd4-b92f19cbf717 {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:19:55.121844 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "88568324-0407-43a8-98b3-bc3d1e54c6f3", "name": "network-vif-plugged", "status": "completed", "tag": "bc5ffaec-cfc8-446f-b23a-7393547c52f8", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:19:55.122094 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-6612dd3d-a8a2-4142-8dd4-b92f19cbf717 {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:19:55.122483 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '88568324-0407-43a8-98b3-bc3d1e54c6f3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bc5ffaec-cfc8-446f-b23a-7393547c52f8', 'code': 200} Feb 08 18:19:55.148608 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=bc5ffaec-cfc8-446f-b23a-7393547c52f8,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:19:55.281931 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aab0e00c-984d-4cd7-b008-a1257af7e61f req-23ed62e7-4ac8-4293-bef0-2453af85cc8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:55.283466 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-aab0e00c-984d-4cd7-b008-a1257af7e61f req-23ed62e7-4ac8-4293-bef0-2453af85cc8d service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=88568324-0407-43a8-98b3-bc3d1e54c6f3 HTTP/1.1" status: 200 len: 1129 time: 0.0432606 Feb 08 18:19:55.330885 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-aab0e00c-984d-4cd7-b008-a1257af7e61f req-ad6baeed-c01e-457d-bc3e-5faab6141b07 service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0388329 Feb 08 18:19:55.589515 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1133656d-ad9d-404b-8a0a-467ced04331a req-f7962548-4dd0-4f3b-aa0d-774ad2859c82 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:55.591015 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1133656d-ad9d-404b-8a0a-467ced04331a req-f7962548-4dd0-4f3b-aa0d-774ad2859c82 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=88568324-0407-43a8-98b3-bc3d1e54c6f3 HTTP/1.1" status: 200 len: 945 time: 0.0557573 Feb 08 18:19:55.645662 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1133656d-ad9d-404b-8a0a-467ced04331a req-45709c67-897d-4c44-9c91-8a86d912b331 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465832 Feb 08 18:19:56.786335 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-830965a3-bf04-410b-af4f-e3c82f15a4e6 req-04d648c1-1665-42d0-908f-8cfee19b9704 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:19:56.787818 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-830965a3-bf04-410b-af4f-e3c82f15a4e6 req-04d648c1-1665-42d0-908f-8cfee19b9704 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=88568324-0407-43a8-98b3-bc3d1e54c6f3 HTTP/1.1" status: 200 len: 945 time: 0.0540080 Feb 08 18:19:56.834708 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-830965a3-bf04-410b-af4f-e3c82f15a4e6 req-4b87ee1b-61fd-416a-8b3e-2524ad6cbf69 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0408285 Feb 08 18:20:00.063900 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-721bb254-7962-4029-abda-92f7b799af3f req-4a0d5e21-72e3-4077-8088-a1d4b7c785b7 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:00.065374 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-721bb254-7962-4029-abda-92f7b799af3f req-4a0d5e21-72e3-4077-8088-a1d4b7c785b7 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=88568324-0407-43a8-98b3-bc3d1e54c6f3 HTTP/1.1" status: 200 len: 945 time: 0.0588436 Feb 08 18:20:00.112720 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-721bb254-7962-4029-abda-92f7b799af3f req-6894b4a8-875f-4b79-938b-96733d041df6 tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416551 Feb 08 18:20:00.805935 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-de442f7f-dec1-41b1-98f1-23a29aa4051c tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:00.807308 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-de442f7f-dec1-41b1-98f1-23a29aa4051c tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/networks?id=15a08cf2-cd5e-4df5-9cba-d45464825731 HTTP/1.1" status: 200 len: 813 time: 0.1002407 Feb 08 18:20:00.821825 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-710a8dcc-aa0c-46d6-8746-62e5d60a6982 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/quotas/c50a1910195245ff8254b7cca4fdfbaa HTTP/1.1" status: 200 len: 375 time: 0.0090401 Feb 08 18:20:00.855423 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-e4e73aae-3776-4cc5-9c54-f2e241628ae3 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?tenant_id=c50a1910195245ff8254b7cca4fdfbaa&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0287941 Feb 08 18:20:00.950204 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-0060233b-2b57-4759-a26e-3d9c2998b3ea service neutron] 10.222.0.118 "GET /v2.0/networks/15a08cf2-cd5e-4df5-9cba-d45464825731?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0881579 Feb 08 18:20:01.041721 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-bff8e824-ee4c-43b7-b209-1219558e8aa7 service neutron] 10.222.0.118 "GET /v2.0/networks/15a08cf2-cd5e-4df5-9cba-d45464825731?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0845926 Feb 08 18:20:01.209098 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-86413321-50fc-4a9c-98bd-2502e89c6d60 req-a746861b-2e2c-457b-b2f7-ac961d1b9fe5 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=6417461e-39aa-41d0-abd0-1cb7c32b50f9 HTTP/1.1" status: 200 len: 210 time: 0.0305243 Feb 08 18:20:01.241701 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b47ed1c2-4d33-4c6c-b042-cbbadf62f93e req-1437d0b1-b26f-469f-bd3a-e2fc03299ecc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:01.243377 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b47ed1c2-4d33-4c6c-b042-cbbadf62f93e req-1437d0b1-b26f-469f-bd3a-e2fc03299ecc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=88568324-0407-43a8-98b3-bc3d1e54c6f3 HTTP/1.1" status: 200 len: 945 time: 0.0576346 Feb 08 18:20:01.298139 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b47ed1c2-4d33-4c6c-b042-cbbadf62f93e req-392a972f-2ab9-490a-8386-bfd116fe95cb tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/security-groups?id=6004eaa9-5c33-40f2-aefa-709b7e32466f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0490115 Feb 08 18:20:01.436580 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1ecc68a-893e-46fc-984f-33d868df5aef req-879eeb89-98c9-4c07-a7c9-1ca332b1a8fd tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:01.438060 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c1ecc68a-893e-46fc-984f-33d868df5aef req-879eeb89-98c9-4c07-a7c9-1ca332b1a8fd tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.109 "GET /v2.0/ports?device_id=88568324-0407-43a8-98b3-bc3d1e54c6f3 HTTP/1.1" status: 200 len: 945 time: 0.0555234 Feb 08 18:20:01.533503 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-c1ecc68a-893e-46fc-984f-33d868df5aef req-5ec6108c-6083-4607-98ef-8aa52b6257bc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Deleting port bc5ffaec-cfc8-446f-b23a-7393547c52f8 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:20:01.533852 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-c1ecc68a-893e-46fc-984f-33d868df5aef req-5ec6108c-6083-4607-98ef-8aa52b6257bc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (bc5ffaec-cfc8-446f-b23a-7393547c52f8), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:01.627301 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-c1ecc68a-893e-46fc-984f-33d868df5aef req-5ec6108c-6083-4607-98ef-8aa52b6257bc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] For port bc5ffaec-cfc8-446f-b23a-7393547c52f8, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=bc5ffaec-cfc8-446f-b23a-7393547c52f8,segment=NetworkSegment(13d5b676-de49-4978-bcd0-77f8a280ddfe),segment_id=13d5b676-de49-4978-bcd0-77f8a280ddfe)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:20:01.627671 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-c1ecc68a-893e-46fc-984f-33d868df5aef req-5ec6108c-6083-4607-98ef-8aa52b6257bc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (bc5ffaec-cfc8-446f-b23a-7393547c52f8), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:01.900354 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-c1ecc68a-893e-46fc-984f-33d868df5aef req-5ec6108c-6083-4607-98ef-8aa52b6257bc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Calling delete_port for bc5ffaec-cfc8-446f-b23a-7393547c52f8 owned by compute:nova {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:20:02.027611 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-c1ecc68a-893e-46fc-984f-33d868df5aef req-5ec6108c-6083-4607-98ef-8aa52b6257bc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (bc5ffaec-cfc8-446f-b23a-7393547c52f8), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:02.040815 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['bc5ffaec-cfc8-446f-b23a-7393547c52f8'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:20:02.058119 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ec6108c-6083-4607-98ef-8aa52b6257bc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Pushing event deleted for resources: {'Port': ['ID=bc5ffaec-cfc8-446f-b23a-7393547c52f8,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:20:02.070193 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec6108c-6083-4607-98ef-8aa52b6257bc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:02.070575 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec6108c-6083-4607-98ef-8aa52b6257bc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:02.070931 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec6108c-6083-4607-98ef-8aa52b6257bc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:02.071268 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec6108c-6083-4607-98ef-8aa52b6257bc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:02.071596 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec6108c-6083-4607-98ef-8aa52b6257bc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:02.071919 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec6108c-6083-4607-98ef-8aa52b6257bc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:02.072304 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec6108c-6083-4607-98ef-8aa52b6257bc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:02.072632 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec6108c-6083-4607-98ef-8aa52b6257bc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:02.072950 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec6108c-6083-4607-98ef-8aa52b6257bc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:02.073270 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec6108c-6083-4607-98ef-8aa52b6257bc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:02.073746 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec6108c-6083-4607-98ef-8aa52b6257bc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:02.074068 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec6108c-6083-4607-98ef-8aa52b6257bc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:02.074371 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ec6108c-6083-4607-98ef-8aa52b6257bc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:02.109997 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [req-c1ecc68a-893e-46fc-984f-33d868df5aef req-5ec6108c-6083-4607-98ef-8aa52b6257bc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] No DVR routers for this DVR port bc5ffaec-cfc8-446f-b23a-7393547c52f8 on host hv-cinder-77398 {{(pid=102560) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:20:02.112755 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-c1ecc68a-893e-46fc-984f-33d868df5aef req-5ec6108c-6083-4607-98ef-8aa52b6257bc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:02.116124 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c1ecc68a-893e-46fc-984f-33d868df5aef req-5ec6108c-6083-4607-98ef-8aa52b6257bc tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.109 "DELETE /v2.0/ports/bc5ffaec-cfc8-446f-b23a-7393547c52f8 HTTP/1.1" status: 204 len: 173 time: 0.6713972 Feb 08 18:20:02.116680 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '88568324-0407-43a8-98b3-bc3d1e54c6f3', 'name': 'network-vif-deleted', 'tag': 'bc5ffaec-cfc8-446f-b23a-7393547c52f8'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:20:02.118961 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4961c024-01c2-450d-9606-c7e32acaed5f" -d '{"events": [{"server_uuid": "88568324-0407-43a8-98b3-bc3d1e54c6f3", "name": "network-vif-deleted", "tag": "bc5ffaec-cfc8-446f-b23a-7393547c52f8"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:20:02.171017 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:20:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b80ed4b8-09c9-4dd3-84c0-4f7816d3090c x-openstack-request-id: req-b80ed4b8-09c9-4dd3-84c0-4f7816d3090c {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:20:02.171314 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "88568324-0407-43a8-98b3-bc3d1e54c6f3", "name": "network-vif-deleted", "tag": "bc5ffaec-cfc8-446f-b23a-7393547c52f8", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:20:02.171601 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-b80ed4b8-09c9-4dd3-84c0-4f7816d3090c {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:20:02.172008 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '88568324-0407-43a8-98b3-bc3d1e54c6f3', 'name': 'network-vif-deleted', 'tag': 'bc5ffaec-cfc8-446f-b23a-7393547c52f8', 'status': 'completed', 'code': 200} Feb 08 18:20:02.176567 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-81144f89-65b9-41b1-9d29-6845537e98e3 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:02.178018 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-81144f89-65b9-41b1-9d29-6845537e98e3 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.109 "GET /v2.0/networks?id=15a08cf2-cd5e-4df5-9cba-d45464825731 HTTP/1.1" status: 200 len: 813 time: 0.1132586 Feb 08 18:20:02.196963 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-06ce715e-c18a-4ae6-b724-7cf9530721d4 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Request body: {'port': {'device_id': '6417461e-39aa-41d0-abd0-1cb7c32b50f9', 'network_id': '15a08cf2-cd5e-4df5-9cba-d45464825731', 'admin_state_up': True, 'tenant_id': 'c50a1910195245ff8254b7cca4fdfbaa'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:20:02.318703 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a39ea63b-ecc2-4703-b844-148770e514ea req-5c92e5a4-93ad-49cb-adfb-d1d129be2bc0 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=6417461e-39aa-41d0-abd0-1cb7c32b50f9 HTTP/1.1" status: 200 len: 210 time: 0.0306857 Feb 08 18:20:02.320378 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-06ce715e-c18a-4ae6-b724-7cf9530721d4 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Made reservation on behalf of c50a1910195245ff8254b7cca4fdfbaa for: {'port': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:20:02.324117 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-06ce715e-c18a-4ae6-b724-7cf9530721d4 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:02.421254 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-01fb423d-543d-45ee-b6be-54c20d9678b4 req-7f094290-37b2-491d-b5eb-a0b46df4c87e tempest-VolumesActionsTest-1470510165 tempest-VolumesActionsTest-1470510165-project] 10.222.0.118 "GET /v2.0/ports?device_id=88568324-0407-43a8-98b3-bc3d1e54c6f3 HTTP/1.1" status: 200 len: 210 time: 0.0364559 Feb 08 18:20:02.477280 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-06ce715e-c18a-4ae6-b724-7cf9530721d4 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Allocated IP 172.20.0.9 (15a08cf2-cd5e-4df5-9cba-d45464825731/fe603f88-f21a-48c8-b9f7-c48877966ded/2c658d9f-28b0-4b57-8f0d-0d80d321a84f) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:20:02.629287 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-06ce715e-c18a-4ae6-b724-7cf9530721d4 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Publish callbacks [] for port (2c658d9f-28b0-4b57-8f0d-0d80d321a84f), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:02.664699 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-06ce715e-c18a-4ae6-b724-7cf9530721d4 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (2c658d9f-28b0-4b57-8f0d-0d80d321a84f), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:02.706398 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-06ce715e-c18a-4ae6-b724-7cf9530721d4 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Network 15a08cf2-cd5e-4df5-9cba-d45464825731 is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:20:02.712035 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-06ce715e-c18a-4ae6-b724-7cf9530721d4 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:20:02.714502 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-06ce715e-c18a-4ae6-b724-7cf9530721d4 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:20:02.744000 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-06ce715e-c18a-4ae6-b724-7cf9530721d4 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Pushing event updated for resources: {'Port': ['ID=2c658d9f-28b0-4b57-8f0d-0d80d321a84f,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:20:02.771253 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-06ce715e-c18a-4ae6-b724-7cf9530721d4 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:02.771872 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-06ce715e-c18a-4ae6-b724-7cf9530721d4 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:02.790719 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-06ce715e-c18a-4ae6-b724-7cf9530721d4 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.109 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.5977683 Feb 08 18:20:02.801907 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] Request body: {'port': {'device_id': '6417461e-39aa-41d0-abd0-1cb7c32b50f9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77398'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:20:02.864510 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (2c658d9f-28b0-4b57-8f0d-0d80d321a84f), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:03.121001 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2c658d9f-28b0-4b57-8f0d-0d80d321a84f {{(pid=102559) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:20:03.131826 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] Publish callbacks [] for port (2c658d9f-28b0-4b57-8f0d-0d80d321a84f), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:03.145431 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.provisioning_blocks [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] Transition to ACTIVE for port object 2c658d9f-28b0-4b57-8f0d-0d80d321a84f will not be triggered until provisioned by entity L2. {{(pid=102559) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Feb 08 18:20:03.149397 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-63856478'] for port (2c658d9f-28b0-4b57-8f0d-0d80d321a84f), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:03.195087 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] Pushing event updated for resources: {'Port': ['ID=2c658d9f-28b0-4b57-8f0d-0d80d321a84f,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:20:03.273444 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] Attempting to bind port 2c658d9f-28b0-4b57-8f0d-0d80d321a84f on host hv-cinder-77398 for vnic_type normal with profile {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:20:03.273788 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] Attempting to bind port 2c658d9f-28b0-4b57-8f0d-0d80d321a84f by drivers openvswitch,hyperv on host hv-cinder-77398 at level 0 using segments [{'id': 'dfda56ea-4f8f-4241-8424-b3ed264aa208', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1054, 'network_id': '15a08cf2-cd5e-4df5-9cba-d45464825731'}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:20:03.274115 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] Attempting to bind port 2c658d9f-28b0-4b57-8f0d-0d80d321a84f on network 15a08cf2-cd5e-4df5-9cba-d45464825731 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:20:03.278898 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] Port 2c658d9f-28b0-4b57-8f0d-0d80d321a84f on network 15a08cf2-cd5e-4df5-9cba-d45464825731 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77398 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Feb 08 18:20:03.279224 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] Attempting to bind port 2c658d9f-28b0-4b57-8f0d-0d80d321a84f on network 15a08cf2-cd5e-4df5-9cba-d45464825731 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:20:03.284411 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] Checking agent: {'id': '045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77398', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'started_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 19, 48), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:20:03.284690 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] Checking segment: {'id': 'dfda56ea-4f8f-4241-8424-b3ed264aa208', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1054, 'network_id': '15a08cf2-cd5e-4df5-9cba-d45464825731'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102559) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:20:03.285083 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] Bound using segment: {'id': 'dfda56ea-4f8f-4241-8424-b3ed264aa208', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1054, 'network_id': '15a08cf2-cd5e-4df5-9cba-d45464825731'} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:20:03.285503 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] Bound port: 2c658d9f-28b0-4b57-8f0d-0d80d321a84f, host: hv-cinder-77398, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'dfda56ea-4f8f-4241-8424-b3ed264aa208', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1054, 'network_id': '15a08cf2-cd5e-4df5-9cba-d45464825731'}}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:20:03.285860 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (2c658d9f-28b0-4b57-8f0d-0d80d321a84f), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:03.349322 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] For port 2c658d9f-28b0-4b57-8f0d-0d80d321a84f, host hv-cinder-77398, cleared binding levels {{(pid=102559) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:20:03.352380 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] For port 2c658d9f-28b0-4b57-8f0d-0d80d321a84f, host hv-cinder-77398, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=2c658d9f-28b0-4b57-8f0d-0d80d321a84f,segment=NetworkSegment(dfda56ea-4f8f-4241-8424-b3ed264aa208),segment_id=dfda56ea-4f8f-4241-8424-b3ed264aa208)] {{(pid=102559) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:20:03.359400 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-63856478'] for port (2c658d9f-28b0-4b57-8f0d-0d80d321a84f), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:03.393223 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:03.394201 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:03.395640 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] 10.222.0.109 "PUT /v2.0/ports/2c658d9f-28b0-4b57-8f0d-0d80d321a84f HTTP/1.1" status: 200 len: 1093 time: 0.5977428 Feb 08 18:20:03.396085 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6417461e-39aa-41d0-abd0-1cb7c32b50f9', 'tag': '2c658d9f-28b0-4b57-8f0d-0d80d321a84f'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:20:03.398327 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-12413ea8-a517-406c-a92b-9d7f295bbd8c" -d '{"events": [{"name": "network-changed", "server_uuid": "6417461e-39aa-41d0-abd0-1cb7c32b50f9", "tag": "2c658d9f-28b0-4b57-8f0d-0d80d321a84f"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:20:03.434624 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-429c6b24-4574-4d8e-a01e-4d2f05de6ee1 service neutron] Pushing event updated for resources: {'Port': ['ID=2c658d9f-28b0-4b57-8f0d-0d80d321a84f,revision_number=3']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:20:03.452550 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:20:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b58269a8-e2ea-4aa2-a0d2-eda59bacf947 x-openstack-request-id: req-b58269a8-e2ea-4aa2-a0d2-eda59bacf947 {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:20:03.452923 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6417461e-39aa-41d0-abd0-1cb7c32b50f9", "tag": "2c658d9f-28b0-4b57-8f0d-0d80d321a84f", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:20:03.453172 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-b58269a8-e2ea-4aa2-a0d2-eda59bacf947 {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:20:03.453453 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3396af8b-9bb3-4e07-a90e-e8c68c02b061 req-aa5a8367-f466-4c4f-854f-0997bf008a9c tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:03.453941 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6417461e-39aa-41d0-abd0-1cb7c32b50f9', 'tag': '2c658d9f-28b0-4b57-8f0d-0d80d321a84f', 'status': 'completed', 'code': 200} Feb 08 18:20:03.455737 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-3396af8b-9bb3-4e07-a90e-e8c68c02b061 req-aa5a8367-f466-4c4f-854f-0997bf008a9c tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=6417461e-39aa-41d0-abd0-1cb7c32b50f9 HTTP/1.1" status: 200 len: 943 time: 0.0686681 Feb 08 18:20:03.492418 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-154fbd9f-1317-491f-a225-8ef9dc6cc5fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:03.493939 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-154fbd9f-1317-491f-a225-8ef9dc6cc5fc service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=c50a1910195245ff8254b7cca4fdfbaa&device_id=6417461e-39aa-41d0-abd0-1cb7c32b50f9 HTTP/1.1" status: 200 len: 1127 time: 0.0525744 Feb 08 18:20:03.516853 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-3396af8b-9bb3-4e07-a90e-e8c68c02b061 req-e0061dc5-1866-435e-81d3-6108b73c3a8d tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/security-groups?id=66081d7a-f07b-4f82-ad72-c8f7a5870dcd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0541737 Feb 08 18:20:03.538837 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-a74dc8c2-8eb5-4183-bda4-c29bdd1a443c service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=2c658d9f-28b0-4b57-8f0d-0d80d321a84f HTTP/1.1" status: 200 len: 217 time: 0.0376079 Feb 08 18:20:03.587231 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-6e8454cd-def0-4ddf-b6b3-453a2a93d3d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:03.588704 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-6e8454cd-def0-4ddf-b6b3-453a2a93d3d7 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=fe603f88-f21a-48c8-b9f7-c48877966ded HTTP/1.1" status: 200 len: 853 time: 0.0443079 Feb 08 18:20:03.625343 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-0365a470-6c44-4e2f-b328-a88a316b61e4 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=15a08cf2-cd5e-4df5-9cba-d45464825731&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0297177 Feb 08 18:20:03.729873 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-d55aaa84-e53c-44a2-a982-e97a3ff16755 service neutron] 10.222.0.109 "GET /v2.0/networks/15a08cf2-cd5e-4df5-9cba-d45464825731?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0976038 Feb 08 18:20:03.830802 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-eed4e156-ee59-4f54-af57-ecb76e47945e req-febded44-b3db-47d3-b801-ca4ee04c75c5 service neutron] 10.222.0.109 "GET /v2.0/networks/15a08cf2-cd5e-4df5-9cba-d45464825731?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0949547 Feb 08 18:20:03.926100 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12413ea8-a517-406c-a92b-9d7f295bbd8c req-f3e18464-8da0-4e40-b780-1cdab530a29c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:03.927674 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-12413ea8-a517-406c-a92b-9d7f295bbd8c req-f3e18464-8da0-4e40-b780-1cdab530a29c service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=c50a1910195245ff8254b7cca4fdfbaa&device_id=6417461e-39aa-41d0-abd0-1cb7c32b50f9 HTTP/1.1" status: 200 len: 1127 time: 0.0474734 Feb 08 18:20:03.997207 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:20:04.036650 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12413ea8-a517-406c-a92b-9d7f295bbd8c req-d5b74ba5-3b09-4b33-9049-59b9489b5a19 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:04.038260 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-12413ea8-a517-406c-a92b-9d7f295bbd8c req-d5b74ba5-3b09-4b33-9049-59b9489b5a19 service neutron] 10.222.0.109 "GET /v2.0/networks?id=15a08cf2-cd5e-4df5-9cba-d45464825731 HTTP/1.1" status: 200 len: 915 time: 0.1025324 Feb 08 18:20:04.082500 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-12413ea8-a517-406c-a92b-9d7f295bbd8c req-66e2cd04-0ec1-48c5-b1da-0e90931caeb3 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=2c658d9f-28b0-4b57-8f0d-0d80d321a84f HTTP/1.1" status: 200 len: 217 time: 0.0381813 Feb 08 18:20:04.129810 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12413ea8-a517-406c-a92b-9d7f295bbd8c req-31538688-6761-4ba3-92de-15dcac9d6e99 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:04.131290 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-12413ea8-a517-406c-a92b-9d7f295bbd8c req-31538688-6761-4ba3-92de-15dcac9d6e99 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=fe603f88-f21a-48c8-b9f7-c48877966ded HTTP/1.1" status: 200 len: 853 time: 0.0427346 Feb 08 18:20:04.162364 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-12413ea8-a517-406c-a92b-9d7f295bbd8c req-8a306768-8eef-43ae-9676-b7a46dcf2350 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=15a08cf2-cd5e-4df5-9cba-d45464825731&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0251667 Feb 08 18:20:04.256191 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-12413ea8-a517-406c-a92b-9d7f295bbd8c req-c69e6166-97f8-4bee-8f75-9b688ce642b4 service neutron] 10.222.0.109 "GET /v2.0/networks/15a08cf2-cd5e-4df5-9cba-d45464825731?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0867829 Feb 08 18:20:04.352523 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-12413ea8-a517-406c-a92b-9d7f295bbd8c req-4da1a474-b138-4e72-b733-7e900d233236 service neutron] 10.222.0.109 "GET /v2.0/networks/15a08cf2-cd5e-4df5-9cba-d45464825731?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0899818 Feb 08 18:20:04.644344 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3a8a1a7-84c2-4153-9d46-3dc24bc00141 req-e39e3103-3491-4164-8ca9-f20084b53f32 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:04.645757 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e3a8a1a7-84c2-4153-9d46-3dc24bc00141 req-e39e3103-3491-4164-8ca9-f20084b53f32 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=6417461e-39aa-41d0-abd0-1cb7c32b50f9 HTTP/1.1" status: 200 len: 943 time: 0.0558679 Feb 08 18:20:04.703922 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e3a8a1a7-84c2-4153-9d46-3dc24bc00141 req-f6a4cd26-a7e3-4894-a0e8-f11f0f5598b1 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/security-groups?id=66081d7a-f07b-4f82-ad72-c8f7a5870dcd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0503106 Feb 08 18:20:05.362893 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device bc5ffaec-cfc8-446f-b23a-7393547c52f8 no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:20:05.383902 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] No Port match for: bc5ffaec-cfc8-446f-b23a-7393547c52f8 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:20:05.384237 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device bc5ffaec-cfc8-446f-b23a-7393547c52f8 not bound to the agent host hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:20:05.846899 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9455633e-0607-4edb-a9ac-5660db33ddac req-94599a8e-684f-4551-94e8-ce14d357d5f4 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:05.848330 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-9455633e-0607-4edb-a9ac-5660db33ddac req-94599a8e-684f-4551-94e8-ce14d357d5f4 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=6417461e-39aa-41d0-abd0-1cb7c32b50f9 HTTP/1.1" status: 200 len: 943 time: 0.0536010 Feb 08 18:20:05.896080 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-9455633e-0607-4edb-a9ac-5660db33ddac req-258859cd-2362-4c7d-8ba5-0aff4bb5cb8f tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/security-groups?id=66081d7a-f07b-4f82-ad72-c8f7a5870dcd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421154 Feb 08 18:20:07.028301 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a07d7714-838a-400c-82bd-f835b6050841 req-8c6bda3f-6214-4a33-ad7b-0a871f6640ec tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:07.029796 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a07d7714-838a-400c-82bd-f835b6050841 req-8c6bda3f-6214-4a33-ad7b-0a871f6640ec tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=6417461e-39aa-41d0-abd0-1cb7c32b50f9 HTTP/1.1" status: 200 len: 943 time: 0.0557201 Feb 08 18:20:07.043618 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 2c658d9f-28b0-4b57-8f0d-0d80d321a84f details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:20:07.078459 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a07d7714-838a-400c-82bd-f835b6050841 req-9e51bfec-e505-4b30-908e-d87d67c5343f tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/security-groups?id=66081d7a-f07b-4f82-ad72-c8f7a5870dcd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0427759 Feb 08 18:20:07.271810 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 2c658d9f-28b0-4b57-8f0d-0d80d321a84f, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=2c658d9f-28b0-4b57-8f0d-0d80d321a84f,segment=NetworkSegment(dfda56ea-4f8f-4241-8424-b3ed264aa208),segment_id=dfda56ea-4f8f-4241-8424-b3ed264aa208)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:20:07.283549 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': '2c658d9f-28b0-4b57-8f0d-0d80d321a84f', 'network_id': '15a08cf2-cd5e-4df5-9cba-d45464825731', 'port_id': '2c658d9f-28b0-4b57-8f0d-0d80d321a84f', 'mac_address': 'fa:16:3e:9d:d1:76', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1054, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fe603f88-f21a-48c8-b9f7-c48877966ded', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:20:07.322810 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 2c658d9f-28b0-4b57-8f0d-0d80d321a84f is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:20:07.323240 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (2c658d9f-28b0-4b57-8f0d-0d80d321a84f), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:07.336260 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2c658d9f-28b0-4b57-8f0d-0d80d321a84f {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:20:07.358648 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 2c658d9f-28b0-4b57-8f0d-0d80d321a84f, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=2c658d9f-28b0-4b57-8f0d-0d80d321a84f,segment=NetworkSegment(dfda56ea-4f8f-4241-8424-b3ed264aa208),segment_id=dfda56ea-4f8f-4241-8424-b3ed264aa208)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:20:07.364239 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (2c658d9f-28b0-4b57-8f0d-0d80d321a84f), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:07.410244 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=2c658d9f-28b0-4b57-8f0d-0d80d321a84f,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:20:07.417810 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:07.418258 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:07.418519 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:07.418938 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:07.419298 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:07.419617 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:07.419943 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:07.420273 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:07.420598 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:07.420923 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:07.421251 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:07.421573 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:07.421873 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:20:07.628048 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['2c658d9f-28b0-4b57-8f0d-0d80d321a84f'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:20:08.197557 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ae14a64e-276a-4421-bb78-ca13ed3c9e56 req-ce6dfba1-840c-44be-8bc2-4d08f553f150 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:08.199067 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ae14a64e-276a-4421-bb78-ca13ed3c9e56 req-ce6dfba1-840c-44be-8bc2-4d08f553f150 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=6417461e-39aa-41d0-abd0-1cb7c32b50f9 HTTP/1.1" status: 200 len: 944 time: 0.0542467 Feb 08 18:20:08.244967 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ae14a64e-276a-4421-bb78-ca13ed3c9e56 req-fd56b4dd-74be-4919-a585-0780938fac3c tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/security-groups?id=66081d7a-f07b-4f82-ad72-c8f7a5870dcd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0402048 Feb 08 18:20:09.053418 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 2c658d9f-28b0-4b57-8f0d-0d80d321a84f up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:20:09.113062 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning for port 2c658d9f-28b0-4b57-8f0d-0d80d321a84f completed by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Feb 08 18:20:09.119903 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port 2c658d9f-28b0-4b57-8f0d-0d80d321a84f triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:20:09.122388 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (2c658d9f-28b0-4b57-8f0d-0d80d321a84f), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:09.220287 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 2c658d9f-28b0-4b57-8f0d-0d80d321a84f is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:20:09.220740 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (2c658d9f-28b0-4b57-8f0d-0d80d321a84f), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:09.256561 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6417461e-39aa-41d0-abd0-1cb7c32b50f9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2c658d9f-28b0-4b57-8f0d-0d80d321a84f'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:20:09.280002 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3e395f8d-c7de-4797-ac55-a305e8ae0e8a" -d '{"events": [{"server_uuid": "6417461e-39aa-41d0-abd0-1cb7c32b50f9", "name": "network-vif-plugged", "status": "completed", "tag": "2c658d9f-28b0-4b57-8f0d-0d80d321a84f"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:20:09.321370 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 2c658d9f-28b0-4b57-8f0d-0d80d321a84f, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=2c658d9f-28b0-4b57-8f0d-0d80d321a84f,segment=NetworkSegment(dfda56ea-4f8f-4241-8424-b3ed264aa208),segment_id=dfda56ea-4f8f-4241-8424-b3ed264aa208)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:20:09.332560 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (2c658d9f-28b0-4b57-8f0d-0d80d321a84f), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:09.395134 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=2c658d9f-28b0-4b57-8f0d-0d80d321a84f,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:20:09.406104 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f50c86a5-523d-4dd1-8e3f-79f20ca63d34 req-30a84c9a-a4d6-4f70-9c81-d9c1c4f81fd2 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:09.413598 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f50c86a5-523d-4dd1-8e3f-79f20ca63d34 req-30a84c9a-a4d6-4f70-9c81-d9c1c4f81fd2 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0743499 Feb 08 18:20:09.427388 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dfa0021-5277-44ae-b43f-be626684cc85 req-7d0c0e2f-e9ea-4489-ae9b-13b1b98ecac6 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:09.435560 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0dfa0021-5277-44ae-b43f-be626684cc85 req-7d0c0e2f-e9ea-4489-ae9b-13b1b98ecac6 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=6417461e-39aa-41d0-abd0-1cb7c32b50f9 HTTP/1.1" status: 200 len: 945 time: 0.0809705 Feb 08 18:20:09.471444 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f50c86a5-523d-4dd1-8e3f-79f20ca63d34 req-8067c271-4de2-4675-b17d-b056a41ec8fc tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0558355 Feb 08 18:20:09.491700 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0dfa0021-5277-44ae-b43f-be626684cc85 req-faf1cef0-2321-4543-85af-0d6c9b4415db tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/security-groups?id=66081d7a-f07b-4f82-ad72-c8f7a5870dcd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0552752 Feb 08 18:20:09.520428 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:20:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4ad63264-e7fe-47c3-985e-6f0335a5ece6 x-openstack-request-id: req-4ad63264-e7fe-47c3-985e-6f0335a5ece6 {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:20:09.520733 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6417461e-39aa-41d0-abd0-1cb7c32b50f9", "name": "network-vif-plugged", "status": "completed", "tag": "2c658d9f-28b0-4b57-8f0d-0d80d321a84f", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:20:09.520991 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-4ad63264-e7fe-47c3-985e-6f0335a5ece6 {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:20:09.521391 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6417461e-39aa-41d0-abd0-1cb7c32b50f9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2c658d9f-28b0-4b57-8f0d-0d80d321a84f', 'code': 200} Feb 08 18:20:09.726798 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d059656-7f88-4ff7-8de1-80bd112a777b req-3fbc977e-8502-416e-a03e-d8395eafbaae service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:09.729080 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0d059656-7f88-4ff7-8de1-80bd112a777b req-3fbc977e-8502-416e-a03e-d8395eafbaae service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=6417461e-39aa-41d0-abd0-1cb7c32b50f9 HTTP/1.1" status: 200 len: 1129 time: 0.0678329 Feb 08 18:20:09.792577 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0d059656-7f88-4ff7-8de1-80bd112a777b req-888454fb-c89d-4cb8-8fe6-85f5b117eaaf service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=66081d7a-f07b-4f82-ad72-c8f7a5870dcd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0547106 Feb 08 18:20:10.619014 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97159b20-b718-43c0-8e75-cd64d45f793d req-98bd1744-fb33-4db3-a27b-990b7d892428 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:10.624101 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-97159b20-b718-43c0-8e75-cd64d45f793d req-98bd1744-fb33-4db3-a27b-990b7d892428 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0691164 Feb 08 18:20:10.624407 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3593681d-acff-4d95-a3e2-e2aed37e1cac req-0ed9b244-28f1-4824-b383-8c46ef50343c tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:10.626282 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-3593681d-acff-4d95-a3e2-e2aed37e1cac req-0ed9b244-28f1-4824-b383-8c46ef50343c tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=6417461e-39aa-41d0-abd0-1cb7c32b50f9 HTTP/1.1" status: 200 len: 945 time: 0.0581224 Feb 08 18:20:10.695714 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-3593681d-acff-4d95-a3e2-e2aed37e1cac req-67daf3fc-41c9-4ae3-afa7-c5acb189e429 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/security-groups?id=66081d7a-f07b-4f82-ad72-c8f7a5870dcd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0589132 Feb 08 18:20:10.703107 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-97159b20-b718-43c0-8e75-cd64d45f793d req-9cd765a3-b769-4674-9cc3-dc526fb88549 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0611875 Feb 08 18:20:11.836004 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81c2c4ec-bd3d-4c7e-b97e-cb654ee15e6e req-4067ecca-2978-4a39-9fd2-98c21ac79b87 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:11.838164 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-81c2c4ec-bd3d-4c7e-b97e-cb654ee15e6e req-4067ecca-2978-4a39-9fd2-98c21ac79b87 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=6417461e-39aa-41d0-abd0-1cb7c32b50f9 HTTP/1.1" status: 200 len: 945 time: 0.0619831 Feb 08 18:20:11.880743 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-197afb61-caba-48c9-a163-d282679c67f4 req-6b9a4235-1709-45be-a8f6-0392764748bf tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:11.882382 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-197afb61-caba-48c9-a163-d282679c67f4 req-6b9a4235-1709-45be-a8f6-0392764748bf tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0782592 Feb 08 18:20:11.898821 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-81c2c4ec-bd3d-4c7e-b97e-cb654ee15e6e req-5ccd21cf-45d7-4f24-beb2-57f8d3b9c982 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/security-groups?id=66081d7a-f07b-4f82-ad72-c8f7a5870dcd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0518572 Feb 08 18:20:11.951902 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-197afb61-caba-48c9-a163-d282679c67f4 req-a6c55a1c-6b8b-4ef0-9987-f4e325342ec7 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0632660 Feb 08 18:20:13.081784 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad47c882-9bda-43b4-af91-d0b269b277f6 req-efb62128-13c8-48bb-8fd0-146b18825827 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:13.084263 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ad47c882-9bda-43b4-af91-d0b269b277f6 req-efb62128-13c8-48bb-8fd0-146b18825827 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0618913 Feb 08 18:20:13.141453 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ad47c882-9bda-43b4-af91-d0b269b277f6 req-13496db7-a455-4f0d-874e-88270751be75 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0480082 Feb 08 18:20:14.274230 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-175565a9-539e-49c7-853a-7cbf2f14338a req-48392b0e-016d-46e8-8081-b6352e82161f tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:14.276050 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-175565a9-539e-49c7-853a-7cbf2f14338a req-48392b0e-016d-46e8-8081-b6352e82161f tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0560074 Feb 08 18:20:14.328876 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-175565a9-539e-49c7-853a-7cbf2f14338a req-22dc1f42-dbab-4de3-a39a-df789b14dbb2 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0468068 Feb 08 18:20:15.389410 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-0321dd5e-18df-49d6-885a-68c1b72150f6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:15.490232 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f075badc-26a8-417e-82dd-9b3eed97b1f2 req-f3f21b59-951a-419d-84fa-531d67362f71 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:15.492335 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f075badc-26a8-417e-82dd-9b3eed97b1f2 req-f3f21b59-951a-419d-84fa-531d67362f71 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0691183 Feb 08 18:20:15.544849 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-f075badc-26a8-417e-82dd-9b3eed97b1f2 req-14e9d175-c926-458c-83f0-b6eaf6baef89 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462642 Feb 08 18:20:16.675057 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e90b068f-685a-42da-8524-6e72029e9f53 req-0cbe7a83-5c25-45b7-9aaf-5e8b2a15f8f0 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:16.677418 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e90b068f-685a-42da-8524-6e72029e9f53 req-0cbe7a83-5c25-45b7-9aaf-5e8b2a15f8f0 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0645916 Feb 08 18:20:16.741452 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e90b068f-685a-42da-8524-6e72029e9f53 req-55e6d346-174d-4ed5-8e72-a7469e942be3 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0581338 Feb 08 18:20:17.838366 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-d061f51a-b295-425d-b94f-519da4589b93 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:17.889942 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6114b79d-a595-4d7b-8bc4-1d23924a4c85 req-51941dff-4068-4f1f-8107-bb60c2f9a6b9 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:17.891504 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6114b79d-a595-4d7b-8bc4-1d23924a4c85 req-51941dff-4068-4f1f-8107-bb60c2f9a6b9 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0604174 Feb 08 18:20:17.946192 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6114b79d-a595-4d7b-8bc4-1d23924a4c85 req-3e4bfec2-aca6-4009-84e6-03ebe164ef7f tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0479188 Feb 08 18:20:18.046991 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:18.522474 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:19.088177 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0928566d-26c2-474f-8cda-78e349851dbc req-19e4a289-94fb-4002-89fe-2db81b95cd32 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:19.089675 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0928566d-26c2-474f-8cda-78e349851dbc req-19e4a289-94fb-4002-89fe-2db81b95cd32 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0726464 Feb 08 18:20:19.142560 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0928566d-26c2-474f-8cda-78e349851dbc req-f5461e64-71a5-4c9a-b9b4-b529fdcb70d0 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0470202 Feb 08 18:20:20.131318 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:20.301809 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04483d3d-19f2-479b-b954-ead6bb420f11 req-26141f45-6462-4e14-aa3d-f91328fd34d1 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:20.308149 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-04483d3d-19f2-479b-b954-ead6bb420f11 req-26141f45-6462-4e14-aa3d-f91328fd34d1 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0675128 Feb 08 18:20:20.368182 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-04483d3d-19f2-479b-b954-ead6bb420f11 req-742d57c8-771d-4893-b8a4-7924b8441d53 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0561905 Feb 08 18:20:21.503061 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8639a782-5310-4793-9589-076ed3c09d2e req-bed6219c-4bf6-4019-897e-0dd408ce0ffc tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:21.505053 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8639a782-5310-4793-9589-076ed3c09d2e req-bed6219c-4bf6-4019-897e-0dd408ce0ffc tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0627625 Feb 08 18:20:21.558815 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-8639a782-5310-4793-9589-076ed3c09d2e req-ef18d1a2-c3b1-4e86-9e69-6543d3649496 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0478308 Feb 08 18:20:21.673293 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:22.693037 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddf6a61e-515b-4588-a76e-6b5735cc35a0 req-786bda21-cdca-40a9-8320-218a3a1564b5 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:22.694536 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ddf6a61e-515b-4588-a76e-6b5735cc35a0 req-786bda21-cdca-40a9-8320-218a3a1564b5 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0616579 Feb 08 18:20:22.745002 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-ddf6a61e-515b-4588-a76e-6b5735cc35a0 req-b959cb56-d246-4164-acf0-b63cfadd49de tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0441370 Feb 08 18:20:23.865706 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-792d1b4a-979f-493b-84ff-4141f107b030 req-b644841d-f9f8-4aa2-b123-c238bbf028f4 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:23.867236 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-792d1b4a-979f-493b-84ff-4141f107b030 req-b644841d-f9f8-4aa2-b123-c238bbf028f4 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0558209 Feb 08 18:20:23.916026 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-792d1b4a-979f-493b-84ff-4141f107b030 req-f25ce358-83bf-40ae-8ccf-49ac73345bcc tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432012 Feb 08 18:20:25.049095 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ecb6967-46fa-4685-82fe-7f5614586026 req-14605332-965a-4b7c-8edd-f1b4fec93fa8 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:25.050753 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8ecb6967-46fa-4685-82fe-7f5614586026 req-14605332-965a-4b7c-8edd-f1b4fec93fa8 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0595114 Feb 08 18:20:25.102779 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8ecb6967-46fa-4685-82fe-7f5614586026 req-93050567-94e8-4ef7-8e7e-f3b712c66970 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460207 Feb 08 18:20:26.230731 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28418934-5cd7-4016-ab72-3e666c8f4914 req-f5e3517a-0803-445a-a73d-f2ff3ffc2c62 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:26.232224 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-28418934-5cd7-4016-ab72-3e666c8f4914 req-f5e3517a-0803-445a-a73d-f2ff3ffc2c62 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0566187 Feb 08 18:20:26.281421 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-28418934-5cd7-4016-ab72-3e666c8f4914 req-42746ff5-54fd-4a38-be9d-f23d8cf63f13 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435233 Feb 08 18:20:27.058022 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb3858a4-42e8-4287-9859-a59e20aa14b1 req-e5e57df9-5643-4dfc-95f7-8d4479c66cba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:27.059558 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-cb3858a4-42e8-4287-9859-a59e20aa14b1 req-e5e57df9-5643-4dfc-95f7-8d4479c66cba service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=c504038b02a545d8a8b1873a4dfee655&device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 1130 time: 0.0511501 Feb 08 18:20:27.163705 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb3858a4-42e8-4287-9859-a59e20aa14b1 req-7924f4da-849b-48c6-abee-5b560d7e2f6c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:27.165158 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-cb3858a4-42e8-4287-9859-a59e20aa14b1 req-7924f4da-849b-48c6-abee-5b560d7e2f6c service neutron] 10.222.0.109 "GET /v2.0/networks?id=ad3e14dd-35bd-4c6d-8d94-5b851458e927 HTTP/1.1" status: 200 len: 911 time: 0.0850816 Feb 08 18:20:27.227718 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-cb3858a4-42e8-4287-9859-a59e20aa14b1 req-4e8ede15-dd0e-49f9-beda-9a85df3e8c0a service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=012af0ea-fa3b-4267-a4da-80c767055b16 HTTP/1.1" status: 200 len: 1002 time: 0.0558584 Feb 08 18:20:27.284545 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb3858a4-42e8-4287-9859-a59e20aa14b1 req-65255627-defd-45ae-9e10-ffdb22ff32f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:27.286102 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-cb3858a4-42e8-4287-9859-a59e20aa14b1 req-65255627-defd-45ae-9e10-ffdb22ff32f2 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=58f829ef-859d-415d-b810-791456a616fc HTTP/1.1" status: 200 len: 848 time: 0.0472555 Feb 08 18:20:27.337401 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb3858a4-42e8-4287-9859-a59e20aa14b1 req-b0e316e9-83a2-4747-982f-b6d67cd8fa13 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:27.338947 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-cb3858a4-42e8-4287-9859-a59e20aa14b1 req-b0e316e9-83a2-4747-982f-b6d67cd8fa13 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=ad3e14dd-35bd-4c6d-8d94-5b851458e927&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0444255 Feb 08 18:20:27.468191 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ce6fa43-76c8-4b04-b75f-0d324eb0c0e6 req-165bf286-f6b5-4003-9388-91c535a22b1c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:27.469989 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3ce6fa43-76c8-4b04-b75f-0d324eb0c0e6 req-165bf286-f6b5-4003-9388-91c535a22b1c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.1165998 Feb 08 18:20:27.471571 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-cb3858a4-42e8-4287-9859-a59e20aa14b1 req-744e16b1-3405-4756-afd7-b0f074c2395c service neutron] 10.222.0.109 "GET /v2.0/networks/ad3e14dd-35bd-4c6d-8d94-5b851458e927?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1258397 Feb 08 18:20:27.570942 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3ce6fa43-76c8-4b04-b75f-0d324eb0c0e6 req-f5b676d9-baac-49a1-b9b8-d4d514965f59 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0952747 Feb 08 18:20:27.595640 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-cb3858a4-42e8-4287-9859-a59e20aa14b1 req-156b3e08-17f4-422b-8514-69fede935b59 service neutron] 10.222.0.109 "GET /v2.0/networks/ad3e14dd-35bd-4c6d-8d94-5b851458e927?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1137521 Feb 08 18:20:27.685221 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a67522-6066-4576-88f1-1c1137758142 req-572ac2d4-b516-4d96-886f-9427287a54b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:27.686720 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e8a67522-6066-4576-88f1-1c1137758142 req-572ac2d4-b516-4d96-886f-9427287a54b4 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=c504038b02a545d8a8b1873a4dfee655&device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 1130 time: 0.0483482 Feb 08 18:20:27.778425 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a67522-6066-4576-88f1-1c1137758142 req-ac44348a-22db-49a2-99f1-4740c6f2e4db service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:27.779956 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e8a67522-6066-4576-88f1-1c1137758142 req-ac44348a-22db-49a2-99f1-4740c6f2e4db service neutron] 10.222.0.109 "GET /v2.0/networks?id=ad3e14dd-35bd-4c6d-8d94-5b851458e927 HTTP/1.1" status: 200 len: 911 time: 0.0847640 Feb 08 18:20:27.851478 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e8a67522-6066-4576-88f1-1c1137758142 req-5ab1ba48-6a1f-4165-b4e4-4db3a4dda7c6 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=012af0ea-fa3b-4267-a4da-80c767055b16 HTTP/1.1" status: 200 len: 1002 time: 0.0619566 Feb 08 18:20:27.900428 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a67522-6066-4576-88f1-1c1137758142 req-3e254dfd-35c0-467f-9d53-7fd3faa7ce4c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:27.901835 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e8a67522-6066-4576-88f1-1c1137758142 req-3e254dfd-35c0-467f-9d53-7fd3faa7ce4c service neutron] 10.222.0.109 "GET /v2.0/subnets?id=58f829ef-859d-415d-b810-791456a616fc HTTP/1.1" status: 200 len: 848 time: 0.0420597 Feb 08 18:20:27.957380 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a67522-6066-4576-88f1-1c1137758142 req-cbbb8982-d5b6-4f75-b0c0-65a6b45323ba service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:27.958999 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e8a67522-6066-4576-88f1-1c1137758142 req-cbbb8982-d5b6-4f75-b0c0-65a6b45323ba service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=ad3e14dd-35bd-4c6d-8d94-5b851458e927&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0481358 Feb 08 18:20:28.057217 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e8a67522-6066-4576-88f1-1c1137758142 req-930bb84f-b343-4941-b15f-30834767e9d8 service neutron] 10.222.0.109 "GET /v2.0/networks/ad3e14dd-35bd-4c6d-8d94-5b851458e927?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863659 Feb 08 18:20:28.144130 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e8a67522-6066-4576-88f1-1c1137758142 req-d94384dc-f856-4dd7-8e11-8bbe8f98425c service neutron] 10.222.0.109 "GET /v2.0/networks/ad3e14dd-35bd-4c6d-8d94-5b851458e927?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0798371 Feb 08 18:20:28.432134 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 44844) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:20:28.480253 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_v2 [None req-a9a02eaf-83ea-4e44-a61d-a3878f2eb990 admin admin] Deleting subnet d074d819-9d20-4e30-859d-2cb6eb0386d4 {{(pid=102559) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Feb 08 18:20:28.483441 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a9a02eaf-83ea-4e44-a61d-a3878f2eb990 admin admin] Publish callbacks [] for subnet (d074d819-9d20-4e30-859d-2cb6eb0386d4), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:28.517904 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a9a02eaf-83ea-4e44-a61d-a3878f2eb990 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-63850237'] for subnet (d074d819-9d20-4e30-859d-2cb6eb0386d4), precommit_delete_associations {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:28.557508 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a9a02eaf-83ea-4e44-a61d-a3878f2eb990 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1801023'] for subnet (d074d819-9d20-4e30-859d-2cb6eb0386d4), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:28.611097 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a9a02eaf-83ea-4e44-a61d-a3878f2eb990 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1801156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-63856520', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-63685312'] for subnet (d074d819-9d20-4e30-859d-2cb6eb0386d4), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:28.635940 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9a02eaf-83ea-4e44-a61d-a3878f2eb990 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=d074d819-9d20-4e30-859d-2cb6eb0386d4,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:20:28.639530 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a9a02eaf-83ea-4e44-a61d-a3878f2eb990 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:28.645386 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-a9a02eaf-83ea-4e44-a61d-a3878f2eb990 admin admin] 10.222.0.118 "DELETE /v2.0/subnets/d074d819-9d20-4e30-859d-2cb6eb0386d4 HTTP/1.1" status: 204 len: 168 time: 0.2095952 Feb 08 18:20:28.645386 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 44848) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:20:28.716459 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd5f6dc2-b85e-4633-bccb-b13463b5fca0 req-2abeab93-f8b2-4bc7-a971-ed03db1cab82 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:28.717950 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-fd5f6dc2-b85e-4633-bccb-b13463b5fca0 req-2abeab93-f8b2-4bc7-a971-ed03db1cab82 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0751643 Feb 08 18:20:28.745499 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c9a5a170-4d89-4c4a-8a9b-889b96b909f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1860329'] for network (d9d306b6-f1ce-4d24-8c8b-cb17ece212e1), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:28.787330 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-fd5f6dc2-b85e-4633-bccb-b13463b5fca0 req-db0d2121-f323-4002-add6-dff3c87f2847 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0587668 Feb 08 18:20:28.823325 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c9a5a170-4d89-4c4a-8a9b-889b96b909f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1721768', 'neutron.services.segments.db._delete_segments_for_network-8770558865089'] for network (d9d306b6-f1ce-4d24-8c8b-cb17ece212e1), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:28.843936 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.services.segments.db [None req-c9a5a170-4d89-4c4a-8a9b-889b96b909f1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d9d306b6-f1ce-4d24-8c8b-cb17ece212e1']}} {{(pid=102559) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:20:28.853685 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.services.segments.db [None req-c9a5a170-4d89-4c4a-8a9b-889b96b909f1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '13d5b676-de49-4978-bcd0-77f8a280ddfe') {'for_net_delete': True} {{(pid=102559) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:20:28.853995 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.services.segments.db [None req-c9a5a170-4d89-4c4a-8a9b-889b96b909f1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '13d5b676-de49-4978-bcd0-77f8a280ddfe') {} {{(pid=102559) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:20:28.865043 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c9a5a170-4d89-4c4a-8a9b-889b96b909f1 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8770558866122', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-63850230'] for segment (13d5b676-de49-4978-bcd0-77f8a280ddfe), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:28.878211 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c9a5a170-4d89-4c4a-8a9b-889b96b909f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (13d5b676-de49-4978-bcd0-77f8a280ddfe), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:28.884504 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c9a5a170-4d89-4c4a-8a9b-889b96b909f1 admin admin] Releasing vlan 1087 on physical network physnet1 to pool {{(pid=102559) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Feb 08 18:20:28.884931 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c9a5a170-4d89-4c4a-8a9b-889b96b909f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-63856418'] for segment (13d5b676-de49-4978-bcd0-77f8a280ddfe), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: Traceback (most recent call last): Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: timer() Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: cb(*args, **kw) Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: return func(*args, **kwargs) Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: self._notify() Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: self.callback(batched_events) Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: event.method(event) Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: aggregate_uuid = self.p_client.list_aggregates( Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: return f(self, *a, **k) Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: return self._get(url).json() Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: return self._client.get(url, endpoint_filter=self._ks_filter, Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: return self.request(url, 'GET', **kwargs) Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: base_url = self.get_endpoint(auth, allow=allow, Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 08 18:20:28.886701 dv-cinder-773985-21-iscsi neutron-server[102559]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 08 18:20:28.945136 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c9a5a170-4d89-4c4a-8a9b-889b96b909f1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1721777', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-560760'] for network (d9d306b6-f1ce-4d24-8c8b-cb17ece212e1), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:28.952372 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-c9a5a170-4d89-4c4a-8a9b-889b96b909f1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:28.955687 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-c9a5a170-4d89-4c4a-8a9b-889b96b909f1 admin admin] 10.222.0.118 "DELETE /v2.0/networks/d9d306b6-f1ce-4d24-8c8b-cb17ece212e1 HTTP/1.1" status: 204 len: 168 time: 0.3093228 Feb 08 18:20:28.965259 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9a5a170-4d89-4c4a-8a9b-889b96b909f1 admin admin] Pushing event deleted for resources: {'Network': ['ID=d9d306b6-f1ce-4d24-8c8b-cb17ece212e1,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:20:29.075945 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 44852) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:20:29.117712 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-6ad17b38-1bab-43da-b91e-67366161b043 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=c5d4fcba9e9048fba6601a79d19e96bb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0404632 Feb 08 18:20:29.120149 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 44854) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:20:29.167011 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6f95b838-ff17-4397-a5b3-a619c9333d03 admin admin] Publish callbacks [] for security_group (6004eaa9-5c33-40f2-aefa-709b7e32466f), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:29.187916 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6f95b838-ff17-4397-a5b3-a619c9333d03 admin admin] Publish callbacks [] for security_group (6004eaa9-5c33-40f2-aefa-709b7e32466f), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:29.244611 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6f95b838-ff17-4397-a5b3-a619c9333d03 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (6004eaa9-5c33-40f2-aefa-709b7e32466f), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:29.247253 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6f95b838-ff17-4397-a5b3-a619c9333d03 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:29.248398 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-6f95b838-ff17-4397-a5b3-a619c9333d03 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/6004eaa9-5c33-40f2-aefa-709b7e32466f HTTP/1.1" status: 204 len: 168 time: 0.1273227 Feb 08 18:20:29.255875 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f95b838-ff17-4397-a5b3-a619c9333d03 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6004eaa9-5c33-40f2-aefa-709b7e32466f,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:20:29.908448 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fdf0a71-00d5-4c56-bf65-aafd609bee36 req-0332556a-613d-4820-a536-5547d6ac317b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:29.909940 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-4fdf0a71-00d5-4c56-bf65-aafd609bee36 req-0332556a-613d-4820-a536-5547d6ac317b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0525739 Feb 08 18:20:29.960981 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-4fdf0a71-00d5-4c56-bf65-aafd609bee36 req-2b7c2cdd-4548-41ea-8ab0-2490e893e863 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452161 Feb 08 18:20:31.084566 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e09a8980-0812-4895-b65f-f75788823c74 req-89ca8224-3d8f-44a4-a794-c5e7db773921 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:31.086106 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e09a8980-0812-4895-b65f-f75788823c74 req-89ca8224-3d8f-44a4-a794-c5e7db773921 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0548856 Feb 08 18:20:31.137028 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e09a8980-0812-4895-b65f-f75788823c74 req-19715707-ffd3-4a01-a73e-e0c9600c2efd tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451558 Feb 08 18:20:31.208789 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [req-60aa6664-c8b0-42bb-96c5-34d46faf4023 req-09d9210f-d161-4e24-98bf-4817c2fea6d0 service neutron] http://10.222.0.118:9696/v2.0/extensions returned with HTTP 200 {{(pid=102559) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 08 18:20:31.209990 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-60aa6664-c8b0-42bb-96c5-34d46faf4023 req-09d9210f-d161-4e24-98bf-4817c2fea6d0 service neutron] 10.222.0.118 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0081713 Feb 08 18:20:31.393022 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5c539ed7-dda7-4257-bcfc-d02977aee85d req-cb4e4b4b-2100-4815-8585-035b5c0ff4b2 service neutron] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0811927 Feb 08 18:20:31.406953 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91a33e28-7c3d-4027-8c44-5a0b4aa5a1fd req-a2da615b-2c58-4154-9a7c-181b05771598 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:31.408351 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-91a33e28-7c3d-4027-8c44-5a0b4aa5a1fd req-a2da615b-2c58-4154-9a7c-181b05771598 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0714047 Feb 08 18:20:31.461147 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-91a33e28-7c3d-4027-8c44-5a0b4aa5a1fd req-0fe11d2c-9fc7-468a-9d0c-dd7fb2883c8a tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0455377 Feb 08 18:20:32.592305 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92b00d0b-c5be-4e63-8d93-3dfe62805248 req-7b9441cf-621a-4736-9095-e4e1b0c70114 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:32.593764 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-92b00d0b-c5be-4e63-8d93-3dfe62805248 req-7b9441cf-621a-4736-9095-e4e1b0c70114 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0554996 Feb 08 18:20:32.641897 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-92b00d0b-c5be-4e63-8d93-3dfe62805248 req-fa5c8709-106f-4ba6-8508-f9843771a8a6 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0424831 Feb 08 18:20:32.909969 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c539ed7-dda7-4257-bcfc-d02977aee85d req-ea6e29b6-1ea1-4332-8b49-1bbc0624a4a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:32.911542 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5c539ed7-dda7-4257-bcfc-d02977aee85d req-ea6e29b6-1ea1-4332-8b49-1bbc0624a4a3 service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81&tenant_id=c504038b02a545d8a8b1873a4dfee655 HTTP/1.1" status: 200 len: 1130 time: 0.0558500 Feb 08 18:20:32.982490 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c539ed7-dda7-4257-bcfc-d02977aee85d req-6e703a7f-2eee-4bc9-a121-e6ec9cbae8df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:32.984211 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5c539ed7-dda7-4257-bcfc-d02977aee85d req-6e703a7f-2eee-4bc9-a121-e6ec9cbae8df service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=c504038b02a545d8a8b1873a4dfee655&device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 1130 time: 0.0454092 Feb 08 18:20:33.084401 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c539ed7-dda7-4257-bcfc-d02977aee85d req-50ed2375-7370-47a7-851d-35ab92aabd44 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:33.085899 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5c539ed7-dda7-4257-bcfc-d02977aee85d req-50ed2375-7370-47a7-851d-35ab92aabd44 service neutron] 10.222.0.109 "GET /v2.0/networks?id=ad3e14dd-35bd-4c6d-8d94-5b851458e927 HTTP/1.1" status: 200 len: 911 time: 0.0919378 Feb 08 18:20:33.141032 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 012af0ea-fa3b-4267-a4da-80c767055b16 no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:20:33.160031 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5c539ed7-dda7-4257-bcfc-d02977aee85d req-c2f2a754-fe5d-4880-ad1c-58e94a1327f5 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=012af0ea-fa3b-4267-a4da-80c767055b16 HTTP/1.1" status: 200 len: 1002 time: 0.0677500 Feb 08 18:20:33.219516 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c539ed7-dda7-4257-bcfc-d02977aee85d req-e4c92c2c-a77b-4d7a-8101-d17ca8d3a677 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:33.221001 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5c539ed7-dda7-4257-bcfc-d02977aee85d req-e4c92c2c-a77b-4d7a-8101-d17ca8d3a677 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=58f829ef-859d-415d-b810-791456a616fc HTTP/1.1" status: 200 len: 848 time: 0.0495353 Feb 08 18:20:33.222328 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 012af0ea-fa3b-4267-a4da-80c767055b16 is: ACTIVE; New status is: DOWN {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:20:33.222714 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (012af0ea-fa3b-4267-a4da-80c767055b16), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:33.245475 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd5ab9458-bd5e-49a0-b97b-1e388bb5af81', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '012af0ea-fa3b-4267-a4da-80c767055b16'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:20:33.247705 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7fec99d7-75a4-4258-baad-646b65b9c466" -d '{"events": [{"server_uuid": "d5ab9458-bd5e-49a0-b97b-1e388bb5af81", "name": "network-vif-unplugged", "status": "completed", "tag": "012af0ea-fa3b-4267-a4da-80c767055b16"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:20:33.260126 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 012af0ea-fa3b-4267-a4da-80c767055b16, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=012af0ea-fa3b-4267-a4da-80c767055b16,segment=NetworkSegment(2daf4609-3228-47d5-8b2b-536e57ae3977),segment_id=2daf4609-3228-47d5-8b2b-536e57ae3977)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:20:33.265580 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (012af0ea-fa3b-4267-a4da-80c767055b16), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:33.275241 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c539ed7-dda7-4257-bcfc-d02977aee85d req-e7cf474d-b09a-42e5-92b2-dae469c4b8b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:33.276856 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5c539ed7-dda7-4257-bcfc-d02977aee85d req-e7cf474d-b09a-42e5-92b2-dae469c4b8b6 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=ad3e14dd-35bd-4c6d-8d94-5b851458e927&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0483241 Feb 08 18:20:33.294943 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 08 Feb 2022 18:20:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bab5b5f6-e516-495f-85ae-e74a55a0c801 x-openstack-request-id: req-bab5b5f6-e516-495f-85ae-e74a55a0c801 {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:20:33.295463 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d5ab9458-bd5e-49a0-b97b-1e388bb5af81", "name": "network-vif-unplugged", "status": "completed", "tag": "012af0ea-fa3b-4267-a4da-80c767055b16", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:20:33.295715 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-bab5b5f6-e516-495f-85ae-e74a55a0c801 {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:20:33.296151 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd5ab9458-bd5e-49a0-b97b-1e388bb5af81', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '012af0ea-fa3b-4267-a4da-80c767055b16', 'code': 200} Feb 08 18:20:33.318131 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=012af0ea-fa3b-4267-a4da-80c767055b16,revision_number=6']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:20:33.368616 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5c539ed7-dda7-4257-bcfc-d02977aee85d req-550c35c6-4fe9-4a1b-b6ad-cfd185fb0565 service neutron] 10.222.0.109 "GET /v2.0/networks/ad3e14dd-35bd-4c6d-8d94-5b851458e927?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0838511 Feb 08 18:20:33.473247 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5c539ed7-dda7-4257-bcfc-d02977aee85d req-b2d00d63-b4d7-476c-bd04-d8a7a683ce9f service neutron] 10.222.0.109 "GET /v2.0/networks/ad3e14dd-35bd-4c6d-8d94-5b851458e927?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0967753 Feb 08 18:20:33.764542 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a05130f-1485-410f-9ad2-3d0b51823d8d req-67610984-e0f0-4bda-9098-f18fef46863f tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:33.766330 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-6a05130f-1485-410f-9ad2-3d0b51823d8d req-67610984-e0f0-4bda-9098-f18fef46863f tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 944 time: 0.0547280 Feb 08 18:20:33.821265 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-6a05130f-1485-410f-9ad2-3d0b51823d8d req-81618bbe-2a84-4cb1-a3e4-1c1533f8eee6 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0491033 Feb 08 18:20:34.189524 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6c641c1-d4b0-4a3a-8611-fad9b73a432a req-7c2a5a7b-350e-4b3a-8c7a-692d2145ae74 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:34.190928 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e6c641c1-d4b0-4a3a-8611-fad9b73a432a req-7c2a5a7b-350e-4b3a-8c7a-692d2145ae74 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=6417461e-39aa-41d0-abd0-1cb7c32b50f9 HTTP/1.1" status: 200 len: 945 time: 0.0543349 Feb 08 18:20:34.241714 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-e6c641c1-d4b0-4a3a-8611-fad9b73a432a req-dd86280b-9f23-4733-9cdb-593ff2eaa54e tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/security-groups?id=66081d7a-f07b-4f82-ad72-c8f7a5870dcd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0424564 Feb 08 18:20:34.956142 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f5c3d75-f3ec-4786-a831-985b30419a9c req-fd7021e3-27df-4a1f-b6ec-b68ff68117a7 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:34.957581 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5f5c3d75-f3ec-4786-a831-985b30419a9c req-fd7021e3-27df-4a1f-b6ec-b68ff68117a7 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 944 time: 0.0558524 Feb 08 18:20:35.008568 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5f5c3d75-f3ec-4786-a831-985b30419a9c req-5cae73af-2d4d-43c4-a866-be4787d1d940 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0435977 Feb 08 18:20:35.364519 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a7c665c-952d-49ef-a665-0d3d87e12ed5 req-397d4460-a927-4874-84ad-beb1581576fd tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:35.366030 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5a7c665c-952d-49ef-a665-0d3d87e12ed5 req-397d4460-a927-4874-84ad-beb1581576fd tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=6417461e-39aa-41d0-abd0-1cb7c32b50f9 HTTP/1.1" status: 200 len: 945 time: 0.0542445 Feb 08 18:20:35.427459 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5a7c665c-952d-49ef-a665-0d3d87e12ed5 req-94941256-4853-4cfa-9bf5-668e0c54369b tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/security-groups?id=66081d7a-f07b-4f82-ad72-c8f7a5870dcd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0527000 Feb 08 18:20:35.964980 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cea89a5e-fbb4-4321-922a-d156e4e3bad5 req-adbc6342-1b18-4df3-b57f-6ea7e13f6839 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:35.966518 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-cea89a5e-fbb4-4321-922a-d156e4e3bad5 req-adbc6342-1b18-4df3-b57f-6ea7e13f6839 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.109 "GET /v2.0/ports?device_id=6417461e-39aa-41d0-abd0-1cb7c32b50f9 HTTP/1.1" status: 200 len: 945 time: 0.0620446 Feb 08 18:20:36.067396 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [req-cea89a5e-fbb4-4321-922a-d156e4e3bad5 req-196391a3-e8ae-4a2f-bb2f-4dac65e75368 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Deleting port 2c658d9f-28b0-4b57-8f0d-0d80d321a84f {{(pid=102559) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:20:36.067822 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-cea89a5e-fbb4-4321-922a-d156e4e3bad5 req-196391a3-e8ae-4a2f-bb2f-4dac65e75368 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (2c658d9f-28b0-4b57-8f0d-0d80d321a84f), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:36.447896 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-cea89a5e-fbb4-4321-922a-d156e4e3bad5 req-196391a3-e8ae-4a2f-bb2f-4dac65e75368 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] For port 2c658d9f-28b0-4b57-8f0d-0d80d321a84f, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=2c658d9f-28b0-4b57-8f0d-0d80d321a84f,segment=NetworkSegment(dfda56ea-4f8f-4241-8424-b3ed264aa208),segment_id=dfda56ea-4f8f-4241-8424-b3ed264aa208)] {{(pid=102559) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:20:36.448236 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-cea89a5e-fbb4-4321-922a-d156e4e3bad5 req-196391a3-e8ae-4a2f-bb2f-4dac65e75368 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (2c658d9f-28b0-4b57-8f0d-0d80d321a84f), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:36.457002 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0316c527-9bbc-4002-8170-1ef640335901 req-adf96e86-c539-437d-b013-849f95b5d61a tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:36.458521 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0316c527-9bbc-4002-8170-1ef640335901 req-adf96e86-c539-437d-b013-849f95b5d61a tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 944 time: 0.3765593 Feb 08 18:20:36.475840 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [req-cea89a5e-fbb4-4321-922a-d156e4e3bad5 req-196391a3-e8ae-4a2f-bb2f-4dac65e75368 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Calling delete_port for 2c658d9f-28b0-4b57-8f0d-0d80d321a84f owned by compute:nova {{(pid=102559) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:20:36.562603 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-0316c527-9bbc-4002-8170-1ef640335901 req-5e52dff7-a388-4159-ad5c-9cf777a1a9d5 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0956106 Feb 08 18:20:36.563006 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce0ce5e6-0f49-4c9a-87dd-84c63cf463ea req-2324774b-8dd2-4db9-b402-397eeb7cebd8 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:36.566841 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ce0ce5e6-0f49-4c9a-87dd-84c63cf463ea req-2324774b-8dd2-4db9-b402-397eeb7cebd8 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/ports?device_id=6417461e-39aa-41d0-abd0-1cb7c32b50f9 HTTP/1.1" status: 200 len: 945 time: 0.0659232 Feb 08 18:20:36.621409 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ce0ce5e6-0f49-4c9a-87dd-84c63cf463ea req-3b6e0545-8a07-4344-a1cd-607b4bc6271a tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.118 "GET /v2.0/security-groups?id=66081d7a-f07b-4f82-ad72-c8f7a5870dcd&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0478952 Feb 08 18:20:36.641735 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-cea89a5e-fbb4-4321-922a-d156e4e3bad5 req-196391a3-e8ae-4a2f-bb2f-4dac65e75368 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (2c658d9f-28b0-4b57-8f0d-0d80d321a84f), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:36.654556 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['2c658d9f-28b0-4b57-8f0d-0d80d321a84f'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:20:36.671552 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-196391a3-e8ae-4a2f-bb2f-4dac65e75368 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Pushing event deleted for resources: {'Port': ['ID=2c658d9f-28b0-4b57-8f0d-0d80d321a84f,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:20:36.715168 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [req-cea89a5e-fbb4-4321-922a-d156e4e3bad5 req-196391a3-e8ae-4a2f-bb2f-4dac65e75368 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] No DVR routers for this DVR port 2c658d9f-28b0-4b57-8f0d-0d80d321a84f on host hv-cinder-77398 {{(pid=102559) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:20:36.717582 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-cea89a5e-fbb4-4321-922a-d156e4e3bad5 req-196391a3-e8ae-4a2f-bb2f-4dac65e75368 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:36.720955 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-cea89a5e-fbb4-4321-922a-d156e4e3bad5 req-196391a3-e8ae-4a2f-bb2f-4dac65e75368 tempest-VolumesSnapshotTestJSON-711531397 tempest-VolumesSnapshotTestJSON-711531397-project] 10.222.0.109 "DELETE /v2.0/ports/2c658d9f-28b0-4b57-8f0d-0d80d321a84f HTTP/1.1" status: 204 len: 173 time: 0.7454281 Feb 08 18:20:36.721384 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6417461e-39aa-41d0-abd0-1cb7c32b50f9', 'name': 'network-vif-deleted', 'tag': '2c658d9f-28b0-4b57-8f0d-0d80d321a84f'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:20:36.723683 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a8ba41b5-00de-49c9-a2c8-30b5b62aa738" -d '{"events": [{"server_uuid": "6417461e-39aa-41d0-abd0-1cb7c32b50f9", "name": "network-vif-deleted", "tag": "2c658d9f-28b0-4b57-8f0d-0d80d321a84f"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:20:36.761746 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:20:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c2cf8748-042f-410b-b921-c023d0fa0b79 x-openstack-request-id: req-c2cf8748-042f-410b-b921-c023d0fa0b79 {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:20:36.762031 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6417461e-39aa-41d0-abd0-1cb7c32b50f9", "name": "network-vif-deleted", "tag": "2c658d9f-28b0-4b57-8f0d-0d80d321a84f", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:20:36.762277 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-c2cf8748-042f-410b-b921-c023d0fa0b79 {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:20:36.762665 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6417461e-39aa-41d0-abd0-1cb7c32b50f9', 'name': 'network-vif-deleted', 'tag': '2c658d9f-28b0-4b57-8f0d-0d80d321a84f', 'status': 'completed', 'code': 200} Feb 08 18:20:37.702179 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81129517-e62a-445a-9c45-5a045904a96a req-238fa1c7-319e-4b69-9c97-5abde22acf11 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:37.703796 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-81129517-e62a-445a-9c45-5a045904a96a req-238fa1c7-319e-4b69-9c97-5abde22acf11 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 944 time: 0.0598824 Feb 08 18:20:37.753703 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-81129517-e62a-445a-9c45-5a045904a96a req-2ea6f31d-6e11-484e-a2cd-723a08a4fd38 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439646 Feb 08 18:20:38.883549 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f554b0e-1034-4934-b171-e872350e585e req-7deaf67b-66b1-4d8b-93c2-6dcdfc9697c1 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:38.885446 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3f554b0e-1034-4934-b171-e872350e585e req-7deaf67b-66b1-4d8b-93c2-6dcdfc9697c1 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 944 time: 0.0559661 Feb 08 18:20:38.937539 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3f554b0e-1034-4934-b171-e872350e585e req-eb53bef8-0f7e-445f-afe6-8626354565be tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0465229 Feb 08 18:20:39.186447 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 2c658d9f-28b0-4b57-8f0d-0d80d321a84f no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:20:39.206380 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] No Port match for: 2c658d9f-28b0-4b57-8f0d-0d80d321a84f {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:20:39.206727 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 2c658d9f-28b0-4b57-8f0d-0d80d321a84f not bound to the agent host hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:20:40.069684 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1904094-239c-4ada-9279-b1c1b8eec66e req-9e094a56-975d-443e-be78-d69dfbf250b1 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:40.071217 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a1904094-239c-4ada-9279-b1c1b8eec66e req-9e094a56-975d-443e-be78-d69dfbf250b1 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 944 time: 0.0628021 Feb 08 18:20:40.122031 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a1904094-239c-4ada-9279-b1c1b8eec66e req-bfce4cfe-ebbc-456c-9074-46331867588e tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446935 Feb 08 18:20:40.997316 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:20:41.248468 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a2b95a0-b21f-4477-bf4b-35690abccd08 req-fe79d5d3-d0c7-401a-8e0f-e8eba6a4eb75 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:41.249832 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3a2b95a0-b21f-4477-bf4b-35690abccd08 req-fe79d5d3-d0c7-401a-8e0f-e8eba6a4eb75 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 944 time: 0.0521595 Feb 08 18:20:41.297320 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-3a2b95a0-b21f-4477-bf4b-35690abccd08 req-50eaa5a2-b15e-4473-881a-ad918f94bb98 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0417638 Feb 08 18:20:41.818745 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 012af0ea-fa3b-4267-a4da-80c767055b16 details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:20:41.921449 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 012af0ea-fa3b-4267-a4da-80c767055b16, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=012af0ea-fa3b-4267-a4da-80c767055b16,segment=NetworkSegment(2daf4609-3228-47d5-8b2b-536e57ae3977),segment_id=2daf4609-3228-47d5-8b2b-536e57ae3977)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:20:41.934171 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': '012af0ea-fa3b-4267-a4da-80c767055b16', 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927', 'port_id': '012af0ea-fa3b-4267-a4da-80c767055b16', 'mac_address': 'fa:16:3e:4c:d6:fc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1065, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '58f829ef-859d-415d-b810-791456a616fc', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:20:41.971659 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 012af0ea-fa3b-4267-a4da-80c767055b16 is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:20:41.972043 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (012af0ea-fa3b-4267-a4da-80c767055b16), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:41.985183 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 012af0ea-fa3b-4267-a4da-80c767055b16 {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:20:42.007690 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 012af0ea-fa3b-4267-a4da-80c767055b16, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=012af0ea-fa3b-4267-a4da-80c767055b16,segment=NetworkSegment(2daf4609-3228-47d5-8b2b-536e57ae3977),segment_id=2daf4609-3228-47d5-8b2b-536e57ae3977)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:20:42.014125 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (012af0ea-fa3b-4267-a4da-80c767055b16), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:42.061694 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=012af0ea-fa3b-4267-a4da-80c767055b16,revision_number=7']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:20:42.436274 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3112d63-d9a3-4a26-9843-780964063c39 req-f3c5daad-76f4-4d20-80cb-fca107eb1038 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:42.437693 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f3112d63-d9a3-4a26-9843-780964063c39 req-f3c5daad-76f4-4d20-80cb-fca107eb1038 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 945 time: 0.0648806 Feb 08 18:20:42.485299 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f3112d63-d9a3-4a26-9843-780964063c39 req-ead17748-ddf6-4a80-83a3-55b86983cc10 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420067 Feb 08 18:20:43.167325 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['012af0ea-fa3b-4267-a4da-80c767055b16'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:20:43.287780 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae2cbf9-ee33-4f43-89df-ab3bbb26f617 req-41487594-117b-40c2-98cd-d253bcc8c504 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:43.289474 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-fae2cbf9-ee33-4f43-89df-ab3bbb26f617 req-41487594-117b-40c2-98cd-d253bcc8c504 service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 1129 time: 0.0512938 Feb 08 18:20:43.338592 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-fae2cbf9-ee33-4f43-89df-ab3bbb26f617 req-510b13f6-fafa-47e3-a8d8-faae7a4c30ea service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0392265 Feb 08 18:20:43.608031 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e469671-0857-4154-a66e-0e4eb690ca5a req-0c059b77-b478-493e-b7ce-aed706e3bad2 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:43.609524 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8e469671-0857-4154-a66e-0e4eb690ca5a req-0c059b77-b478-493e-b7ce-aed706e3bad2 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 945 time: 0.0523214 Feb 08 18:20:43.658142 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8e469671-0857-4154-a66e-0e4eb690ca5a req-42214fa8-b6c6-4100-81b9-56b8e3d59138 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0430465 Feb 08 18:20:44.801628 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41447e44-696a-4beb-8a01-1f9240734bbd req-d614e661-670c-465c-9f15-e6e803e8c905 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:20:44.803117 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-41447e44-696a-4beb-8a01-1f9240734bbd req-d614e661-670c-465c-9f15-e6e803e8c905 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 945 time: 0.0606358 Feb 08 18:20:44.854117 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-41447e44-696a-4beb-8a01-1f9240734bbd req-8dab6598-bc3a-4536-bada-794d12f04bdc tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452094 Feb 08 18:20:45.197354 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 012af0ea-fa3b-4267-a4da-80c767055b16 up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:20:45.245425 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port 012af0ea-fa3b-4267-a4da-80c767055b16 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:20:45.245801 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (012af0ea-fa3b-4267-a4da-80c767055b16), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:45.324335 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 012af0ea-fa3b-4267-a4da-80c767055b16 is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:20:45.324693 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (012af0ea-fa3b-4267-a4da-80c767055b16), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:45.346659 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd5ab9458-bd5e-49a0-b97b-1e388bb5af81', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '012af0ea-fa3b-4267-a4da-80c767055b16'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:20:45.348914 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-40071f05-6f72-42f0-b357-0e3857635713" -d '{"events": [{"server_uuid": "d5ab9458-bd5e-49a0-b97b-1e388bb5af81", "name": "network-vif-plugged", "status": "completed", "tag": "012af0ea-fa3b-4267-a4da-80c767055b16"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:20:45.369209 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 012af0ea-fa3b-4267-a4da-80c767055b16, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=012af0ea-fa3b-4267-a4da-80c767055b16,segment=NetworkSegment(2daf4609-3228-47d5-8b2b-536e57ae3977),segment_id=2daf4609-3228-47d5-8b2b-536e57ae3977)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:20:45.377336 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (012af0ea-fa3b-4267-a4da-80c767055b16), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:45.403330 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-e191c796-c75f-4298-91d0-06001c54bfdf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:45.407829 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:20:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3c2cd1ff-dc33-4617-b922-14c25a0c44b9 x-openstack-request-id: req-3c2cd1ff-dc33-4617-b922-14c25a0c44b9 {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:20:45.408118 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d5ab9458-bd5e-49a0-b97b-1e388bb5af81", "name": "network-vif-plugged", "status": "completed", "tag": "012af0ea-fa3b-4267-a4da-80c767055b16", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:20:45.408368 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-3c2cd1ff-dc33-4617-b922-14c25a0c44b9 {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:20:45.408753 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd5ab9458-bd5e-49a0-b97b-1e388bb5af81', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '012af0ea-fa3b-4267-a4da-80c767055b16', 'code': 200} Feb 08 18:20:45.438462 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=012af0ea-fa3b-4267-a4da-80c767055b16,revision_number=8']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:20:47.835045 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-0730a051-ba88-47aa-8141-48e8a30935ce None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:48.055569 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:48.521229 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:50.143917 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:20:51.682516 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:03.273458 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45262) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:03.386173 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-420b4704-a787-4234-b96c-ec08bdb8569a admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:03.457366 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-420b4704-a787-4234-b96c-ec08bdb8569a admin admin] Publish callbacks [] for security_group (581b0de5-19d3-4d14-ad91-e04240530b9e), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:03.463817 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-420b4704-a787-4234-b96c-ec08bdb8569a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (581b0de5-19d3-4d14-ad91-e04240530b9e), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:03.504170 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-420b4704-a787-4234-b96c-ec08bdb8569a admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=d2c912454bad40b484699efa8048300a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2295737 Feb 08 18:21:03.504993 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-420b4704-a787-4234-b96c-ec08bdb8569a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=581b0de5-19d3-4d14-ad91-e04240530b9e,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:03.507321 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45266) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:03.512392 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-420b4704-a787-4234-b96c-ec08bdb8569a admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.512745 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-420b4704-a787-4234-b96c-ec08bdb8569a admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.513053 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-420b4704-a787-4234-b96c-ec08bdb8569a admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.513418 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-420b4704-a787-4234-b96c-ec08bdb8569a admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.513742 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-420b4704-a787-4234-b96c-ec08bdb8569a admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.514057 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-420b4704-a787-4234-b96c-ec08bdb8569a admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.514378 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-420b4704-a787-4234-b96c-ec08bdb8569a admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.514697 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-420b4704-a787-4234-b96c-ec08bdb8569a admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.515051 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-420b4704-a787-4234-b96c-ec08bdb8569a admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.515368 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-420b4704-a787-4234-b96c-ec08bdb8569a admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.515682 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-420b4704-a787-4234-b96c-ec08bdb8569a admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.515993 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-420b4704-a787-4234-b96c-ec08bdb8569a admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.516290 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-420b4704-a787-4234-b96c-ec08bdb8569a admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.559014 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-45d2eab6-295b-4813-926c-9bdbd0de30d5 admin admin] Publish callbacks [] for security_group (581b0de5-19d3-4d14-ad91-e04240530b9e), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:03.580013 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-45d2eab6-295b-4813-926c-9bdbd0de30d5 admin admin] Publish callbacks [] for security_group (581b0de5-19d3-4d14-ad91-e04240530b9e), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:03.628694 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-45d2eab6-295b-4813-926c-9bdbd0de30d5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (581b0de5-19d3-4d14-ad91-e04240530b9e), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:03.631611 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-45d2eab6-295b-4813-926c-9bdbd0de30d5 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:03.632753 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-45d2eab6-295b-4813-926c-9bdbd0de30d5 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/581b0de5-19d3-4d14-ad91-e04240530b9e HTTP/1.1" status: 204 len: 168 time: 0.1243463 Feb 08 18:21:03.640363 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45d2eab6-295b-4813-926c-9bdbd0de30d5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=581b0de5-19d3-4d14-ad91-e04240530b9e,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:03.647413 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d2eab6-295b-4813-926c-9bdbd0de30d5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.647767 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d2eab6-295b-4813-926c-9bdbd0de30d5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.648111 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d2eab6-295b-4813-926c-9bdbd0de30d5 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.648461 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d2eab6-295b-4813-926c-9bdbd0de30d5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.648806 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d2eab6-295b-4813-926c-9bdbd0de30d5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.649113 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d2eab6-295b-4813-926c-9bdbd0de30d5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.649440 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d2eab6-295b-4813-926c-9bdbd0de30d5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.649765 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d2eab6-295b-4813-926c-9bdbd0de30d5 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.650091 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d2eab6-295b-4813-926c-9bdbd0de30d5 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.650413 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d2eab6-295b-4813-926c-9bdbd0de30d5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.650739 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d2eab6-295b-4813-926c-9bdbd0de30d5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.651087 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d2eab6-295b-4813-926c-9bdbd0de30d5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:03.651409 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-45d2eab6-295b-4813-926c-9bdbd0de30d5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:04.082871 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45272) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:04.130244 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_v2 [None req-660446ac-4b63-46d8-aa43-6735865abf0d admin admin] Deleting subnet fe603f88-f21a-48c8-b9f7-c48877966ded {{(pid=102560) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Feb 08 18:21:04.133857 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-660446ac-4b63-46d8-aa43-6735865abf0d admin admin] Publish callbacks [] for subnet (fe603f88-f21a-48c8-b9f7-c48877966ded), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:04.177365 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-660446ac-4b63-46d8-aa43-6735865abf0d admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-64533851'] for subnet (fe603f88-f21a-48c8-b9f7-c48877966ded), precommit_delete_associations {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:04.220483 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-660446ac-4b63-46d8-aa43-6735865abf0d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1801023'] for subnet (fe603f88-f21a-48c8-b9f7-c48877966ded), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:04.283729 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-660446ac-4b63-46d8-aa43-6735865abf0d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1801156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-64531538', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-64597460'] for subnet (fe603f88-f21a-48c8-b9f7-c48877966ded), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:04.312836 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-660446ac-4b63-46d8-aa43-6735865abf0d admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:04.316038 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-660446ac-4b63-46d8-aa43-6735865abf0d admin admin] 10.222.0.118 "DELETE /v2.0/subnets/fe603f88-f21a-48c8-b9f7-c48877966ded HTTP/1.1" status: 204 len: 168 time: 0.2321703 Feb 08 18:21:04.316963 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-660446ac-4b63-46d8-aa43-6735865abf0d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fe603f88-f21a-48c8-b9f7-c48877966ded,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:04.318871 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45274) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:04.390212 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9e6de19c-3032-488d-acb9-e867edc73638 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1860329'] for network (15a08cf2-cd5e-4df5-9cba-d45464825731), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:04.483815 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9e6de19c-3032-488d-acb9-e867edc73638 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1721768', 'neutron.services.segments.db._delete_segments_for_network-8770558865089'] for network (15a08cf2-cd5e-4df5-9cba-d45464825731), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:04.503371 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.services.segments.db [None req-9e6de19c-3032-488d-acb9-e867edc73638 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['15a08cf2-cd5e-4df5-9cba-d45464825731']}} {{(pid=102559) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:04.512513 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.services.segments.db [None req-9e6de19c-3032-488d-acb9-e867edc73638 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'dfda56ea-4f8f-4241-8424-b3ed264aa208') {'for_net_delete': True} {{(pid=102559) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:04.512803 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.services.segments.db [None req-9e6de19c-3032-488d-acb9-e867edc73638 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'dfda56ea-4f8f-4241-8424-b3ed264aa208') {} {{(pid=102559) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:04.525606 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9e6de19c-3032-488d-acb9-e867edc73638 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8770558866122', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-63850230'] for segment (dfda56ea-4f8f-4241-8424-b3ed264aa208), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:04.541320 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9e6de19c-3032-488d-acb9-e867edc73638 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (dfda56ea-4f8f-4241-8424-b3ed264aa208), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:04.549663 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-9e6de19c-3032-488d-acb9-e867edc73638 admin admin] Releasing vlan 1054 on physical network physnet1 to pool {{(pid=102559) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Feb 08 18:21:04.550053 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9e6de19c-3032-488d-acb9-e867edc73638 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-63856418'] for segment (dfda56ea-4f8f-4241-8424-b3ed264aa208), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: Traceback (most recent call last): Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: timer() Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: cb(*args, **kw) Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: return func(*args, **kwargs) Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: self._notify() Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: self.callback(batched_events) Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: event.method(event) Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: aggregate_uuid = self.p_client.list_aggregates( Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: return f(self, *a, **k) Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: return self._get(url).json() Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: return self._client.get(url, endpoint_filter=self._ks_filter, Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: return self.request(url, 'GET', **kwargs) Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: base_url = self.get_endpoint(auth, allow=allow, Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 08 18:21:04.552516 dv-cinder-773985-21-iscsi neutron-server[102559]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 08 18:21:04.613303 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9e6de19c-3032-488d-acb9-e867edc73638 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1721777', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-560760'] for network (15a08cf2-cd5e-4df5-9cba-d45464825731), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:04.619252 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-9e6de19c-3032-488d-acb9-e867edc73638 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:04.622336 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-9e6de19c-3032-488d-acb9-e867edc73638 admin admin] 10.222.0.118 "DELETE /v2.0/networks/15a08cf2-cd5e-4df5-9cba-d45464825731 HTTP/1.1" status: 204 len: 168 time: 0.3024347 Feb 08 18:21:04.633329 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e6de19c-3032-488d-acb9-e867edc73638 admin admin] Pushing event deleted for resources: {'Network': ['ID=15a08cf2-cd5e-4df5-9cba-d45464825731,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:04.789023 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45278) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:04.834713 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-a5c2616e-23ac-4b35-8f2e-6a4a4d64c7d6 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=c50a1910195245ff8254b7cca4fdfbaa&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0443389 Feb 08 18:21:04.837037 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45280) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:04.887101 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-8c4010c2-89b3-439b-ad69-4107524d9b9e admin admin] Publish callbacks [] for security_group (66081d7a-f07b-4f82-ad72-c8f7a5870dcd), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:04.908399 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-8c4010c2-89b3-439b-ad69-4107524d9b9e admin admin] Publish callbacks [] for security_group (66081d7a-f07b-4f82-ad72-c8f7a5870dcd), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:04.958040 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-8c4010c2-89b3-439b-ad69-4107524d9b9e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (66081d7a-f07b-4f82-ad72-c8f7a5870dcd), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:04.961283 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-8c4010c2-89b3-439b-ad69-4107524d9b9e admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:04.962433 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-8c4010c2-89b3-439b-ad69-4107524d9b9e admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/66081d7a-f07b-4f82-ad72-c8f7a5870dcd HTTP/1.1" status: 204 len: 168 time: 0.1245236 Feb 08 18:21:04.970108 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c4010c2-89b3-439b-ad69-4107524d9b9e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=66081d7a-f07b-4f82-ad72-c8f7a5870dcd,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:13.084231 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45350) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:13.208299 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-cc235eb5-e5fc-4515-af92-c425fccc1018 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:13.288823 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-cc235eb5-e5fc-4515-af92-c425fccc1018 admin admin] Publish callbacks [] for security_group (30705cae-c9eb-4e76-8b67-beb1b5764c13), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:13.295197 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-cc235eb5-e5fc-4515-af92-c425fccc1018 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (30705cae-c9eb-4e76-8b67-beb1b5764c13), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:13.333071 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-cc235eb5-e5fc-4515-af92-c425fccc1018 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=d17e5ca2f0f343f0a98f85c8cdc07f48&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2476902 Feb 08 18:21:13.333837 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cc235eb5-e5fc-4515-af92-c425fccc1018 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=30705cae-c9eb-4e76-8b67-beb1b5764c13,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:13.336050 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45354) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:13.384818 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f49fcaae-fb90-45fd-a448-fcc5debd1f27 admin admin] Publish callbacks [] for security_group (30705cae-c9eb-4e76-8b67-beb1b5764c13), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:13.406932 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f49fcaae-fb90-45fd-a448-fcc5debd1f27 admin admin] Publish callbacks [] for security_group (30705cae-c9eb-4e76-8b67-beb1b5764c13), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:13.456321 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f49fcaae-fb90-45fd-a448-fcc5debd1f27 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (30705cae-c9eb-4e76-8b67-beb1b5764c13), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:13.459161 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f49fcaae-fb90-45fd-a448-fcc5debd1f27 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:13.463244 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-f49fcaae-fb90-45fd-a448-fcc5debd1f27 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/30705cae-c9eb-4e76-8b67-beb1b5764c13 HTTP/1.1" status: 204 len: 168 time: 0.1261644 Feb 08 18:21:13.471172 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f49fcaae-fb90-45fd-a448-fcc5debd1f27 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=30705cae-c9eb-4e76-8b67-beb1b5764c13,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:14.118385 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45376) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:14.224745 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-0f54d8c3-dce0-4802-969e-ad49cda03053 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1869431064-network', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:21:14.244754 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0f54d8c3-dce0-4802-969e-ad49cda03053 admin admin] Made reservation on behalf of a49c4d8ef7824a87af0bd566f0854d0a for: {'network': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:21:14.247125 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0f54d8c3-dce0-4802-969e-ad49cda03053 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for network (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:14.257859 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0f54d8c3-dce0-4802-969e-ad49cda03053 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:14.337523 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0f54d8c3-dce0-4802-969e-ad49cda03053 admin admin] Publish callbacks [] for security_group (9075e248-9f79-4172-8836-235f98d20c89), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:14.342687 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0f54d8c3-dce0-4802-969e-ad49cda03053 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (9075e248-9f79-4172-8836-235f98d20c89), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:14.366708 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0f54d8c3-dce0-4802-969e-ad49cda03053 admin admin] vlan segment allocate from pool success with {'vlan_id': 1074, 'physical_network': 'physnet1'} {{(pid=102559) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Feb 08 18:21:14.378127 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f54d8c3-dce0-4802-969e-ad49cda03053 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9075e248-9f79-4172-8836-235f98d20c89,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:14.380942 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0f54d8c3-dce0-4802-969e-ad49cda03053 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (d7f921a8-081c-445a-b287-4ebec76c43ab), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:14.381273 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.db.segments_db [None req-0f54d8c3-dce0-4802-969e-ad49cda03053 admin admin] Added segment d7f921a8-081c-445a-b287-4ebec76c43ab of type vlan for network bfa2dbfe-1e79-44ee-9df4-62197aec047e Feb 08 18:21:14.421169 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0f54d8c3-dce0-4802-969e-ad49cda03053 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8770558521384'] for network (bfa2dbfe-1e79-44ee-9df4-62197aec047e), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:14.447134 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0f54d8c3-dce0-4802-969e-ad49cda03053 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for network (bfa2dbfe-1e79-44ee-9df4-62197aec047e), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:14.448120 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0f54d8c3-dce0-4802-969e-ad49cda03053 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:14.448681 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0f54d8c3-dce0-4802-969e-ad49cda03053 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:14.504278 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-0f54d8c3-dce0-4802-969e-ad49cda03053 admin admin] 10.222.0.118 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.3847194 Feb 08 18:21:14.507943 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45380) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:14.511712 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f54d8c3-dce0-4802-969e-ad49cda03053 admin admin] Pushing event updated for resources: {'Network': ['ID=bfa2dbfe-1e79-44ee-9df4-62197aec047e,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:14.513187 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-6936d98d-0302-4ed9-81c1-e73994cfc206 admin admin] Request body: {'subnet': {'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1869431064-subnet', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'ip_version': 4}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:21:14.523308 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Network bfa2dbfe-1e79-44ee-9df4-62197aec047e details requested by agent ovs-agent-dv-cinder-773985-21-iscsi with host dv-cinder-773985-21-iscsi {{(pid=102561) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Feb 08 18:21:14.536254 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6936d98d-0302-4ed9-81c1-e73994cfc206 admin admin] Made reservation on behalf of a49c4d8ef7824a87af0bd566f0854d0a for: {'subnet': 1} {{(pid=102560) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:21:14.539205 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-6936d98d-0302-4ed9-81c1-e73994cfc206 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-64597491'] for subnet (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:14.700989 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-6936d98d-0302-4ed9-81c1-e73994cfc206 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-64531473', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-64597453'] for subnet (96b794ac-bea5-4ac6-8b01-835f4cdef825), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:14.755063 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6936d98d-0302-4ed9-81c1-e73994cfc206 admin admin] Pushing event updated for resources: {'Subnet': ['ID=96b794ac-bea5-4ac6-8b01-835f4cdef825,revision_number=0']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:14.765050 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6936d98d-0302-4ed9-81c1-e73994cfc206 admin admin] Checking segment: {'id': 'd7f921a8-081c-445a-b287-4ebec76c43ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102560) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:21:14.765397 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6936d98d-0302-4ed9-81c1-e73994cfc206 admin admin] Network hostable DHCP agents. Network: bfa2dbfe-1e79-44ee-9df4-62197aec047e, hostable agents: ['006b5388-ac7d-4794-a124-14bb8e5d8fec'], hosted agents: [] {{(pid=102560) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Feb 08 18:21:14.783150 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6936d98d-0302-4ed9-81c1-e73994cfc206 admin admin] Network bfa2dbfe-1e79-44ee-9df4-62197aec047e is scheduled to be hosted by DHCP agent 006b5388-ac7d-4794-a124-14bb8e5d8fec with binding_index 1 {{(pid=102560) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Feb 08 18:21:14.793421 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-6936d98d-0302-4ed9-81c1-e73994cfc206 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773985-21-iscsi, bfa2dbfe-1e79-44ee-9df4-62197aec047e) {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:21:14.797568 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6936d98d-0302-4ed9-81c1-e73994cfc206 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:14.798147 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-6936d98d-0302-4ed9-81c1-e73994cfc206 admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:14.803214 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37a8024c-8eca-468a-9d2c-60aa4cf85561 None None] Network bfa2dbfe-1e79-44ee-9df4-62197aec047e requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:21:14.815179 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-6936d98d-0302-4ed9-81c1-e73994cfc206 admin admin] 10.222.0.118 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.3058910 Feb 08 18:21:14.817856 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45382) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:14.822011 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-3634438d-d322-41fc-b8cf-a71b2d15838e admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1869431064-router', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:21:14.840730 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3634438d-d322-41fc-b8cf-a71b2d15838e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-557369', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6968'] for router (4840b53c-7786-4bda-8326-dd7d53cf4097), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:14.841942 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3634438d-d322-41fc-b8cf-a71b2d15838e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-557389', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-560615', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-578936', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6961'] for router (4840b53c-7786-4bda-8326-dd7d53cf4097), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:14.893651 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3634438d-d322-41fc-b8cf-a71b2d15838e admin admin] Publish callbacks [] for router_controller (4840b53c-7786-4bda-8326-dd7d53cf4097), precommit_add_association {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:14.904769 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp7dd4f88d-be07-54f7-888b-e9d2dcd2237c-bfa2dbfe-1e79-44ee-9df4-62197aec047e', 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e', 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'fixed_ips': [{'subnet_id': '96b794ac-bea5-4ac6-8b01-835f4cdef825'}]}} from dv-cinder-773985-21-iscsi. {{(pid=102561) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Feb 08 18:21:14.905627 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:15.033902 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3634438d-d322-41fc-b8cf-a71b2d15838e admin admin] Publish callbacks [] for router_gateway (4840b53c-7786-4bda-8326-dd7d53cf4097), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:15.042568 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.db_base_plugin_common [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Allocated IP 172.20.0.2 (bfa2dbfe-1e79-44ee-9df4-62197aec047e/96b794ac-bea5-4ac6-8b01-835f4cdef825/cc244935-cc99-4cc9-89b2-0d3e3ed3b616) {{(pid=102561) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:21:15.179070 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Publish callbacks [] for port (cc244935-cc99-4cc9-89b2-0d3e3ed3b616), precommit_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:15.185067 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (cc244935-cc99-4cc9-89b2-0d3e3ed3b616), after_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:15.226388 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Network bfa2dbfe-1e79-44ee-9df4-62197aec047e is already hosted by enough agents. {{(pid=102561) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:21:15.228591 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3634438d-d322-41fc-b8cf-a71b2d15838e admin admin] Publish callbacks [] for router_gateway (4840b53c-7786-4bda-8326-dd7d53cf4097), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:15.229209 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.scheduler.base_scheduler [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Resources bound (agent type, host, resource id): {{(pid=102561) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:21:15.233390 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Received port after_create {{(pid=102561) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:21:15.236434 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Pushing event updated for resources: {'Port': ['ID=cc244935-cc99-4cc9-89b2-0d3e3ed3b616,revision_number=1']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:15.247651 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:15.247999 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:15.248341 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:15.248679 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:15.249025 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:15.249345 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:15.249672 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:15.249981 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:15.250318 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:15.250438 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3634438d-d322-41fc-b8cf-a71b2d15838e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:15.250636 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:15.250978 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:15.251277 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:15.251800 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:15.299069 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Attempting to bind port cc244935-cc99-4cc9-89b2-0d3e3ed3b616 on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:21:15.299301 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Attempting to bind port cc244935-cc99-4cc9-89b2-0d3e3ed3b616 by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': 'd7f921a8-081c-445a-b287-4ebec76c43ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e'}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:21:15.299688 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Attempting to bind port cc244935-cc99-4cc9-89b2-0d3e3ed3b616 on network bfa2dbfe-1e79-44ee-9df4-62197aec047e {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:21:15.304858 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 20, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:21:15.305255 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Checking segment: {'id': 'd7f921a8-081c-445a-b287-4ebec76c43ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102561) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:21:15.305647 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:15.306037 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Bound using segment: {'id': 'd7f921a8-081c-445a-b287-4ebec76c43ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e'} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:21:15.306505 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Bound port: cc244935-cc99-4cc9-89b2-0d3e3ed3b616, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd7f921a8-081c-445a-b287-4ebec76c43ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e'}}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:21:15.306942 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (cc244935-cc99-4cc9-89b2-0d3e3ed3b616), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:15.356070 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_common [None req-3634438d-d322-41fc-b8cf-a71b2d15838e admin admin] Allocated IP 172.27.1.143 (77055816-7c88-403d-8f8a-9be2c1faa10d/18547c52-7b23-42cd-bb53-214663ed102b/227490ec-5281-4713-bf74-27f395237029) {{(pid=102560) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:21:15.381410 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] For port cc244935-cc99-4cc9-89b2-0d3e3ed3b616, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102561) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:21:15.384524 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] For port cc244935-cc99-4cc9-89b2-0d3e3ed3b616, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=cc244935-cc99-4cc9-89b2-0d3e3ed3b616,segment=NetworkSegment(d7f921a8-081c-445a-b287-4ebec76c43ab),segment_id=d7f921a8-081c-445a-b287-4ebec76c43ab)] {{(pid=102561) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:21:15.385762 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-de0ac7fc-d1aa-49ef-ac4f-bfc7ef13a8e3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:15.392028 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (cc244935-cc99-4cc9-89b2-0d3e3ed3b616), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:15.446745 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9029d6bc-3be4-4a6c-b777-8fb44b425dd9 None None] Pushing event updated for resources: {'Port': ['ID=cc244935-cc99-4cc9-89b2-0d3e3ed3b616,revision_number=2']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:15.469077 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3634438d-d322-41fc-b8cf-a71b2d15838e admin admin] Publish callbacks [] for port (227490ec-5281-4713-bf74-27f395237029), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:15.508841 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3634438d-d322-41fc-b8cf-a71b2d15838e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (227490ec-5281-4713-bf74-27f395237029), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:15.551706 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3634438d-d322-41fc-b8cf-a71b2d15838e admin admin] Network 77055816-7c88-403d-8f8a-9be2c1faa10d is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:21:15.554471 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-3634438d-d322-41fc-b8cf-a71b2d15838e admin admin] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:21:15.558872 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3634438d-d322-41fc-b8cf-a71b2d15838e admin admin] Received port after_create {{(pid=102560) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:21:15.561891 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3634438d-d322-41fc-b8cf-a71b2d15838e admin admin] Pushing event updated for resources: {'Port': ['ID=227490ec-5281-4713-bf74-27f395237029,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:15.826473 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3634438d-d322-41fc-b8cf-a71b2d15838e admin admin] Publish callbacks [] for router_gateway (4840b53c-7786-4bda-8326-dd7d53cf4097), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:15.883371 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device cc244935-cc99-4cc9-89b2-0d3e3ed3b616 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:21:15.934835 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port cc244935-cc99-4cc9-89b2-0d3e3ed3b616 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:21:15.935216 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (cc244935-cc99-4cc9-89b2-0d3e3ed3b616), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:16.021113 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port cc244935-cc99-4cc9-89b2-0d3e3ed3b616 is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:21:16.021482 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (cc244935-cc99-4cc9-89b2-0d3e3ed3b616), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:16.028474 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3634438d-d322-41fc-b8cf-a71b2d15838e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-557494', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-560688'] for router (4840b53c-7786-4bda-8326-dd7d53cf4097), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:16.060483 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] For port cc244935-cc99-4cc9-89b2-0d3e3ed3b616, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=cc244935-cc99-4cc9-89b2-0d3e3ed3b616,segment=NetworkSegment(d7f921a8-081c-445a-b287-4ebec76c43ab),segment_id=d7f921a8-081c-445a-b287-4ebec76c43ab)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:21:16.065668 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (cc244935-cc99-4cc9-89b2-0d3e3ed3b616), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:16.118323 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Pushing event updated for resources: {'Port': ['ID=cc244935-cc99-4cc9-89b2-0d3e3ed3b616,revision_number=3']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:16.165835 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3634438d-d322-41fc-b8cf-a71b2d15838e admin admin] Router 4840b53c-7786-4bda-8326-dd7d53cf4097 is scheduled to L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 with binding_index 1 {{(pid=102560) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Feb 08 18:21:16.279982 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3634438d-d322-41fc-b8cf-a71b2d15838e admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:21:16.289212 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] Sync routers for ids ['4840b53c-7786-4bda-8326-dd7d53cf4097'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:21:16.300972 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3634438d-d322-41fc-b8cf-a71b2d15838e admin admin] Publish callbacks [] for router (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:16.301794 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] Routers {'4840b53c-7786-4bda-8326-dd7d53cf4097'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:21:16.302327 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-3634438d-d322-41fc-b8cf-a71b2d15838e admin admin] 10.222.0.118 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 1.4835877 Feb 08 18:21:16.302535 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:20:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['4840b53c-7786-4bda-8326-dd7d53cf4097'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:16.305156 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45384) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:16.345637 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f857a38c-44c5-4152-befb-684bbbccb92a None None] Network bfa2dbfe-1e79-44ee-9df4-62197aec047e requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:21:16.448213 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-300ed78b-d08a-4b47-b154-53b1c1249f6f None None] Provisioning complete for port cc244935-cc99-4cc9-89b2-0d3e3ed3b616 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:21:16.448558 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-300ed78b-d08a-4b47-b154-53b1c1249f6f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (cc244935-cc99-4cc9-89b2-0d3e3ed3b616), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:16.533968 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] Set router 4840b53c-7786-4bda-8326-dd7d53cf4097 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:21:16.838505 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-300ed78b-d08a-4b47-b154-53b1c1249f6f None None] Current status of the port cc244935-cc99-4cc9-89b2-0d3e3ed3b616 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:21:16.903785 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'name': 'tempest-TestMinimumBasicScenario-1869431064-router', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '227490ec-5281-4713-bf74-27f395237029', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:14Z', 'updated_at': '2022-02-08T18:21:15Z', 'revision_number': 3, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'gw_port': {'id': '227490ec-5281-4713-bf74-27f395237029', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:89:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:15Z', 'updated_at': '2022-02-08T18:21:15Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:16.934363 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] Checking router: 4840b53c-7786-4bda-8326-dd7d53cf4097 for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:21:16.934718 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] Updating router 4840b53c-7786-4bda-8326-dd7d53cf4097 port 227490ec-5281-4713-bf74-27f395237029 binding host dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Feb 08 18:21:16.964114 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (227490ec-5281-4713-bf74-27f395237029), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:16.996669 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b1448dad-7314-476e-8aeb-8673b5319b2e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:17.088491 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-dfa06051-c6ce-4e14-8acc-9a3a308c76fc None None] Provisioning complete for port cc244935-cc99-4cc9-89b2-0d3e3ed3b616 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:21:17.088738 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-dfa06051-c6ce-4e14-8acc-9a3a308c76fc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (cc244935-cc99-4cc9-89b2-0d3e3ed3b616), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:17.150417 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_common [None req-b1448dad-7314-476e-8aeb-8673b5319b2e admin admin] Allocated IP 172.20.0.1 (bfa2dbfe-1e79-44ee-9df4-62197aec047e/96b794ac-bea5-4ac6-8b01-835f4cdef825/23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2) {{(pid=102560) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:21:17.247578 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-dfa06051-c6ce-4e14-8acc-9a3a308c76fc None None] Current status of the port cc244935-cc99-4cc9-89b2-0d3e3ed3b616 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:21:17.254674 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b1448dad-7314-476e-8aeb-8673b5319b2e admin admin] Publish callbacks [] for port (23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:17.291840 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b1448dad-7314-476e-8aeb-8673b5319b2e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:17.298706 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] Publish callbacks [] for port (227490ec-5281-4713-bf74-27f395237029), precommit_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:17.303948 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (227490ec-5281-4713-bf74-27f395237029), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:17.332816 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1448dad-7314-476e-8aeb-8673b5319b2e admin admin] Network bfa2dbfe-1e79-44ee-9df4-62197aec047e is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:21:17.335659 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-b1448dad-7314-476e-8aeb-8673b5319b2e admin admin] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:21:17.339991 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b1448dad-7314-476e-8aeb-8673b5319b2e admin admin] Received port after_create {{(pid=102560) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:21:17.343037 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1448dad-7314-476e-8aeb-8673b5319b2e admin admin] Pushing event updated for resources: {'Port': ['ID=23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:17.357461 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] Attempting to bind port 227490ec-5281-4713-bf74-27f395237029 on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:21:17.357897 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] Attempting to bind port 227490ec-5281-4713-bf74-27f395237029 by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:21:17.358349 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] Attempting to bind port 227490ec-5281-4713-bf74-27f395237029 on network 77055816-7c88-403d-8f8a-9be2c1faa10d {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:21:17.371456 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 20, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:21:17.371934 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] Checking segment: {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102561) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:21:17.372380 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:17.372835 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] Bound using segment: {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:21:17.373381 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] Bound port: 227490ec-5281-4713-bf74-27f395237029, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:21:17.373839 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (227490ec-5281-4713-bf74-27f395237029), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:17.380488 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b1448dad-7314-476e-8aeb-8673b5319b2e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-560871'] for router_interface (4840b53c-7786-4bda-8326-dd7d53cf4097), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:17.397222 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2c3a7b9-d49c-4f61-9adf-6bdd580de8d4 None None] Pushing event updated for resources: {'Port': ['ID=227490ec-5281-4713-bf74-27f395237029,revision_number=2']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:17.430906 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] For port 227490ec-5281-4713-bf74-27f395237029, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102561) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:21:17.434198 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] For port 227490ec-5281-4713-bf74-27f395237029, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=227490ec-5281-4713-bf74-27f395237029,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102561) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:21:17.442096 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (227490ec-5281-4713-bf74-27f395237029), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:17.504817 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2c3a7b9-d49c-4f61-9adf-6bdd580de8d4 None None] Pushing event updated for resources: {'Port': ['ID=227490ec-5281-4713-bf74-27f395237029,revision_number=3']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:17.507062 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] Routers {'4840b53c-7786-4bda-8326-dd7d53cf4097'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:21:17.507857 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:20:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['4840b53c-7786-4bda-8326-dd7d53cf4097'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:17.522276 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b1448dad-7314-476e-8aeb-8673b5319b2e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:17.605572 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-0e1e0c37-d040-4c7b-b943-cd464a204987 None None] Provisioning complete for port 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:21:17.605846 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-0e1e0c37-d040-4c7b-b943-cd464a204987 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:17.655135 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-0e1e0c37-d040-4c7b-b943-cd464a204987 None None] Port 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2 cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:21:17.657478 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] Set router 4840b53c-7786-4bda-8326-dd7d53cf4097 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:21:17.684015 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b1448dad-7314-476e-8aeb-8673b5319b2e admin admin] Publish callbacks [] for port (23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:17.689755 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b1448dad-7314-476e-8aeb-8673b5319b2e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-64531588'] for port (23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:17.754275 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b1448dad-7314-476e-8aeb-8673b5319b2e admin admin] Pushing event updated for resources: {'Port': ['ID=23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2,revision_number=2']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:17.759157 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b1448dad-7314-476e-8aeb-8673b5319b2e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-631683', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-559991'] for router_interface (4840b53c-7786-4bda-8326-dd7d53cf4097), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:17.858923 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-0047f39a-4b31-4306-930b-ff8044762ede None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:17.860859 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b1448dad-7314-476e-8aeb-8673b5319b2e admin admin] Network bfa2dbfe-1e79-44ee-9df4-62197aec047e is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:21:17.862279 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-b1448dad-7314-476e-8aeb-8673b5319b2e admin admin] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:21:17.865959 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device cc244935-cc99-4cc9-89b2-0d3e3ed3b616 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:21:17.938015 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'name': 'tempest-TestMinimumBasicScenario-1869431064-router', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '227490ec-5281-4713-bf74-27f395237029', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:14Z', 'updated_at': '2022-02-08T18:21:17Z', 'revision_number': 4, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'gw_port': {'id': '227490ec-5281-4713-bf74-27f395237029', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:89:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:15Z', 'updated_at': '2022-02-08T18:21:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2', 'name': '', 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'mac_address': 'fa:16:3e:ab:a4:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '96b794ac-bea5-4ac6-8b01-835f4cdef825', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:17Z', 'updated_at': '2022-02-08T18:21:17Z', 'revision_number': 1, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'subnets': [{'id': '96b794ac-bea5-4ac6-8b01-835f4cdef825', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:17.941474 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port cc244935-cc99-4cc9-89b2-0d3e3ed3b616 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:21:17.941915 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (cc244935-cc99-4cc9-89b2-0d3e3ed3b616), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:17.972310 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b445c1d7-197a-40c1-a6b5-710d619b352b None None] The sync data for ids ['4840b53c-7786-4bda-8326-dd7d53cf4097'] in dv-cinder-773985-21-iscsi is: [{'id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'name': 'tempest-TestMinimumBasicScenario-1869431064-router', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '227490ec-5281-4713-bf74-27f395237029', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:14Z', 'updated_at': '2022-02-08T18:21:17Z', 'revision_number': 4, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'gw_port': {'id': '227490ec-5281-4713-bf74-27f395237029', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:89:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:15Z', 'updated_at': '2022-02-08T18:21:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2', 'name': '', 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'mac_address': 'fa:16:3e:ab:a4:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '96b794ac-bea5-4ac6-8b01-835f4cdef825', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:17Z', 'updated_at': '2022-02-08T18:21:17Z', 'revision_number': 1, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'subnets': [{'id': '96b794ac-bea5-4ac6-8b01-835f4cdef825', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:21:17.979024 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b1448dad-7314-476e-8aeb-8673b5319b2e admin admin] Router 4840b53c-7786-4bda-8326-dd7d53cf4097 has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:21:18.000637 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:21:18.086205 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port cc244935-cc99-4cc9-89b2-0d3e3ed3b616 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:21:18.090572 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:18.100706 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b1448dad-7314-476e-8aeb-8673b5319b2e admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:21:18.105889 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-b1448dad-7314-476e-8aeb-8673b5319b2e admin admin] 10.222.0.118 "PUT /v2.0/routers/4840b53c-7786-4bda-8326-dd7d53cf4097/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7997408 Feb 08 18:21:18.178927 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-86438863-853e-43a4-a6d6-3a8fbf0456c2 None None] Provisioning complete for port 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:21:18.179307 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-86438863-853e-43a4-a6d6-3a8fbf0456c2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:18.234009 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-86438863-853e-43a4-a6d6-3a8fbf0456c2 None None] Port 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2 cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:21:18.525376 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:18.633999 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45400) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:18.639264 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-31d68d5a-cea3-4246-a9e5-d2ada2ac6077 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-1676436270-network', 'tenant_id': '5a27073c24ea479ab55d00b3886a010e'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:21:18.659780 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-31d68d5a-cea3-4246-a9e5-d2ada2ac6077 admin admin] Made reservation on behalf of 5a27073c24ea479ab55d00b3886a010e for: {'network': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:21:18.662043 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-31d68d5a-cea3-4246-a9e5-d2ada2ac6077 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for network (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:18.672507 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-31d68d5a-cea3-4246-a9e5-d2ada2ac6077 admin admin] Publish callbacks [] for security_group (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:18.751876 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-31d68d5a-cea3-4246-a9e5-d2ada2ac6077 admin admin] Publish callbacks [] for security_group (9a00ae86-e139-4230-9fd9-9fd7caebd9c2), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:18.756019 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-31d68d5a-cea3-4246-a9e5-d2ada2ac6077 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (9a00ae86-e139-4230-9fd9-9fd7caebd9c2), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:18.783362 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-31d68d5a-cea3-4246-a9e5-d2ada2ac6077 admin admin] vlan segment allocate from pool success with {'vlan_id': 1058, 'physical_network': 'physnet1'} {{(pid=102559) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Feb 08 18:21:18.790196 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31d68d5a-cea3-4246-a9e5-d2ada2ac6077 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9a00ae86-e139-4230-9fd9-9fd7caebd9c2,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:18.796629 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-31d68d5a-cea3-4246-a9e5-d2ada2ac6077 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (0d63bc5b-3ce8-454e-8bc9-2f9a2d079796), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:18.796972 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.db.segments_db [None req-31d68d5a-cea3-4246-a9e5-d2ada2ac6077 admin admin] Added segment 0d63bc5b-3ce8-454e-8bc9-2f9a2d079796 of type vlan for network def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13 Feb 08 18:21:18.839436 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-31d68d5a-cea3-4246-a9e5-d2ada2ac6077 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8770558521384'] for network (def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:18.865471 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-31d68d5a-cea3-4246-a9e5-d2ada2ac6077 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709'] for network (def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:18.866840 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-31d68d5a-cea3-4246-a9e5-d2ada2ac6077 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:18.867705 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-31d68d5a-cea3-4246-a9e5-d2ada2ac6077 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:18.927448 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-31d68d5a-cea3-4246-a9e5-d2ada2ac6077 admin admin] 10.222.0.118 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.2921503 Feb 08 18:21:18.930273 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45402) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:18.935070 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-2e36f195-a558-4906-98f4-195b5cb173d0 admin admin] Request body: {'subnet': {'network_id': 'def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-1676436270-subnet', 'tenant_id': '5a27073c24ea479ab55d00b3886a010e', 'ip_version': 4}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:21:18.948288 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31d68d5a-cea3-4246-a9e5-d2ada2ac6077 admin admin] Pushing event updated for resources: {'Network': ['ID=def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:18.958968 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Network def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13 details requested by agent ovs-agent-dv-cinder-773985-21-iscsi with host dv-cinder-773985-21-iscsi {{(pid=102561) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Feb 08 18:21:18.963523 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2e36f195-a558-4906-98f4-195b5cb173d0 admin admin] Made reservation on behalf of 5a27073c24ea479ab55d00b3886a010e for: {'subnet': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:21:18.966169 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-2e36f195-a558-4906-98f4-195b5cb173d0 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-63685351'] for subnet (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:19.142664 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-2e36f195-a558-4906-98f4-195b5cb173d0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-63856587', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-63685337'] for subnet (4e9b7aec-e75c-4d79-bd59-c1154c6f66b2), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:19.196383 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e36f195-a558-4906-98f4-195b5cb173d0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4e9b7aec-e75c-4d79-bd59-c1154c6f66b2,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:19.208234 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2e36f195-a558-4906-98f4-195b5cb173d0 admin admin] Checking segment: {'id': '0d63bc5b-3ce8-454e-8bc9-2f9a2d079796', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1058, 'network_id': 'def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102559) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:21:19.208603 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e36f195-a558-4906-98f4-195b5cb173d0 admin admin] Network hostable DHCP agents. Network: def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13, hostable agents: ['006b5388-ac7d-4794-a124-14bb8e5d8fec'], hosted agents: [] {{(pid=102559) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Feb 08 18:21:19.228043 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2e36f195-a558-4906-98f4-195b5cb173d0 admin admin] Network def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13 is scheduled to be hosted by DHCP agent 006b5388-ac7d-4794-a124-14bb8e5d8fec with binding_index 1 {{(pid=102559) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Feb 08 18:21:19.243361 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-2e36f195-a558-4906-98f4-195b5cb173d0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-773985-21-iscsi, def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13) {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:21:19.247889 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2e36f195-a558-4906-98f4-195b5cb173d0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:19.248486 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-2e36f195-a558-4906-98f4-195b5cb173d0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:19.254957 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8226d341-42e8-433c-a60f-0cc3d06bd642 None None] Network def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:21:19.264977 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-2e36f195-a558-4906-98f4-195b5cb173d0 admin admin] 10.222.0.118 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.3336439 Feb 08 18:21:19.267933 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45404) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:19.272340 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-970ea690-2a3f-4308-93c6-d2911b6c00a4 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-1676436270-router', 'tenant_id': '5a27073c24ea479ab55d00b3886a010e', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:21:19.292935 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-970ea690-2a3f-4308-93c6-d2911b6c00a4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-557369', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-6968'] for router (9af26cb5-3b1a-4b25-9d52-edaea753433a), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:19.294102 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-970ea690-2a3f-4308-93c6-d2911b6c00a4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-557389', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-560615', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-578936', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-6961'] for router (9af26cb5-3b1a-4b25-9d52-edaea753433a), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:19.346701 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-970ea690-2a3f-4308-93c6-d2911b6c00a4 admin admin] Publish callbacks [] for router_controller (9af26cb5-3b1a-4b25-9d52-edaea753433a), precommit_add_association {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:19.359123 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-729583fd-31af-4d7f-a427-d453fe49564a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp7dd4f88d-be07-54f7-888b-e9d2dcd2237c-def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13', 'network_id': 'def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13', 'project_id': '5a27073c24ea479ab55d00b3886a010e', 'fixed_ips': [{'subnet_id': '4e9b7aec-e75c-4d79-bd59-c1154c6f66b2'}]}} from dv-cinder-773985-21-iscsi. {{(pid=102561) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:268}} Feb 08 18:21:19.359973 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-729583fd-31af-4d7f-a427-d453fe49564a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:19.487041 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-970ea690-2a3f-4308-93c6-d2911b6c00a4 admin admin] Publish callbacks [] for router_gateway (9af26cb5-3b1a-4b25-9d52-edaea753433a), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:19.496350 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.db_base_plugin_common [None req-729583fd-31af-4d7f-a427-d453fe49564a None None] Allocated IP 172.20.0.2 (def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13/4e9b7aec-e75c-4d79-bd59-c1154c6f66b2/0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a) {{(pid=102561) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:21:19.647451 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-729583fd-31af-4d7f-a427-d453fe49564a None None] Publish callbacks [] for port (0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a), precommit_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:19.653362 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-729583fd-31af-4d7f-a427-d453fe49564a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433'] for port (0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a), after_create {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:19.701674 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-729583fd-31af-4d7f-a427-d453fe49564a None None] Network def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13 is already hosted by enough agents. {{(pid=102561) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:21:19.705765 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.scheduler.base_scheduler [None req-729583fd-31af-4d7f-a427-d453fe49564a None None] Resources bound (agent type, host, resource id): {{(pid=102561) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:21:19.707683 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-729583fd-31af-4d7f-a427-d453fe49564a None None] Pushing event updated for resources: {'Port': ['ID=0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a,revision_number=1']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:19.709823 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-729583fd-31af-4d7f-a427-d453fe49564a None None] Received port after_create {{(pid=102561) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:21:19.712664 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-970ea690-2a3f-4308-93c6-d2911b6c00a4 admin admin] Publish callbacks [] for router_gateway (9af26cb5-3b1a-4b25-9d52-edaea753433a), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:19.732375 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-970ea690-2a3f-4308-93c6-d2911b6c00a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:19.764837 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-729583fd-31af-4d7f-a427-d453fe49564a None None] Attempting to bind port 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:21:19.765211 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-729583fd-31af-4d7f-a427-d453fe49564a None None] Attempting to bind port 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': '0d63bc5b-3ce8-454e-8bc9-2f9a2d079796', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1058, 'network_id': 'def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13'}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:21:19.765571 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-729583fd-31af-4d7f-a427-d453fe49564a None None] Attempting to bind port 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a on network def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13 {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:21:19.771128 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-729583fd-31af-4d7f-a427-d453fe49564a None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 20, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:21:19.771514 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-729583fd-31af-4d7f-a427-d453fe49564a None None] Checking segment: {'id': '0d63bc5b-3ce8-454e-8bc9-2f9a2d079796', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1058, 'network_id': 'def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102561) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:21:19.771944 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-729583fd-31af-4d7f-a427-d453fe49564a None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:19.772335 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-729583fd-31af-4d7f-a427-d453fe49564a None None] Bound using segment: {'id': '0d63bc5b-3ce8-454e-8bc9-2f9a2d079796', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1058, 'network_id': 'def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13'} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:21:19.772805 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-729583fd-31af-4d7f-a427-d453fe49564a None None] Bound port: 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0d63bc5b-3ce8-454e-8bc9-2f9a2d079796', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1058, 'network_id': 'def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13'}}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:21:19.773280 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-729583fd-31af-4d7f-a427-d453fe49564a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:19.845569 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_common [None req-970ea690-2a3f-4308-93c6-d2911b6c00a4 admin admin] Allocated IP 172.27.1.119 (77055816-7c88-403d-8f8a-9be2c1faa10d/18547c52-7b23-42cd-bb53-214663ed102b/d387bf73-fc8b-4b08-959c-321d84fe4205) {{(pid=102560) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:21:19.860633 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-729583fd-31af-4d7f-a427-d453fe49564a None None] For port 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102561) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:21:19.865301 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-729583fd-31af-4d7f-a427-d453fe49564a None None] For port 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a,segment=NetworkSegment(0d63bc5b-3ce8-454e-8bc9-2f9a2d079796),segment_id=0d63bc5b-3ce8-454e-8bc9-2f9a2d079796)] {{(pid=102561) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:21:19.872755 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-729583fd-31af-4d7f-a427-d453fe49564a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:19.921905 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 227490ec-5281-4713-bf74-27f395237029 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:21:19.964827 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-970ea690-2a3f-4308-93c6-d2911b6c00a4 admin admin] Publish callbacks [] for port (d387bf73-fc8b-4b08-959c-321d84fe4205), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:19.979101 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-729583fd-31af-4d7f-a427-d453fe49564a None None] Pushing event updated for resources: {'Port': ['ID=0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a,revision_number=2']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:19.998008 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 227490ec-5281-4713-bf74-27f395237029 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:21:19.998008 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (227490ec-5281-4713-bf74-27f395237029), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:20.009305 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-970ea690-2a3f-4308-93c6-d2911b6c00a4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (d387bf73-fc8b-4b08-959c-321d84fe4205), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:20.037856 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] Sync routers for ids ['4840b53c-7786-4bda-8326-dd7d53cf4097'] in dv-cinder-773985-21-iscsi {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:21:20.049717 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] Routers {'4840b53c-7786-4bda-8326-dd7d53cf4097'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:21:20.050520 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:21:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['4840b53c-7786-4bda-8326-dd7d53cf4097'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:20.064210 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-970ea690-2a3f-4308-93c6-d2911b6c00a4 admin admin] Network 77055816-7c88-403d-8f8a-9be2c1faa10d is already hosted by enough agents. {{(pid=102560) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:21:20.069889 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.base_scheduler [None req-970ea690-2a3f-4308-93c6-d2911b6c00a4 admin admin] Resources bound (agent type, host, resource id): {{(pid=102560) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:21:20.073951 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [None req-970ea690-2a3f-4308-93c6-d2911b6c00a4 admin admin] Received port after_create {{(pid=102560) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:21:20.102023 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-970ea690-2a3f-4308-93c6-d2911b6c00a4 admin admin] Pushing event updated for resources: {'Port': ['ID=d387bf73-fc8b-4b08-959c-321d84fe4205,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:20.124033 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 227490ec-5281-4713-bf74-27f395237029 is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:21:20.124419 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (227490ec-5281-4713-bf74-27f395237029), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:20.167107 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:20.175142 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] For port 227490ec-5281-4713-bf74-27f395237029, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=227490ec-5281-4713-bf74-27f395237029,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:21:20.192742 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (227490ec-5281-4713-bf74-27f395237029), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:20.207741 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] Set router 4840b53c-7786-4bda-8326-dd7d53cf4097 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:21:20.261418 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Pushing event updated for resources: {'Port': ['ID=227490ec-5281-4713-bf74-27f395237029,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:20.382405 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-970ea690-2a3f-4308-93c6-d2911b6c00a4 admin admin] Publish callbacks [] for router_gateway (9af26cb5-3b1a-4b25-9d52-edaea753433a), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:20.438851 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'name': 'tempest-TestMinimumBasicScenario-1869431064-router', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '227490ec-5281-4713-bf74-27f395237029', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:14Z', 'updated_at': '2022-02-08T18:21:17Z', 'revision_number': 4, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'gw_port': {'id': '227490ec-5281-4713-bf74-27f395237029', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:89:6c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:15Z', 'updated_at': '2022-02-08T18:21:17Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2', 'name': '', 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'mac_address': 'fa:16:3e:ab:a4:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '96b794ac-bea5-4ac6-8b01-835f4cdef825', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:17Z', 'updated_at': '2022-02-08T18:21:17Z', 'revision_number': 2, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'subnets': [{'id': '96b794ac-bea5-4ac6-8b01-835f4cdef825', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:20.468147 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] Checking router: 4840b53c-7786-4bda-8326-dd7d53cf4097 for host: dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:21:20.468468 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] Updating router 4840b53c-7786-4bda-8326-dd7d53cf4097 port 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2 binding host dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Feb 08 18:21:20.495577 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2), before_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:20.583321 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-970ea690-2a3f-4308-93c6-d2911b6c00a4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-557494', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-560688'] for router (9af26cb5-3b1a-4b25-9d52-edaea753433a), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:20.719226 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-970ea690-2a3f-4308-93c6-d2911b6c00a4 admin admin] Router 9af26cb5-3b1a-4b25-9d52-edaea753433a is scheduled to L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 with binding_index 1 {{(pid=102560) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Feb 08 18:21:20.762943 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] Publish callbacks [] for port (23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2), precommit_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:20.768684 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2), after_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:20.818101 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ab3f403-3ef0-45f1-a9d9-3d09961412f4 None None] Pushing event updated for resources: {'Port': ['ID=23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2,revision_number=3']} {{(pid=102562) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:20.826575 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab3f403-3ef0-45f1-a9d9-3d09961412f4 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:20.827227 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab3f403-3ef0-45f1-a9d9-3d09961412f4 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:20.827741 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab3f403-3ef0-45f1-a9d9-3d09961412f4 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:20.828075 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab3f403-3ef0-45f1-a9d9-3d09961412f4 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:20.828553 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab3f403-3ef0-45f1-a9d9-3d09961412f4 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:20.829039 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab3f403-3ef0-45f1-a9d9-3d09961412f4 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:20.829513 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab3f403-3ef0-45f1-a9d9-3d09961412f4 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:20.829989 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab3f403-3ef0-45f1-a9d9-3d09961412f4 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:20.830475 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab3f403-3ef0-45f1-a9d9-3d09961412f4 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:20.830989 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab3f403-3ef0-45f1-a9d9-3d09961412f4 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:20.831460 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab3f403-3ef0-45f1-a9d9-3d09961412f4 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:20.831956 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab3f403-3ef0-45f1-a9d9-3d09961412f4 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:20.832278 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5ab3f403-3ef0-45f1-a9d9-3d09961412f4 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102562) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:21:20.844947 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-970ea690-2a3f-4308-93c6-d2911b6c00a4 admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:21:20.856054 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] Sync routers for ids ['9af26cb5-3b1a-4b25-9d52-edaea753433a'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:21:20.866846 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-970ea690-2a3f-4308-93c6-d2911b6c00a4 admin admin] Publish callbacks [] for router (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:20.870973 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-970ea690-2a3f-4308-93c6-d2911b6c00a4 admin admin] 10.222.0.118 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 1.5993025 Feb 08 18:21:20.871558 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45406) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:20.873867 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] Routers {'9af26cb5-3b1a-4b25-9d52-edaea753433a'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:21:20.875190 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:21:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['9af26cb5-3b1a-4b25-9d52-edaea753433a'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:20.916974 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] Attempting to bind port 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2 on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:21:20.917565 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] Attempting to bind port 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2 by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': 'd7f921a8-081c-445a-b287-4ebec76c43ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e'}] {{(pid=102562) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:21:20.918033 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] Attempting to bind port 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2 on network bfa2dbfe-1e79-44ee-9df4-62197aec047e {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:21:20.923848 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 20, 52), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:21:20.924399 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] Checking segment: {'id': 'd7f921a8-081c-445a-b287-4ebec76c43ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102562) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:21:20.925025 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:20.925519 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] Bound using segment: {'id': 'd7f921a8-081c-445a-b287-4ebec76c43ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e'} {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:21:20.931660 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] Bound port: 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd7f921a8-081c-445a-b287-4ebec76c43ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e'}}] {{(pid=102562) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:21:20.932204 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2), before_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:21.022392 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.db [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] For port 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102562) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:21:21.027864 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.db [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] For port 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2,segment=NetworkSegment(d7f921a8-081c-445a-b287-4ebec76c43ab),segment_id=d7f921a8-081c-445a-b287-4ebec76c43ab)] {{(pid=102562) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:21:21.041502 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2), after_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:21.106497 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5ab3f403-3ef0-45f1-a9d9-3d09961412f4 None None] Pushing event updated for resources: {'Port': ['ID=23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2,revision_number=4']} {{(pid=102562) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:21.120791 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] Routers {'4840b53c-7786-4bda-8326-dd7d53cf4097'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:21:21.121550 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:21:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['4840b53c-7786-4bda-8326-dd7d53cf4097'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:21.139637 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-83f5c850-9c07-4271-841e-2bc535851dee None None] Network def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:21:21.219206 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-fa5b3c8a-7225-4f53-9b23-a44fb992ac07 None None] Provisioning complete for port 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:21:21.219499 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-fa5b3c8a-7225-4f53-9b23-a44fb992ac07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:21.243833 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] Set router 4840b53c-7786-4bda-8326-dd7d53cf4097 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:21:21.290918 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] Set router 9af26cb5-3b1a-4b25-9d52-edaea753433a gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:21:21.420071 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-ef9566e9-9dae-458b-bfc0-dbb59bcfabc8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:21.470746 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'name': 'tempest-TestMinimumBasicScenario-1869431064-router', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '227490ec-5281-4713-bf74-27f395237029', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:14Z', 'updated_at': '2022-02-08T18:21:17Z', 'revision_number': 4, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'gw_port': {'id': '227490ec-5281-4713-bf74-27f395237029', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:89:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:15Z', 'updated_at': '2022-02-08T18:21:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2', 'name': '', 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'mac_address': 'fa:16:3e:ab:a4:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '96b794ac-bea5-4ac6-8b01-835f4cdef825', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:17Z', 'updated_at': '2022-02-08T18:21:21Z', 'revision_number': 4, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'subnets': [{'id': '96b794ac-bea5-4ac6-8b01-835f4cdef825', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:21.487907 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-fa5b3c8a-7225-4f53-9b23-a44fb992ac07 None None] Current status of the port 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:21:21.488298 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-fa5b3c8a-7225-4f53-9b23-a44fb992ac07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:21.503528 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-36789849-d0af-4ee0-ab7e-4a2d76985c91 None None] The sync data for ids ['4840b53c-7786-4bda-8326-dd7d53cf4097'] in dv-cinder-773985-21-iscsi is: [{'id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'name': 'tempest-TestMinimumBasicScenario-1869431064-router', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '227490ec-5281-4713-bf74-27f395237029', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:14Z', 'updated_at': '2022-02-08T18:21:17Z', 'revision_number': 4, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'gw_port': {'id': '227490ec-5281-4713-bf74-27f395237029', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:89:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:15Z', 'updated_at': '2022-02-08T18:21:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2', 'name': '', 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'mac_address': 'fa:16:3e:ab:a4:9e', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '96b794ac-bea5-4ac6-8b01-835f4cdef825', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:17Z', 'updated_at': '2022-02-08T18:21:21Z', 'revision_number': 4, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'subnets': [{'id': '96b794ac-bea5-4ac6-8b01-835f4cdef825', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:21:21.547904 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-fa5b3c8a-7225-4f53-9b23-a44fb992ac07 None None] For port 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a,segment=NetworkSegment(0d63bc5b-3ce8-454e-8bc9-2f9a2d079796),segment_id=0d63bc5b-3ce8-454e-8bc9-2f9a2d079796)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:21:21.554043 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-fa5b3c8a-7225-4f53-9b23-a44fb992ac07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:21.596107 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [None req-ef9566e9-9dae-458b-bfc0-dbb59bcfabc8 admin admin] Allocated IP 172.20.0.1 (def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13/4e9b7aec-e75c-4d79-bd59-c1154c6f66b2/771f4417-67cb-4a2b-a517-4e9b828487e2) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:21:21.611128 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9af26cb5-3b1a-4b25-9d52-edaea753433a', 'name': 'tempest-TestMinimumBasicScenario-1676436270-router', 'tenant_id': '5a27073c24ea479ab55d00b3886a010e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.119'}], 'enable_snat': True}, 'gw_port_id': 'd387bf73-fc8b-4b08-959c-321d84fe4205', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:19Z', 'updated_at': '2022-02-08T18:21:20Z', 'revision_number': 3, 'project_id': '5a27073c24ea479ab55d00b3886a010e', 'gw_port': {'id': 'd387bf73-fc8b-4b08-959c-321d84fe4205', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:36:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9af26cb5-3b1a-4b25-9d52-edaea753433a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:19Z', 'updated_at': '2022-02-08T18:21:19Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:21.614490 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa5b3c8a-7225-4f53-9b23-a44fb992ac07 None None] Pushing event updated for resources: {'Port': ['ID=0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a,revision_number=3']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:21.646841 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] Checking router: 9af26cb5-3b1a-4b25-9d52-edaea753433a for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:21:21.647222 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] Updating router 9af26cb5-3b1a-4b25-9d52-edaea753433a port d387bf73-fc8b-4b08-959c-321d84fe4205 binding host dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Feb 08 18:21:21.704872 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (d387bf73-fc8b-4b08-959c-321d84fe4205), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:21.709167 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:21.725058 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-ef9566e9-9dae-458b-bfc0-dbb59bcfabc8 admin admin] Publish callbacks [] for port (771f4417-67cb-4a2b-a517-4e9b828487e2), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:21.729363 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-00fb1533-d271-4b84-815c-1e7a52bd4057 None None] Provisioning complete for port 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:21:21.729732 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-00fb1533-d271-4b84-815c-1e7a52bd4057 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:21.766787 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-ef9566e9-9dae-458b-bfc0-dbb59bcfabc8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (771f4417-67cb-4a2b-a517-4e9b828487e2), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:21.809658 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ef9566e9-9dae-458b-bfc0-dbb59bcfabc8 admin admin] Network def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13 is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:21:21.812913 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-ef9566e9-9dae-458b-bfc0-dbb59bcfabc8 admin admin] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:21:21.816579 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ef9566e9-9dae-458b-bfc0-dbb59bcfabc8 admin admin] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:21:21.823015 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef9566e9-9dae-458b-bfc0-dbb59bcfabc8 admin admin] Pushing event updated for resources: {'Port': ['ID=771f4417-67cb-4a2b-a517-4e9b828487e2,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:21.861507 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-ef9566e9-9dae-458b-bfc0-dbb59bcfabc8 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-560871'] for router_interface (9af26cb5-3b1a-4b25-9d52-edaea753433a), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:21.946538 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-00fb1533-d271-4b84-815c-1e7a52bd4057 None None] Current status of the port 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2 is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:21:21.946978 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-00fb1533-d271-4b84-815c-1e7a52bd4057 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:22.032246 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-00fb1533-d271-4b84-815c-1e7a52bd4057 None None] For port 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2,segment=NetworkSegment(d7f921a8-081c-445a-b287-4ebec76c43ab),segment_id=d7f921a8-081c-445a-b287-4ebec76c43ab)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:21:22.048014 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-00fb1533-d271-4b84-815c-1e7a52bd4057 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:22.102384 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-ef9566e9-9dae-458b-bfc0-dbb59bcfabc8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (771f4417-67cb-4a2b-a517-4e9b828487e2), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:22.114652 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00fb1533-d271-4b84-815c-1e7a52bd4057 None None] Pushing event updated for resources: {'Port': ['ID=23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:22.166915 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:21:22.250715 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-f41358b4-a287-4e59-9fd2-480c0f7020ba None None] Provisioning complete for port 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:21:22.251133 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-f41358b4-a287-4e59-9fd2-480c0f7020ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:22.290162 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] Publish callbacks [] for port (d387bf73-fc8b-4b08-959c-321d84fe4205), precommit_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:22.305065 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (d387bf73-fc8b-4b08-959c-321d84fe4205), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:22.338539 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-ef9566e9-9dae-458b-bfc0-dbb59bcfabc8 admin admin] Publish callbacks [] for port (771f4417-67cb-4a2b-a517-4e9b828487e2), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:22.346671 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:21:22.347110 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:22.348907 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-ef9566e9-9dae-458b-bfc0-dbb59bcfabc8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-63856478'] for port (771f4417-67cb-4a2b-a517-4e9b828487e2), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:22.397591 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] Attempting to bind port d387bf73-fc8b-4b08-959c-321d84fe4205 on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:21:22.397966 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] Attempting to bind port d387bf73-fc8b-4b08-959c-321d84fe4205 by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:21:22.398840 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] Attempting to bind port d387bf73-fc8b-4b08-959c-321d84fe4205 on network 77055816-7c88-403d-8f8a-9be2c1faa10d {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:21:22.417078 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee4af675-55d3-4767-9ac7-fad85ed1f872 None None] Pushing event updated for resources: {'Port': ['ID=d387bf73-fc8b-4b08-959c-321d84fe4205,revision_number=2']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:22.420360 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 21, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:21:22.420795 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] Checking segment: {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102561) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:21:22.421134 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:22.421498 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] Bound using segment: {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'} {{(pid=102561) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:21:22.421990 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.managers [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] Bound port: d387bf73-fc8b-4b08-959c-321d84fe4205, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b82851d8-2dbc-41d4-9627-76824b5fc9cb', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d'}}] {{(pid=102561) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:21:22.422371 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (d387bf73-fc8b-4b08-959c-321d84fe4205), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:22.441764 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef9566e9-9dae-458b-bfc0-dbb59bcfabc8 admin admin] Pushing event updated for resources: {'Port': ['ID=771f4417-67cb-4a2b-a517-4e9b828487e2,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:22.447688 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-ef9566e9-9dae-458b-bfc0-dbb59bcfabc8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-631683', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-559991'] for router_interface (9af26cb5-3b1a-4b25-9d52-edaea753433a), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:22.501046 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-f41358b4-a287-4e59-9fd2-480c0f7020ba None None] Current status of the port 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:21:22.536723 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ef9566e9-9dae-458b-bfc0-dbb59bcfabc8 admin admin] Network def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13 is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:21:22.538174 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-ef9566e9-9dae-458b-bfc0-dbb59bcfabc8 admin admin] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:21:22.543927 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] For port d387bf73-fc8b-4b08-959c-321d84fe4205, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102561) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:21:22.548595 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] For port d387bf73-fc8b-4b08-959c-321d84fe4205, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=d387bf73-fc8b-4b08-959c-321d84fe4205,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102561) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:21:22.554284 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:21:22.555581 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 227490ec-5281-4713-bf74-27f395237029 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:21:22.577146 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (d387bf73-fc8b-4b08-959c-321d84fe4205), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:22.667160 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ef9566e9-9dae-458b-bfc0-dbb59bcfabc8 admin admin] Router 9af26cb5-3b1a-4b25-9d52-edaea753433a has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102559) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:21:22.673931 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] Routers {'9af26cb5-3b1a-4b25-9d52-edaea753433a'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:21:22.674440 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:21:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['9af26cb5-3b1a-4b25-9d52-edaea753433a'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:22.678320 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee4af675-55d3-4767-9ac7-fad85ed1f872 None None] Pushing event updated for resources: {'Port': ['ID=d387bf73-fc8b-4b08-959c-321d84fe4205,revision_number=3']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:22.715161 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-759135a4-9c21-4502-a111-f67e9f137b13 None None] Provisioning complete for port 771f4417-67cb-4a2b-a517-4e9b828487e2 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:21:22.715543 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-759135a4-9c21-4502-a111-f67e9f137b13 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (771f4417-67cb-4a2b-a517-4e9b828487e2), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:22.783355 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ef9566e9-9dae-458b-bfc0-dbb59bcfabc8 admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102559) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:21:22.788847 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-ef9566e9-9dae-458b-bfc0-dbb59bcfabc8 admin admin] 10.222.0.118 "PUT /v2.0/routers/9af26cb5-3b1a-4b25-9d52-edaea753433a/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9152098 Feb 08 18:21:22.796597 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 227490ec-5281-4713-bf74-27f395237029 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:21:22.796851 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (227490ec-5281-4713-bf74-27f395237029), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:22.829370 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-759135a4-9c21-4502-a111-f67e9f137b13 None None] Port 771f4417-67cb-4a2b-a517-4e9b828487e2 cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:21:22.855328 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] Set router 9af26cb5-3b1a-4b25-9d52-edaea753433a gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:21:23.104220 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2e44080c-d4cc-4543-983f-4b8e55050d08 None None] Provisioning complete for port 771f4417-67cb-4a2b-a517-4e9b828487e2 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:21:23.104637 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2e44080c-d4cc-4543-983f-4b8e55050d08 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (771f4417-67cb-4a2b-a517-4e9b828487e2), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:23.196164 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 227490ec-5281-4713-bf74-27f395237029 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:21:23.197279 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:21:23.200318 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2e44080c-d4cc-4543-983f-4b8e55050d08 None None] Port 771f4417-67cb-4a2b-a517-4e9b828487e2 cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:21:23.302219 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:21:23.302502 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:23.346539 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9af26cb5-3b1a-4b25-9d52-edaea753433a', 'name': 'tempest-TestMinimumBasicScenario-1676436270-router', 'tenant_id': '5a27073c24ea479ab55d00b3886a010e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.119'}], 'enable_snat': True}, 'gw_port_id': 'd387bf73-fc8b-4b08-959c-321d84fe4205', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:19Z', 'updated_at': '2022-02-08T18:21:22Z', 'revision_number': 4, 'project_id': '5a27073c24ea479ab55d00b3886a010e', 'gw_port': {'id': 'd387bf73-fc8b-4b08-959c-321d84fe4205', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:36:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9af26cb5-3b1a-4b25-9d52-edaea753433a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:19Z', 'updated_at': '2022-02-08T18:21:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '771f4417-67cb-4a2b-a517-4e9b828487e2', 'name': '', 'network_id': 'def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13', 'tenant_id': '5a27073c24ea479ab55d00b3886a010e', 'mac_address': 'fa:16:3e:a7:eb:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9af26cb5-3b1a-4b25-9d52-edaea753433a', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '4e9b7aec-e75c-4d79-bd59-c1154c6f66b2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:21Z', 'updated_at': '2022-02-08T18:21:22Z', 'revision_number': 2, 'project_id': '5a27073c24ea479ab55d00b3886a010e', 'subnets': [{'id': '4e9b7aec-e75c-4d79-bd59-c1154c6f66b2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:23.376908 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-34483514-17d3-42ac-a8ae-49e46af9ba64 None None] The sync data for ids ['9af26cb5-3b1a-4b25-9d52-edaea753433a'] in dv-cinder-773985-21-iscsi is: [{'id': '9af26cb5-3b1a-4b25-9d52-edaea753433a', 'name': 'tempest-TestMinimumBasicScenario-1676436270-router', 'tenant_id': '5a27073c24ea479ab55d00b3886a010e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.119'}], 'enable_snat': True}, 'gw_port_id': 'd387bf73-fc8b-4b08-959c-321d84fe4205', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:19Z', 'updated_at': '2022-02-08T18:21:22Z', 'revision_number': 4, 'project_id': '5a27073c24ea479ab55d00b3886a010e', 'gw_port': {'id': 'd387bf73-fc8b-4b08-959c-321d84fe4205', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:36:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9af26cb5-3b1a-4b25-9d52-edaea753433a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:19Z', 'updated_at': '2022-02-08T18:21:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '771f4417-67cb-4a2b-a517-4e9b828487e2', 'name': '', 'network_id': 'def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13', 'tenant_id': '5a27073c24ea479ab55d00b3886a010e', 'mac_address': 'fa:16:3e:a7:eb:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9af26cb5-3b1a-4b25-9d52-edaea753433a', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '4e9b7aec-e75c-4d79-bd59-c1154c6f66b2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:21Z', 'updated_at': '2022-02-08T18:21:22Z', 'revision_number': 2, 'project_id': '5a27073c24ea479ab55d00b3886a010e', 'subnets': [{'id': '4e9b7aec-e75c-4d79-bd59-c1154c6f66b2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:21:23.437847 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:21:23.920906 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:21:23.979427 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:21:23.979799 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:24.104513 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:21:25.393432 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45434) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:25.629931 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-0fa7abf2-72cd-46c3-873a-f2c051311b55 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Deleting port a3e62267-f1df-4632-b2cf-756e5f53e433 {{(pid=102559) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:21:25.630299 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0fa7abf2-72cd-46c3-873a-f2c051311b55 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (a3e62267-f1df-4632-b2cf-756e5f53e433), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:25.725862 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0fa7abf2-72cd-46c3-873a-f2c051311b55 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (a3e62267-f1df-4632-b2cf-756e5f53e433), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:25.726127 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0fa7abf2-72cd-46c3-873a-f2c051311b55 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for floatingip (a3e62267-f1df-4632-b2cf-756e5f53e433), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:25.740959 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-0fa7abf2-72cd-46c3-873a-f2c051311b55 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Calling delete_port for a3e62267-f1df-4632-b2cf-756e5f53e433 owned by network:floatingip {{(pid=102559) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:21:26.139613 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] Sync routers for ids ['9af26cb5-3b1a-4b25-9d52-edaea753433a'] in dv-cinder-773985-21-iscsi {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:21:26.153879 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] Routers {'9af26cb5-3b1a-4b25-9d52-edaea753433a'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:21:26.154842 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:21:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['9af26cb5-3b1a-4b25-9d52-edaea753433a'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:26.195552 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device d387bf73-fc8b-4b08-959c-321d84fe4205 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:21:26.291067 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port d387bf73-fc8b-4b08-959c-321d84fe4205 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:21:26.292803 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (d387bf73-fc8b-4b08-959c-321d84fe4205), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:26.298212 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] Set router 9af26cb5-3b1a-4b25-9d52-edaea753433a gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:21:26.336942 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0fa7abf2-72cd-46c3-873a-f2c051311b55 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (a3e62267-f1df-4632-b2cf-756e5f53e433), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:26.400004 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fa7abf2-72cd-46c3-873a-f2c051311b55 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Pushing event deleted for resources: {'Port': ['ID=a3e62267-f1df-4632-b2cf-756e5f53e433,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:26.432273 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port d387bf73-fc8b-4b08-959c-321d84fe4205 is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:21:26.433095 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (d387bf73-fc8b-4b08-959c-321d84fe4205), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:26.455224 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0fa7abf2-72cd-46c3-873a-f2c051311b55 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for floatingip (ae582062-974d-4f63-a11f-d5135353aa45), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:26.457922 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.db.l3_db [None req-0fa7abf2-72cd-46c3-873a-f2c051311b55 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Floating IP ae582062-974d-4f63-a11f-d5135353aa45 disassociated (deleted). External IP: 172.27.1.70, port: 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda. Feb 08 18:21:26.465628 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] For port d387bf73-fc8b-4b08-959c-321d84fe4205, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=d387bf73-fc8b-4b08-959c-321d84fe4205,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:21:26.479564 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (d387bf73-fc8b-4b08-959c-321d84fe4205), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:26.545168 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Pushing event updated for resources: {'Port': ['ID=d387bf73-fc8b-4b08-959c-321d84fe4205,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:26.631444 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9af26cb5-3b1a-4b25-9d52-edaea753433a', 'name': 'tempest-TestMinimumBasicScenario-1676436270-router', 'tenant_id': '5a27073c24ea479ab55d00b3886a010e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.119'}], 'enable_snat': True}, 'gw_port_id': 'd387bf73-fc8b-4b08-959c-321d84fe4205', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:19Z', 'updated_at': '2022-02-08T18:21:22Z', 'revision_number': 4, 'project_id': '5a27073c24ea479ab55d00b3886a010e', 'gw_port': {'id': 'd387bf73-fc8b-4b08-959c-321d84fe4205', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:36:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9af26cb5-3b1a-4b25-9d52-edaea753433a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:19Z', 'updated_at': '2022-02-08T18:21:22Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '771f4417-67cb-4a2b-a517-4e9b828487e2', 'name': '', 'network_id': 'def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13', 'tenant_id': '5a27073c24ea479ab55d00b3886a010e', 'mac_address': 'fa:16:3e:a7:eb:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9af26cb5-3b1a-4b25-9d52-edaea753433a', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '4e9b7aec-e75c-4d79-bd59-c1154c6f66b2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:21Z', 'updated_at': '2022-02-08T18:21:22Z', 'revision_number': 2, 'project_id': '5a27073c24ea479ab55d00b3886a010e', 'subnets': [{'id': '4e9b7aec-e75c-4d79-bd59-c1154c6f66b2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:26.660355 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] Checking router: 9af26cb5-3b1a-4b25-9d52-edaea753433a for host: dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:21:26.661009 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] Updating router 9af26cb5-3b1a-4b25-9d52-edaea753433a port 771f4417-67cb-4a2b-a517-4e9b828487e2 binding host dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Feb 08 18:21:26.696026 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (771f4417-67cb-4a2b-a517-4e9b828487e2), before_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:26.729561 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0fa7abf2-72cd-46c3-873a-f2c051311b55 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Router 72b4fd56-6775-4076-9195-fe85693f53aa has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102559) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:21:26.870412 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0fa7abf2-72cd-46c3-873a-f2c051311b55 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102559) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:21:26.875547 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-0fa7abf2-72cd-46c3-873a-f2c051311b55 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for floatingip (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:26.885333 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b10f1587-3474-49bf-b3a0-d9c702f90626 None None] Sync routers for ids ['72b4fd56-6775-4076-9195-fe85693f53aa'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:21:26.903983 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b10f1587-3474-49bf-b3a0-d9c702f90626 None None] Routers {'72b4fd56-6775-4076-9195-fe85693f53aa'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:21:26.904619 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-b10f1587-3474-49bf-b3a0-d9c702f90626 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:21:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['72b4fd56-6775-4076-9195-fe85693f53aa'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:26.923864 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-0fa7abf2-72cd-46c3-873a-f2c051311b55 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "DELETE /v2.0/floatingips/ae582062-974d-4f63-a11f-d5135353aa45 HTTP/1.1" status: 204 len: 168 time: 1.5288582 Feb 08 18:21:26.924150 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0ef1fd50-983d-4e00-af14-294faf1027a4', 'tag': '2901fd86-2fd5-4d64-a4c7-9a0ef0423bda'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:21:26.926652 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-080b57d8-1c23-4c00-ad6c-d866212ca781" -d '{"events": [{"name": "network-changed", "server_uuid": "0ef1fd50-983d-4e00-af14-294faf1027a4", "tag": "2901fd86-2fd5-4d64-a4c7-9a0ef0423bda"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:21:27.004470 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:21:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-de06082b-e62a-4654-8515-20319e8fdbd0 x-openstack-request-id: req-de06082b-e62a-4654-8515-20319e8fdbd0 {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:21:27.004748 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0ef1fd50-983d-4e00-af14-294faf1027a4", "tag": "2901fd86-2fd5-4d64-a4c7-9a0ef0423bda", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:21:27.005001 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-de06082b-e62a-4654-8515-20319e8fdbd0 {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:21:27.005410 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0ef1fd50-983d-4e00-af14-294faf1027a4', 'tag': '2901fd86-2fd5-4d64-a4c7-9a0ef0423bda', 'status': 'completed', 'code': 200} Feb 08 18:21:27.015728 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] Publish callbacks [] for port (771f4417-67cb-4a2b-a517-4e9b828487e2), precommit_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:27.025646 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (771f4417-67cb-4a2b-a517-4e9b828487e2), after_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:27.076273 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3555f2df-2000-4e7e-ac8b-04f2e3c54920 None None] Pushing event updated for resources: {'Port': ['ID=771f4417-67cb-4a2b-a517-4e9b828487e2,revision_number=3']} {{(pid=102562) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:27.090081 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-080b57d8-1c23-4c00-ad6c-d866212ca781 req-f3974694-0492-4c22-badb-9b528d2808c9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:27.092172 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-080b57d8-1c23-4c00-ad6c-d866212ca781 req-f3974694-0492-4c22-badb-9b528d2808c9 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=768f50510c57419e8a49ed0988014174&device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 1129 time: 0.0626905 Feb 08 18:21:27.120525 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-b10f1587-3474-49bf-b3a0-d9c702f90626 None None] Set router 72b4fd56-6775-4076-9195-fe85693f53aa gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:21:27.185418 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] Attempting to bind port 771f4417-67cb-4a2b-a517-4e9b828487e2 on host dv-cinder-773985-21-iscsi for vnic_type normal with profile {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:21:27.186005 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] Attempting to bind port 771f4417-67cb-4a2b-a517-4e9b828487e2 by drivers openvswitch,hyperv on host dv-cinder-773985-21-iscsi at level 0 using segments [{'id': '0d63bc5b-3ce8-454e-8bc9-2f9a2d079796', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1058, 'network_id': 'def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13'}] {{(pid=102562) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:21:27.186151 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] Attempting to bind port 771f4417-67cb-4a2b-a517-4e9b828487e2 on network def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13 {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:21:27.194426 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] Checking agent: {'id': '8e282338-d49c-44f3-a0d1-6b594748b4ab', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-773985-21-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 4, 22), 'started_at': datetime.datetime(2022, 2, 8, 18, 4, 52), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 21, 22), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-773985-21-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'LocalIPAssociation': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:21:27.194992 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] Checking segment: {'id': '0d63bc5b-3ce8-454e-8bc9-2f9a2d079796', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1058, 'network_id': 'def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102562) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:21:27.195291 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] Publish callbacks [] for ovs_bridge_name (None), before_read {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:27.195827 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] Bound using segment: {'id': '0d63bc5b-3ce8-454e-8bc9-2f9a2d079796', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1058, 'network_id': 'def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13'} {{(pid=102562) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:21:27.196318 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.managers [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] Bound port: 771f4417-67cb-4a2b-a517-4e9b828487e2, host: dv-cinder-773985-21-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0d63bc5b-3ce8-454e-8bc9-2f9a2d079796', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1058, 'network_id': 'def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13'}}] {{(pid=102562) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:21:27.196697 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (771f4417-67cb-4a2b-a517-4e9b828487e2), before_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:27.247611 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-080b57d8-1c23-4c00-ad6c-d866212ca781 req-d7268ecd-4b82-4817-8a08-9445c89bada7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:27.253212 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-080b57d8-1c23-4c00-ad6c-d866212ca781 req-d7268ecd-4b82-4817-8a08-9445c89bada7 service neutron] 10.222.0.109 "GET /v2.0/networks?id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 HTTP/1.1" status: 200 len: 913 time: 0.1515329 Feb 08 18:21:27.290034 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.db [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] For port 771f4417-67cb-4a2b-a517-4e9b828487e2, host dv-cinder-773985-21-iscsi, cleared binding levels {{(pid=102562) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:21:27.297077 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.plugins.ml2.db [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] For port 771f4417-67cb-4a2b-a517-4e9b828487e2, host dv-cinder-773985-21-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=771f4417-67cb-4a2b-a517-4e9b828487e2,segment=NetworkSegment(0d63bc5b-3ce8-454e-8bc9-2f9a2d079796),segment_id=0d63bc5b-3ce8-454e-8bc9-2f9a2d079796)] {{(pid=102562) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:21:27.316510 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron_lib.callbacks.manager [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (771f4417-67cb-4a2b-a517-4e9b828487e2), after_update {{(pid=102562) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:27.352587 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-080b57d8-1c23-4c00-ad6c-d866212ca781 req-4d320a56-396c-4055-a624-531bf08af7d1 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=2901fd86-2fd5-4d64-a4c7-9a0ef0423bda HTTP/1.1" status: 200 len: 217 time: 0.0935667 Feb 08 18:21:27.401672 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3555f2df-2000-4e7e-ac8b-04f2e3c54920 None None] Pushing event updated for resources: {'Port': ['ID=771f4417-67cb-4a2b-a517-4e9b828487e2,revision_number=4']} {{(pid=102562) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:27.425845 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] Routers {'9af26cb5-3b1a-4b25-9d52-edaea753433a'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:21:27.427013 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:21:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['9af26cb5-3b1a-4b25-9d52-edaea753433a'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:27.497044 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-080b57d8-1c23-4c00-ad6c-d866212ca781 req-e3770acf-bd8e-4b25-b3bf-260d74427169 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:27.498628 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-080b57d8-1c23-4c00-ad6c-d866212ca781 req-e3770acf-bd8e-4b25-b3bf-260d74427169 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=7b1e16de-d9af-4f50-86d7-ee22c9e14b1b HTTP/1.1" status: 200 len: 850 time: 0.1162553 Feb 08 18:21:27.501172 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-23afbe06-8be2-4252-b0fd-eb3888284636 None None] Provisioning complete for port 771f4417-67cb-4a2b-a517-4e9b828487e2 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:21:27.502049 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-23afbe06-8be2-4252-b0fd-eb3888284636 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (771f4417-67cb-4a2b-a517-4e9b828487e2), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:27.516131 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a598e52-666b-4266-9c0c-e053c036b527 req-173129c7-b894-4a31-8611-f720803be008 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:27.524418 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1a598e52-666b-4266-9c0c-e053c036b527 req-173129c7-b894-4a31-8611-f720803be008 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 945 time: 0.1901939 Feb 08 18:21:27.572666 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-b10f1587-3474-49bf-b3a0-d9c702f90626 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 4, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '8b5d25a6-20c1-4111-8cd4-527be842c81e', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'floating_ip_address': '172.27.1.78', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'port_id': '8f5b70dd-2b98-47c5-9288-4dabd9ca45e6', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 546, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'mac_address': 'fa:16:3e:61:f1:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b68b868-44af-459b-8cc4-7ec714415497', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:17:24Z', 'updated_at': '2022-02-08T18:17:26Z', 'revision_number': 1, 'project_id': '768f50510c57419e8a49ed0988014174', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '13fcfd03-fc49-4bba-8574-ec74e795e2bd', 'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'mac_address': 'fa:16:3e:4b:7b:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:44Z', 'updated_at': '2022-02-08T18:13:51Z', 'revision_number': 5, 'project_id': '768f50510c57419e8a49ed0988014174', 'subnets': [{'id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:27.587424 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] Set router 9af26cb5-3b1a-4b25-9d52-edaea753433a gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:21:27.611125 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b10f1587-3474-49bf-b3a0-d9c702f90626 None None] Checking router: 72b4fd56-6775-4076-9195-fe85693f53aa for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:21:27.624393 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b10f1587-3474-49bf-b3a0-d9c702f90626 None None] Routers {'72b4fd56-6775-4076-9195-fe85693f53aa'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:21:27.625820 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-b10f1587-3474-49bf-b3a0-d9c702f90626 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:21:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['72b4fd56-6775-4076-9195-fe85693f53aa'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:27.640334 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-1a598e52-666b-4266-9c0c-e053c036b527 req-670242e4-0cc6-4c70-a707-35b8278540bf tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1048665 Feb 08 18:21:27.650407 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-080b57d8-1c23-4c00-ad6c-d866212ca781 req-a41699c7-56e7-4827-b8b9-451c5ad427fc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:27.652043 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-080b57d8-1c23-4c00-ad6c-d866212ca781 req-a41699c7-56e7-4827-b8b9-451c5ad427fc service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.1265352 Feb 08 18:21:27.791459 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-23afbe06-8be2-4252-b0fd-eb3888284636 None None] Current status of the port 771f4417-67cb-4a2b-a517-4e9b828487e2 is: DOWN; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:21:27.792127 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-23afbe06-8be2-4252-b0fd-eb3888284636 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (771f4417-67cb-4a2b-a517-4e9b828487e2), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:27.858836 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-080b57d8-1c23-4c00-ad6c-d866212ca781 req-f57c73a6-7aea-4753-82b8-b7516f69fa35 service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1908638 Feb 08 18:21:27.861069 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-23afbe06-8be2-4252-b0fd-eb3888284636 None None] For port 771f4417-67cb-4a2b-a517-4e9b828487e2, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=771f4417-67cb-4a2b-a517-4e9b828487e2,segment=NetworkSegment(0d63bc5b-3ce8-454e-8bc9-2f9a2d079796),segment_id=0d63bc5b-3ce8-454e-8bc9-2f9a2d079796)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:21:27.873346 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-23afbe06-8be2-4252-b0fd-eb3888284636 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (771f4417-67cb-4a2b-a517-4e9b828487e2), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:27.920534 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-b10f1587-3474-49bf-b3a0-d9c702f90626 None None] Set router 72b4fd56-6775-4076-9195-fe85693f53aa gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:21:27.921178 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9af26cb5-3b1a-4b25-9d52-edaea753433a', 'name': 'tempest-TestMinimumBasicScenario-1676436270-router', 'tenant_id': '5a27073c24ea479ab55d00b3886a010e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.119'}], 'enable_snat': True}, 'gw_port_id': 'd387bf73-fc8b-4b08-959c-321d84fe4205', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:19Z', 'updated_at': '2022-02-08T18:21:22Z', 'revision_number': 4, 'project_id': '5a27073c24ea479ab55d00b3886a010e', 'gw_port': {'id': 'd387bf73-fc8b-4b08-959c-321d84fe4205', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:36:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9af26cb5-3b1a-4b25-9d52-edaea753433a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:19Z', 'updated_at': '2022-02-08T18:21:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '771f4417-67cb-4a2b-a517-4e9b828487e2', 'name': '', 'network_id': 'def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13', 'tenant_id': '5a27073c24ea479ab55d00b3886a010e', 'mac_address': 'fa:16:3e:a7:eb:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9af26cb5-3b1a-4b25-9d52-edaea753433a', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '4e9b7aec-e75c-4d79-bd59-c1154c6f66b2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:21Z', 'updated_at': '2022-02-08T18:21:27Z', 'revision_number': 4, 'project_id': '5a27073c24ea479ab55d00b3886a010e', 'subnets': [{'id': '4e9b7aec-e75c-4d79-bd59-c1154c6f66b2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:27.959809 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c18404f-41e4-411f-b3d9-6cda95c7273d None None] The sync data for ids ['9af26cb5-3b1a-4b25-9d52-edaea753433a'] in dv-cinder-773985-21-iscsi is: [{'id': '9af26cb5-3b1a-4b25-9d52-edaea753433a', 'name': 'tempest-TestMinimumBasicScenario-1676436270-router', 'tenant_id': '5a27073c24ea479ab55d00b3886a010e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.119'}], 'enable_snat': True}, 'gw_port_id': 'd387bf73-fc8b-4b08-959c-321d84fe4205', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:19Z', 'updated_at': '2022-02-08T18:21:22Z', 'revision_number': 4, 'project_id': '5a27073c24ea479ab55d00b3886a010e', 'gw_port': {'id': 'd387bf73-fc8b-4b08-959c-321d84fe4205', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:36:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9af26cb5-3b1a-4b25-9d52-edaea753433a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:19Z', 'updated_at': '2022-02-08T18:21:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '771f4417-67cb-4a2b-a517-4e9b828487e2', 'name': '', 'network_id': 'def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13', 'tenant_id': '5a27073c24ea479ab55d00b3886a010e', 'mac_address': 'fa:16:3e:a7:eb:a6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9af26cb5-3b1a-4b25-9d52-edaea753433a', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': '4e9b7aec-e75c-4d79-bd59-c1154c6f66b2', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:21Z', 'updated_at': '2022-02-08T18:21:27Z', 'revision_number': 4, 'project_id': '5a27073c24ea479ab55d00b3886a010e', 'subnets': [{'id': '4e9b7aec-e75c-4d79-bd59-c1154c6f66b2', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:21:28.021995 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23afbe06-8be2-4252-b0fd-eb3888284636 None None] Pushing event updated for resources: {'Port': ['ID=771f4417-67cb-4a2b-a517-4e9b828487e2,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:28.038668 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-080b57d8-1c23-4c00-ad6c-d866212ca781 req-a1d7c9e1-2c06-4cb7-8b0c-733d75bb01bc service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1723785 Feb 08 18:21:28.096136 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-0c0bdbc5-d84e-4e3b-9fc1-833c0930cac2 None None] Provisioning complete for port 771f4417-67cb-4a2b-a517-4e9b828487e2 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:21:28.096350 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-0c0bdbc5-d84e-4e3b-9fc1-833c0930cac2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (771f4417-67cb-4a2b-a517-4e9b828487e2), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:28.230207 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 771f4417-67cb-4a2b-a517-4e9b828487e2 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:21:28.491356 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-0c0bdbc5-d84e-4e3b-9fc1-833c0930cac2 None None] Current status of the port 771f4417-67cb-4a2b-a517-4e9b828487e2 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:21:28.511078 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port 771f4417-67cb-4a2b-a517-4e9b828487e2 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:21:28.511749 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (771f4417-67cb-4a2b-a517-4e9b828487e2), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:28.641030 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-b10f1587-3474-49bf-b3a0-d9c702f90626 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 4, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '8b5d25a6-20c1-4111-8cd4-527be842c81e', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'floating_ip_address': '172.27.1.78', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'port_id': '8f5b70dd-2b98-47c5-9288-4dabd9ca45e6', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 546, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'mac_address': 'fa:16:3e:61:f1:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b68b868-44af-459b-8cc4-7ec714415497', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:17:24Z', 'updated_at': '2022-02-08T18:17:26Z', 'revision_number': 1, 'project_id': '768f50510c57419e8a49ed0988014174', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '13fcfd03-fc49-4bba-8574-ec74e795e2bd', 'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'mac_address': 'fa:16:3e:4b:7b:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:44Z', 'updated_at': '2022-02-08T18:13:51Z', 'revision_number': 5, 'project_id': '768f50510c57419e8a49ed0988014174', 'subnets': [{'id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:28.694897 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b10f1587-3474-49bf-b3a0-d9c702f90626 None None] The sync data for ids ['72b4fd56-6775-4076-9195-fe85693f53aa'] in dv-cinder-773985-21-iscsi is: [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 4, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '8b5d25a6-20c1-4111-8cd4-527be842c81e', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'floating_ip_address': '172.27.1.78', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'port_id': '8f5b70dd-2b98-47c5-9288-4dabd9ca45e6', 'fixed_ip_address': '172.20.0.3', 'status': 'ACTIVE', 'standard_attr_id': 546, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'mac_address': 'fa:16:3e:61:f1:63', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7b68b868-44af-459b-8cc4-7ec714415497', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:17:24Z', 'updated_at': '2022-02-08T18:17:26Z', 'revision_number': 1, 'project_id': '768f50510c57419e8a49ed0988014174', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '13fcfd03-fc49-4bba-8574-ec74e795e2bd', 'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'mac_address': 'fa:16:3e:4b:7b:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:44Z', 'updated_at': '2022-02-08T18:13:51Z', 'revision_number': 5, 'project_id': '768f50510c57419e8a49ed0988014174', 'subnets': [{'id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:21:28.708755 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port 771f4417-67cb-4a2b-a517-4e9b828487e2 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:21:28.710407 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device d387bf73-fc8b-4b08-959c-321d84fe4205 up at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:21:28.763240 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Provisioning complete for port d387bf73-fc8b-4b08-959c-321d84fe4205 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:21:28.763728 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (d387bf73-fc8b-4b08-959c-321d84fe4205), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:28.808603 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9aff2e05-b1d3-4064-b6c2-be3cbd46f5db req-84221e2d-728f-475d-bcf2-55a83d2a12d9 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:28.811001 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-9aff2e05-b1d3-4064-b6c2-be3cbd46f5db req-84221e2d-728f-475d-bcf2-55a83d2a12d9 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 945 time: 0.0687623 Feb 08 18:21:28.875379 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Current status of the port d387bf73-fc8b-4b08-959c-321d84fe4205 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:21:28.895429 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-9aff2e05-b1d3-4064-b6c2-be3cbd46f5db req-196246db-2aab-4b6a-b56b-ba68571d7035 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0747745 Feb 08 18:21:29.560874 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a5a73c74-4f63-4e92-a3d6-7085bef68169 None None] New status for floating IP ae582062-974d-4f63-a11f-d5135353aa45: DOWN {{(pid=102562) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Feb 08 18:21:30.018985 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36cb3fff-17ed-45f9-a056-b1982e18ba9e req-e21566fa-3538-47de-bb96-6cfe82559230 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:30.020465 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-36cb3fff-17ed-45f9-a056-b1982e18ba9e req-e21566fa-3538-47de-bb96-6cfe82559230 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 945 time: 0.0609722 Feb 08 18:21:30.075573 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-36cb3fff-17ed-45f9-a056-b1982e18ba9e req-2558a485-9402-4525-a39f-012f31eca99e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0473766 Feb 08 18:21:31.205991 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a083806-7e24-4abf-af38-e7e6f0e90612 req-b0fe2f6a-88ad-4151-95c1-0d2f42dacbef tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:31.207558 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5a083806-7e24-4abf-af38-e7e6f0e90612 req-b0fe2f6a-88ad-4151-95c1-0d2f42dacbef tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 945 time: 0.0569839 Feb 08 18:21:31.273869 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5a083806-7e24-4abf-af38-e7e6f0e90612 req-68c1b2c4-08ba-43d6-9181-1946e1ed1df5 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0595248 Feb 08 18:21:31.459297 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:21:31.552379 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda is: ACTIVE; New status is: DOWN {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:21:31.552674 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (2901fd86-2fd5-4d64-a4c7-9a0ef0423bda), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:31.577506 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0ef1fd50-983d-4e00-af14-294faf1027a4', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2901fd86-2fd5-4d64-a4c7-9a0ef0423bda'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:21:31.581707 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5adaf47a-dd46-4f19-9107-6ae896ada547" -d '{"events": [{"server_uuid": "0ef1fd50-983d-4e00-af14-294faf1027a4", "name": "network-vif-unplugged", "status": "completed", "tag": "2901fd86-2fd5-4d64-a4c7-9a0ef0423bda"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:21:31.599796 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=2901fd86-2fd5-4d64-a4c7-9a0ef0423bda,segment=NetworkSegment(fc5ec9ee-df90-46f3-bddf-aef0221d9066),segment_id=fc5ec9ee-df90-46f3-bddf-aef0221d9066)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:21:31.610273 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (2901fd86-2fd5-4d64-a4c7-9a0ef0423bda), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:31.636582 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 08 Feb 2022 18:21:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-637f9710-376c-4f84-98cb-eec86b094079 x-openstack-request-id: req-637f9710-376c-4f84-98cb-eec86b094079 {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:21:31.636871 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0ef1fd50-983d-4e00-af14-294faf1027a4", "name": "network-vif-unplugged", "status": "completed", "tag": "2901fd86-2fd5-4d64-a4c7-9a0ef0423bda", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:21:31.637121 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-637f9710-376c-4f84-98cb-eec86b094079 {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:21:31.637510 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0ef1fd50-983d-4e00-af14-294faf1027a4', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '2901fd86-2fd5-4d64-a4c7-9a0ef0423bda', 'code': 200} Feb 08 18:21:31.667819 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=2901fd86-2fd5-4d64-a4c7-9a0ef0423bda,revision_number=6']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:32.415897 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6baf3150-5ce7-49d9-b6d9-e93a4ad3383e req-254abd7b-db62-4ccb-b9b0-110dbc1044ff tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:32.417561 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-6baf3150-5ce7-49d9-b6d9-e93a4ad3383e req-254abd7b-db62-4ccb-b9b0-110dbc1044ff tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 943 time: 0.0748241 Feb 08 18:21:32.488580 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-6baf3150-5ce7-49d9-b6d9-e93a4ad3383e req-bf2a8ee4-1ca8-4b82-b20f-34268e5a71a1 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0571034 Feb 08 18:21:33.558550 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-9ff69c10-3302-409e-a3a8-8dccfdeb7c03 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:33.560046 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-9ff69c10-3302-409e-a3a8-8dccfdeb7c03 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/networks?id=bfa2dbfe-1e79-44ee-9df4-62197aec047e HTTP/1.1" status: 200 len: 815 time: 0.1031215 Feb 08 18:21:33.574997 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-473846c9-aa18-43e1-9eac-d1be3a252571 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/quotas/a49c4d8ef7824a87af0bd566f0854d0a HTTP/1.1" status: 200 len: 375 time: 0.0092320 Feb 08 18:21:33.612859 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9092f3f7-beae-4aad-9881-b70b95485a1f req-c3efeb66-19de-413d-8dd9-ca76371d0b23 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:33.614425 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9092f3f7-beae-4aad-9881-b70b95485a1f req-c3efeb66-19de-413d-8dd9-ca76371d0b23 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 943 time: 0.0539112 Feb 08 18:21:33.666908 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-9092f3f7-beae-4aad-9881-b70b95485a1f req-dd77de55-3f9d-4f5f-ac2e-baa622c82f6f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465963 Feb 08 18:21:33.790050 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-514bf696-066e-41b5-bd28-33f6a5e73e1f req-ce83ec6a-96ae-4e6d-9584-de7902a45a3c tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:33.791960 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-514bf696-066e-41b5-bd28-33f6a5e73e1f req-ce83ec6a-96ae-4e6d-9584-de7902a45a3c tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.109 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 943 time: 0.0617139 Feb 08 18:21:33.886716 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-02f735f6-9344-48f9-b147-52ad59ca8942 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?tenant_id=a49c4d8ef7824a87af0bd566f0854d0a&fields=id HTTP/1.1" status: 200 len: 302 time: 0.3065169 Feb 08 18:21:33.888143 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [req-514bf696-066e-41b5-bd28-33f6a5e73e1f req-7b0bfada-0131-417b-8d50-0027b0fac2f2 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Deleting port 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda {{(pid=102559) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:21:33.888501 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-514bf696-066e-41b5-bd28-33f6a5e73e1f req-7b0bfada-0131-417b-8d50-0027b0fac2f2 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (2901fd86-2fd5-4d64-a4c7-9a0ef0423bda), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:33.978145 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-514bf696-066e-41b5-bd28-33f6a5e73e1f req-7b0bfada-0131-417b-8d50-0027b0fac2f2 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] For port 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=2901fd86-2fd5-4d64-a4c7-9a0ef0423bda,segment=NetworkSegment(fc5ec9ee-df90-46f3-bddf-aef0221d9066),segment_id=fc5ec9ee-df90-46f3-bddf-aef0221d9066)] {{(pid=102559) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:21:33.978457 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-8f5b24c9-bd40-4be1-b5e8-671594e6ff9f service neutron] 10.222.0.118 "GET /v2.0/networks/bfa2dbfe-1e79-44ee-9df4-62197aec047e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0801616 Feb 08 18:21:33.978709 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-514bf696-066e-41b5-bd28-33f6a5e73e1f req-7b0bfada-0131-417b-8d50-0027b0fac2f2 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (2901fd86-2fd5-4d64-a4c7-9a0ef0423bda), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:33.991764 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [req-514bf696-066e-41b5-bd28-33f6a5e73e1f req-7b0bfada-0131-417b-8d50-0027b0fac2f2 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Calling delete_port for 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda owned by compute:nova {{(pid=102559) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:21:34.073807 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-704b0322-93bc-48f5-93bc-e24c345b772e service neutron] 10.222.0.118 "GET /v2.0/networks/bfa2dbfe-1e79-44ee-9df4-62197aec047e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0895529 Feb 08 18:21:34.123056 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-514bf696-066e-41b5-bd28-33f6a5e73e1f req-7b0bfada-0131-417b-8d50-0027b0fac2f2 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (2901fd86-2fd5-4d64-a4c7-9a0ef0423bda), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:34.154697 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b0bfada-0131-417b-8d50-0027b0fac2f2 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Pushing event deleted for resources: {'Port': ['ID=2901fd86-2fd5-4d64-a4c7-9a0ef0423bda,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:34.199420 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [req-514bf696-066e-41b5-bd28-33f6a5e73e1f req-7b0bfada-0131-417b-8d50-0027b0fac2f2 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] No DVR routers for this DVR port 2901fd86-2fd5-4d64-a4c7-9a0ef0423bda on host hv-cinder-77398 {{(pid=102559) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:21:34.202260 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-514bf696-066e-41b5-bd28-33f6a5e73e1f req-7b0bfada-0131-417b-8d50-0027b0fac2f2 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:34.208034 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-514bf696-066e-41b5-bd28-33f6a5e73e1f req-7b0bfada-0131-417b-8d50-0027b0fac2f2 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.109 "DELETE /v2.0/ports/2901fd86-2fd5-4d64-a4c7-9a0ef0423bda HTTP/1.1" status: 204 len: 173 time: 0.4106951 Feb 08 18:21:34.208526 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0ef1fd50-983d-4e00-af14-294faf1027a4', 'name': 'network-vif-deleted', 'tag': '2901fd86-2fd5-4d64-a4c7-9a0ef0423bda'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:21:34.211077 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b000eccf-bd26-4e00-b995-43dec8980d66" -d '{"events": [{"server_uuid": "0ef1fd50-983d-4e00-af14-294faf1027a4", "name": "network-vif-deleted", "tag": "2901fd86-2fd5-4d64-a4c7-9a0ef0423bda"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:21:34.266743 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-4930e192-5583-48f0-ba1d-8462bdaeb4bc req-98800aa7-936b-4ae4-92f2-9114b79420ca tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 210 time: 0.0363626 Feb 08 18:21:34.268481 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:21:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c123b1f7-fc44-4d65-a0c2-94120278d5cc x-openstack-request-id: req-c123b1f7-fc44-4d65-a0c2-94120278d5cc {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:21:34.268847 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0ef1fd50-983d-4e00-af14-294faf1027a4", "name": "network-vif-deleted", "tag": "2901fd86-2fd5-4d64-a4c7-9a0ef0423bda", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:21:34.269145 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-c123b1f7-fc44-4d65-a0c2-94120278d5cc {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:21:34.269662 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0ef1fd50-983d-4e00-af14-294faf1027a4', 'name': 'network-vif-deleted', 'tag': '2901fd86-2fd5-4d64-a4c7-9a0ef0423bda', 'status': 'completed', 'code': 200} Feb 08 18:21:34.791604 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-48bd8bfe-3c97-4a95-8c6d-5ae0a83838c3 req-7182240c-1b49-44fd-ba17-b6464df5f080 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=0ef1fd50-983d-4e00-af14-294faf1027a4 HTTP/1.1" status: 200 len: 210 time: 0.0280442 Feb 08 18:21:35.285379 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-b11fd611-50fc-4632-a4a0-ed4688b3e621 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:35.287210 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-b11fd611-50fc-4632-a4a0-ed4688b3e621 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.109 "GET /v2.0/networks?id=bfa2dbfe-1e79-44ee-9df4-62197aec047e HTTP/1.1" status: 200 len: 815 time: 0.1174531 Feb 08 18:21:35.299509 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-306414ec-929d-4280-89ab-29d5a1e0d8e8 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Request body: {'port': {'device_id': 'd80c03fe-3e2c-4e43-acfd-5b5af96404cc', 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e', 'admin_state_up': True, 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:21:35.374918 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-47cc93b2-830f-4962-8cbc-b06f1903f980 req-2a91e7c0-064d-4b6b-a9c6-838a4fda1f4a tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 210 time: 0.0350771 Feb 08 18:21:35.436386 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-306414ec-929d-4280-89ab-29d5a1e0d8e8 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Made reservation on behalf of a49c4d8ef7824a87af0bd566f0854d0a for: {'port': 1} {{(pid=102559) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Feb 08 18:21:35.439875 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-306414ec-929d-4280-89ab-29d5a1e0d8e8 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:35.564182 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-306414ec-929d-4280-89ab-29d5a1e0d8e8 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Allocated IP 172.20.0.5 (bfa2dbfe-1e79-44ee-9df4-62197aec047e/96b794ac-bea5-4ac6-8b01-835f4cdef825/99a68581-a41f-466f-b6d4-fd8d25cc9536) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:21:35.760482 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-306414ec-929d-4280-89ab-29d5a1e0d8e8 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:35.802989 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-306414ec-929d-4280-89ab-29d5a1e0d8e8 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:35.861239 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-306414ec-929d-4280-89ab-29d5a1e0d8e8 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Network bfa2dbfe-1e79-44ee-9df4-62197aec047e is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:21:35.865539 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-306414ec-929d-4280-89ab-29d5a1e0d8e8 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:21:35.867882 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-306414ec-929d-4280-89ab-29d5a1e0d8e8 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Pushing event updated for resources: {'Port': ['ID=99a68581-a41f-466f-b6d4-fd8d25cc9536,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:35.876631 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-306414ec-929d-4280-89ab-29d5a1e0d8e8 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:21:35.948842 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-306414ec-929d-4280-89ab-29d5a1e0d8e8 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:35.949337 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-306414ec-929d-4280-89ab-29d5a1e0d8e8 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:35.983028 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-306414ec-929d-4280-89ab-29d5a1e0d8e8 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.109 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6875560 Feb 08 18:21:36.269565 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-1b889f51-817a-4f5b-a14c-8323d98c2a37 None None] Provisioning complete for port 99a68581-a41f-466f-b6d4-fd8d25cc9536 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:21:36.270223 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-1b889f51-817a-4f5b-a14c-8323d98c2a37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:36.309037 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-1b889f51-817a-4f5b-a14c-8323d98c2a37 None None] Port 99a68581-a41f-466f-b6d4-fd8d25cc9536 cannot update to ACTIVE because it is not bound. {{(pid=102561) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:343}} Feb 08 18:21:36.496968 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22bf11e4-a5e1-4100-afc6-e239d5c94f4c req-60d56576-a132-4373-ae33-07c38f593aec tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:36.498645 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-22bf11e4-a5e1-4100-afc6-e239d5c94f4c req-60d56576-a132-4373-ae33-07c38f593aec tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 931 time: 0.0556810 Feb 08 18:21:36.548278 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-22bf11e4-a5e1-4100-afc6-e239d5c94f4c req-c4c249b9-ce0b-4fdf-9a22-aca11584678c tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433779 Feb 08 18:21:37.668476 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c92401a7-edc6-47b6-a548-e57453e459e5 req-9d06bf1d-3d3e-48b3-9841-86287b3b1160 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:37.669956 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c92401a7-edc6-47b6-a548-e57453e459e5 req-9d06bf1d-3d3e-48b3-9841-86287b3b1160 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 931 time: 0.0532649 Feb 08 18:21:37.721119 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c92401a7-edc6-47b6-a548-e57453e459e5 req-a743a56b-9d6c-4bc1-9c57-9f9bc4b244ee tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451250 Feb 08 18:21:38.156409 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45546) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:38.323669 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-7b9c377d-ccbf-451e-bcd6-b56f192976e9 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Deleting port 177108d5-7af3-47a5-a94a-774e9e7cccb7 {{(pid=102559) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:21:38.324015 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7b9c377d-ccbf-451e-bcd6-b56f192976e9 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (177108d5-7af3-47a5-a94a-774e9e7cccb7), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:38.402625 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7b9c377d-ccbf-451e-bcd6-b56f192976e9 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (177108d5-7af3-47a5-a94a-774e9e7cccb7), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:38.402907 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7b9c377d-ccbf-451e-bcd6-b56f192976e9 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for floatingip (177108d5-7af3-47a5-a94a-774e9e7cccb7), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:38.415304 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-7b9c377d-ccbf-451e-bcd6-b56f192976e9 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Calling delete_port for 177108d5-7af3-47a5-a94a-774e9e7cccb7 owned by network:floatingip {{(pid=102559) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:21:38.620247 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7b9c377d-ccbf-451e-bcd6-b56f192976e9 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (177108d5-7af3-47a5-a94a-774e9e7cccb7), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:38.647181 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b9c377d-ccbf-451e-bcd6-b56f192976e9 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Pushing event deleted for resources: {'Port': ['ID=177108d5-7af3-47a5-a94a-774e9e7cccb7,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:38.710310 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7b9c377d-ccbf-451e-bcd6-b56f192976e9 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for floatingip (8b5d25a6-20c1-4111-8cd4-527be842c81e), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:38.710815 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.db.l3_db [None req-7b9c377d-ccbf-451e-bcd6-b56f192976e9 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Floating IP 8b5d25a6-20c1-4111-8cd4-527be842c81e disassociated (deleted). External IP: 172.27.1.78, port: 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6. Feb 08 18:21:38.942936 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d37797e2-9e99-4d0e-9ec7-605fa3fbb682 req-deca9c9d-8f59-48c6-9541-a43be9f57a71 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:38.944716 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d37797e2-9e99-4d0e-9ec7-605fa3fbb682 req-deca9c9d-8f59-48c6-9541-a43be9f57a71 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 931 time: 0.1305120 Feb 08 18:21:39.014097 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d37797e2-9e99-4d0e-9ec7-605fa3fbb682 req-8e30306d-b019-43a9-be95-7a1eb25665c8 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0633700 Feb 08 18:21:39.021838 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7b9c377d-ccbf-451e-bcd6-b56f192976e9 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Router 72b4fd56-6775-4076-9195-fe85693f53aa has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102559) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:21:39.159803 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7b9c377d-ccbf-451e-bcd6-b56f192976e9 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102559) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:21:39.165480 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7b9c377d-ccbf-451e-bcd6-b56f192976e9 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for floatingip (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:39.174638 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c83c3ad-ac02-4055-a662-08cdece3f30a None None] Sync routers for ids ['72b4fd56-6775-4076-9195-fe85693f53aa'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:21:39.186520 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c83c3ad-ac02-4055-a662-08cdece3f30a None None] Routers {'72b4fd56-6775-4076-9195-fe85693f53aa'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:21:39.187495 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-0c83c3ad-ac02-4055-a662-08cdece3f30a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:21:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['72b4fd56-6775-4076-9195-fe85693f53aa'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:39.201895 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-7b9c377d-ccbf-451e-bcd6-b56f192976e9 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "DELETE /v2.0/floatingips/8b5d25a6-20c1-4111-8cd4-527be842c81e HTTP/1.1" status: 204 len: 168 time: 1.0443447 Feb 08 18:21:39.202546 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7b68b868-44af-459b-8cc4-7ec714415497', 'tag': '8f5b70dd-2b98-47c5-9288-4dabd9ca45e6'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:21:39.204970 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f4af604d-0ba5-4ac1-8fd0-243979f4fb51" -d '{"events": [{"name": "network-changed", "server_uuid": "7b68b868-44af-459b-8cc4-7ec714415497", "tag": "8f5b70dd-2b98-47c5-9288-4dabd9ca45e6"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:21:39.265112 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:21:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d7c8e6b9-2a47-4f79-ab71-a4db58f9254f x-openstack-request-id: req-d7c8e6b9-2a47-4f79-ab71-a4db58f9254f {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:21:39.265382 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7b68b868-44af-459b-8cc4-7ec714415497", "tag": "8f5b70dd-2b98-47c5-9288-4dabd9ca45e6", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:21:39.265611 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-d7c8e6b9-2a47-4f79-ab71-a4db58f9254f {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:21:39.266016 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7b68b868-44af-459b-8cc4-7ec714415497', 'tag': '8f5b70dd-2b98-47c5-9288-4dabd9ca45e6', 'status': 'completed', 'code': 200} Feb 08 18:21:39.354363 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-0c83c3ad-ac02-4055-a662-08cdece3f30a None None] Set router 72b4fd56-6775-4076-9195-fe85693f53aa gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:21:39.509112 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e85859a-6086-478f-a65e-150ddcd7cfa0 req-b32a4330-9563-496e-bddf-c4b45a5996cd tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:39.510806 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8e85859a-6086-478f-a65e-150ddcd7cfa0 req-b32a4330-9563-496e-bddf-c4b45a5996cd tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 945 time: 0.0750425 Feb 08 18:21:39.595239 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-0c83c3ad-ac02-4055-a662-08cdece3f30a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 4, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '13fcfd03-fc49-4bba-8574-ec74e795e2bd', 'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'mac_address': 'fa:16:3e:4b:7b:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:44Z', 'updated_at': '2022-02-08T18:13:51Z', 'revision_number': 5, 'project_id': '768f50510c57419e8a49ed0988014174', 'subnets': [{'id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:39.600150 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8e85859a-6086-478f-a65e-150ddcd7cfa0 req-23895c46-c430-4e37-ab6d-7049ba942fdb tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0792644 Feb 08 18:21:39.633840 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c83c3ad-ac02-4055-a662-08cdece3f30a None None] Checking router: 72b4fd56-6775-4076-9195-fe85693f53aa for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:21:39.643274 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0c83c3ad-ac02-4055-a662-08cdece3f30a None None] Routers {'72b4fd56-6775-4076-9195-fe85693f53aa'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:21:39.643910 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-0c83c3ad-ac02-4055-a662-08cdece3f30a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:21:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['72b4fd56-6775-4076-9195-fe85693f53aa'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:39.762293 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-0c83c3ad-ac02-4055-a662-08cdece3f30a None None] Set router 72b4fd56-6775-4076-9195-fe85693f53aa gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:21:39.972866 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-0c83c3ad-ac02-4055-a662-08cdece3f30a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 4, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '13fcfd03-fc49-4bba-8574-ec74e795e2bd', 'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'mac_address': 'fa:16:3e:4b:7b:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:44Z', 'updated_at': '2022-02-08T18:13:51Z', 'revision_number': 5, 'project_id': '768f50510c57419e8a49ed0988014174', 'subnets': [{'id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:40.003938 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0c83c3ad-ac02-4055-a662-08cdece3f30a None None] The sync data for ids ['72b4fd56-6775-4076-9195-fe85693f53aa'] in dv-cinder-773985-21-iscsi is: [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:45Z', 'revision_number': 4, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '13fcfd03-fc49-4bba-8574-ec74e795e2bd', 'name': '', 'network_id': '2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'mac_address': 'fa:16:3e:4b:7b:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_interface', 'standard_attr_id': 375, 'fixed_ips': [{'subnet_id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:44Z', 'updated_at': '2022-02-08T18:13:51Z', 'revision_number': 5, 'project_id': '768f50510c57419e8a49ed0988014174', 'subnets': [{'id': '7b1e16de-d9af-4f50-86d7-ee22c9e14b1b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:21:40.168465 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17190e2a-2829-4628-ba6f-adfd9b25caf5 req-d0e0760a-efa5-4a2b-ab8b-a5e7119b08f3 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:40.170017 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-17190e2a-2829-4628-ba6f-adfd9b25caf5 req-d0e0760a-efa5-4a2b-ab8b-a5e7119b08f3 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 931 time: 0.0607708 Feb 08 18:21:40.226016 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-17190e2a-2829-4628-ba6f-adfd9b25caf5 req-2391a665-de2a-437f-bf58-039a478861d3 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501161 Feb 08 18:21:40.298095 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-23181cd3-b5c2-40f9-b6ac-c64cb76f7220 None None] New status for floating IP 8b5d25a6-20c1-4111-8cd4-527be842c81e: DOWN {{(pid=102562) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Feb 08 18:21:40.723207 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0f2ddb2-9b75-4bee-a3dc-de311aef10f4 req-6e3dd6b3-496c-4221-b125-6114dcc49cab tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:40.724767 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e0f2ddb2-9b75-4bee-a3dc-de311aef10f4 req-6e3dd6b3-496c-4221-b125-6114dcc49cab tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 945 time: 0.0545418 Feb 08 18:21:40.776405 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e0f2ddb2-9b75-4bee-a3dc-de311aef10f4 req-872c69b4-5b61-48b6-80c2-df32a8e78597 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458345 Feb 08 18:21:41.362446 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21247644-5bcb-4cd5-b5b5-f2a7d26e94b1 req-e9c53f99-4273-4517-852a-bfa410075a19 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:41.363902 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-21247644-5bcb-4cd5-b5b5-f2a7d26e94b1 req-e9c53f99-4273-4517-852a-bfa410075a19 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 931 time: 0.0531847 Feb 08 18:21:41.418964 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-21247644-5bcb-4cd5-b5b5-f2a7d26e94b1 req-efb9b76e-5860-4d50-87f4-df57b3056db5 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0428019 Feb 08 18:21:41.913261 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43900da8-1c33-4f37-9173-b13352c8023d req-0c974d3e-ad83-4188-acd0-a45cd6dcfd05 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:41.915233 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-43900da8-1c33-4f37-9173-b13352c8023d req-0c974d3e-ad83-4188-acd0-a45cd6dcfd05 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 945 time: 0.0688660 Feb 08 18:21:41.967009 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-43900da8-1c33-4f37-9173-b13352c8023d req-8c3cd355-160a-458e-81bb-68fafd7c5f35 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456185 Feb 08 18:21:42.548496 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8c184ad-b74e-471b-96d7-257783b1b93d req-061c30ae-cc6a-4bed-a5bb-97c68af8fecb tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:42.550078 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b8c184ad-b74e-471b-96d7-257783b1b93d req-061c30ae-cc6a-4bed-a5bb-97c68af8fecb tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 931 time: 0.0577328 Feb 08 18:21:42.602361 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b8c184ad-b74e-471b-96d7-257783b1b93d req-cc9d6d80-f6d7-415f-ad5c-d7334eacb2d2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459735 Feb 08 18:21:43.093363 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96d9e103-8edf-4bba-b491-9ecfc92287a5 req-5a71d590-2168-429d-814f-2a15e2a5351a tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:43.095062 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-96d9e103-8edf-4bba-b491-9ecfc92287a5 req-5a71d590-2168-429d-814f-2a15e2a5351a tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 945 time: 0.0567198 Feb 08 18:21:43.147109 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-96d9e103-8edf-4bba-b491-9ecfc92287a5 req-e72c2a42-a383-4e9f-8a76-296e971385c3 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459871 Feb 08 18:21:43.542056 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] Request body: {'port': {'device_id': 'd80c03fe-3e2c-4e43-acfd-5b5af96404cc', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-77398'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:21:43.599626 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4af604d-0ba5-4ac1-8fd0-243979f4fb51 req-50dff270-3898-4b7c-96d6-d6838ec5de71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:43.601333 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f4af604d-0ba5-4ac1-8fd0-243979f4fb51 req-50dff270-3898-4b7c-96d6-d6838ec5de71 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=768f50510c57419e8a49ed0988014174&device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 1129 time: 0.0509920 Feb 08 18:21:43.606021 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:43.728446 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4af604d-0ba5-4ac1-8fd0-243979f4fb51 req-54cff663-fb82-4125-9e9e-4ba431099510 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:43.729930 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f4af604d-0ba5-4ac1-8fd0-243979f4fb51 req-54cff663-fb82-4125-9e9e-4ba431099510 service neutron] 10.222.0.109 "GET /v2.0/networks?id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 HTTP/1.1" status: 200 len: 913 time: 0.1200347 Feb 08 18:21:43.782543 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f4af604d-0ba5-4ac1-8fd0-243979f4fb51 req-1299bc0b-9075-4147-9834-d14570d681ef service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 HTTP/1.1" status: 200 len: 217 time: 0.0452487 Feb 08 18:21:43.793747 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f23da338-98b4-4c8e-992f-d49c46a6c4ff req-5b3811bf-f600-4d52-808c-1db38f2ec2bb tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:43.795127 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f23da338-98b4-4c8e-992f-d49c46a6c4ff req-5b3811bf-f600-4d52-808c-1db38f2ec2bb tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 931 time: 0.1053798 Feb 08 18:21:43.862931 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4af604d-0ba5-4ac1-8fd0-243979f4fb51 req-202f9560-3819-4492-a111-6a8316b176d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:43.864427 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f4af604d-0ba5-4ac1-8fd0-243979f4fb51 req-202f9560-3819-4492-a111-6a8316b176d6 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=7b1e16de-d9af-4f50-86d7-ee22c9e14b1b HTTP/1.1" status: 200 len: 850 time: 0.0684388 Feb 08 18:21:43.891742 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 99a68581-a41f-466f-b6d4-fd8d25cc9536 {{(pid=102559) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:21:43.899782 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] Publish callbacks [] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:43.910158 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f23da338-98b4-4c8e-992f-d49c46a6c4ff req-7bad131d-5410-4258-a881-ebabf0b984e3 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1060774 Feb 08 18:21:43.919633 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.provisioning_blocks [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] Transition to ACTIVE for port object 99a68581-a41f-466f-b6d4-fd8d25cc9536 will not be triggered until provisioned by entity L2. {{(pid=102559) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Feb 08 18:21:43.923630 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4af604d-0ba5-4ac1-8fd0-243979f4fb51 req-6ea62054-5dc0-47ee-a228-868f9a8fb2b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:43.924775 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-63856478'] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:43.925121 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f4af604d-0ba5-4ac1-8fd0-243979f4fb51 req-6ea62054-5dc0-47ee-a228-868f9a8fb2b1 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0531070 Feb 08 18:21:43.997122 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] Pushing event updated for resources: {'Port': ['ID=99a68581-a41f-466f-b6d4-fd8d25cc9536,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:44.033556 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f4af604d-0ba5-4ac1-8fd0-243979f4fb51 req-fc15e8b8-4d7e-43a8-bfba-f46d8dc53ffe service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1012843 Feb 08 18:21:44.056364 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] Attempting to bind port 99a68581-a41f-466f-b6d4-fd8d25cc9536 on host hv-cinder-77398 for vnic_type normal with profile {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Feb 08 18:21:44.056655 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] Attempting to bind port 99a68581-a41f-466f-b6d4-fd8d25cc9536 by drivers openvswitch,hyperv on host hv-cinder-77398 at level 0 using segments [{'id': 'd7f921a8-081c-445a-b287-4ebec76c43ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e'}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Feb 08 18:21:44.056980 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] Attempting to bind port 99a68581-a41f-466f-b6d4-fd8d25cc9536 on network bfa2dbfe-1e79-44ee-9df4-62197aec047e {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:21:44.061854 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] Port 99a68581-a41f-466f-b6d4-fd8d25cc9536 on network bfa2dbfe-1e79-44ee-9df4-62197aec047e not bound, no agent of type Open vSwitch agent registered on host hv-cinder-77398 {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Feb 08 18:21:44.062187 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] Attempting to bind port 99a68581-a41f-466f-b6d4-fd8d25cc9536 on network bfa2dbfe-1e79-44ee-9df4-62197aec047e {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Feb 08 18:21:44.067581 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] Checking agent: {'id': '045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-77398', 'admin_state_up': True, 'created_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'started_at': datetime.datetime(2022, 2, 8, 18, 10, 18), 'heartbeat_timestamp': datetime.datetime(2022, 2, 8, 18, 21, 18), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Feb 08 18:21:44.067924 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] Checking segment: {'id': 'd7f921a8-081c-445a-b287-4ebec76c43ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102559) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:373}} Feb 08 18:21:44.068317 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] Bound using segment: {'id': 'd7f921a8-081c-445a-b287-4ebec76c43ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e'} {{(pid=102559) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Feb 08 18:21:44.068763 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.managers [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] Bound port: 99a68581-a41f-466f-b6d4-fd8d25cc9536, host: hv-cinder-77398, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd7f921a8-081c-445a-b287-4ebec76c43ab', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 1074, 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e'}}] {{(pid=102559) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Feb 08 18:21:44.069095 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:44.124823 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f4af604d-0ba5-4ac1-8fd0-243979f4fb51 req-b4b1b8a5-c458-4e0b-a18a-a74a18bb6fac service neutron] 10.222.0.109 "GET /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0838327 Feb 08 18:21:44.135766 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] For port 99a68581-a41f-466f-b6d4-fd8d25cc9536, host hv-cinder-77398, cleared binding levels {{(pid=102559) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Feb 08 18:21:44.139622 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] For port 99a68581-a41f-466f-b6d4-fd8d25cc9536, host hv-cinder-77398, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=99a68581-a41f-466f-b6d4-fd8d25cc9536,segment=NetworkSegment(d7f921a8-081c-445a-b287-4ebec76c43ab),segment_id=d7f921a8-081c-445a-b287-4ebec76c43ab)] {{(pid=102559) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Feb 08 18:21:44.145922 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-63856478'] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:44.184205 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:44.184779 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:44.186462 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] 10.222.0.109 "PUT /v2.0/ports/99a68581-a41f-466f-b6d4-fd8d25cc9536 HTTP/1.1" status: 200 len: 1093 time: 0.6519597 Feb 08 18:21:44.187019 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd80c03fe-3e2c-4e43-acfd-5b5af96404cc', 'tag': '99a68581-a41f-466f-b6d4-fd8d25cc9536'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:21:44.189356 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6a3184d0-3872-40c7-b30c-67b3efdd7508" -d '{"events": [{"name": "network-changed", "server_uuid": "d80c03fe-3e2c-4e43-acfd-5b5af96404cc", "tag": "99a68581-a41f-466f-b6d4-fd8d25cc9536"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:21:44.213409 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-665a17a4-5367-4e3d-b198-54e8d1d2ff95 service neutron] Pushing event updated for resources: {'Port': ['ID=99a68581-a41f-466f-b6d4-fd8d25cc9536,revision_number=3']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:44.250600 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:21:44 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9888a98f-649c-41b5-a890-707e32c9d404 x-openstack-request-id: req-9888a98f-649c-41b5-a890-707e32c9d404 {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:21:44.250983 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d80c03fe-3e2c-4e43-acfd-5b5af96404cc", "tag": "99a68581-a41f-466f-b6d4-fd8d25cc9536", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:21:44.251234 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-9888a98f-649c-41b5-a890-707e32c9d404 {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:21:44.251636 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd80c03fe-3e2c-4e43-acfd-5b5af96404cc', 'tag': '99a68581-a41f-466f-b6d4-fd8d25cc9536', 'status': 'completed', 'code': 200} Feb 08 18:21:44.315494 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91c99711-5dbf-412a-8f79-b944d1257344 req-797c46d7-ab32-491f-81d0-85121377fd81 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:44.316940 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-91c99711-5dbf-412a-8f79-b944d1257344 req-797c46d7-ab32-491f-81d0-85121377fd81 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 945 time: 0.0910752 Feb 08 18:21:44.318969 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-fecf5f52-3694-4dff-9b05-cb2d067ac75b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:44.320438 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-fecf5f52-3694-4dff-9b05-cb2d067ac75b service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=a49c4d8ef7824a87af0bd566f0854d0a&device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 1127 time: 0.0795138 Feb 08 18:21:44.375411 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-8ff19fe9-c35a-4c46-b045-0d1c4c6983bb service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=99a68581-a41f-466f-b6d4-fd8d25cc9536 HTTP/1.1" status: 200 len: 217 time: 0.0465786 Feb 08 18:21:44.427868 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-91c99711-5dbf-412a-8f79-b944d1257344 req-62fca85a-3166-4ebe-9163-633ebb161fc0 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1050153 Feb 08 18:21:44.441867 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-e1ff61b1-9458-4428-b714-d8b0d110dcde service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:44.443667 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-e1ff61b1-9458-4428-b714-d8b0d110dcde service neutron] 10.222.0.109 "GET /v2.0/subnets?id=96b794ac-bea5-4ac6-8b01-835f4cdef825 HTTP/1.1" status: 200 len: 854 time: 0.0605092 Feb 08 18:21:44.492034 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-5e85cee7-81ed-4def-8362-9a06746fb53f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:44.493594 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-5e85cee7-81ed-4def-8362-9a06746fb53f service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=bfa2dbfe-1e79-44ee-9df4-62197aec047e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0443211 Feb 08 18:21:44.845712 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-9336fce7-9b42-49a2-bde8-583dcca152e6 service neutron] 10.222.0.109 "GET /v2.0/networks/bfa2dbfe-1e79-44ee-9df4-62197aec047e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3459375 Feb 08 18:21:44.935619 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-c0c2f569-e3cc-43b1-92d3-8e7477e96a60 req-e987db48-aba5-4c62-a440-6451ec0da836 service neutron] 10.222.0.109 "GET /v2.0/networks/bfa2dbfe-1e79-44ee-9df4-62197aec047e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0828817 Feb 08 18:21:45.036049 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b0c1c71-95bc-4146-bd79-9f96b8f03af4 req-d057a1a1-874a-4619-81b7-9b655b00a302 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:45.036539 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a3184d0-3872-40c7-b30c-67b3efdd7508 req-f91d69b9-8365-41fe-a6f0-b0d1446bf365 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:45.037560 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1b0c1c71-95bc-4146-bd79-9f96b8f03af4 req-d057a1a1-874a-4619-81b7-9b655b00a302 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 943 time: 0.0526402 Feb 08 18:21:45.037996 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6a3184d0-3872-40c7-b30c-67b3efdd7508 req-f91d69b9-8365-41fe-a6f0-b0d1446bf365 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=a49c4d8ef7824a87af0bd566f0854d0a&device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 1127 time: 0.0455713 Feb 08 18:21:45.084230 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1b0c1c71-95bc-4146-bd79-9f96b8f03af4 req-7ee75c5d-46f5-40aa-b976-78ff5d351a13 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0404963 Feb 08 18:21:45.132275 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a3184d0-3872-40c7-b30c-67b3efdd7508 req-9dc13783-b8e2-4b38-bf5a-3d362087b67a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:45.134226 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6a3184d0-3872-40c7-b30c-67b3efdd7508 req-9dc13783-b8e2-4b38-bf5a-3d362087b67a service neutron] 10.222.0.109 "GET /v2.0/networks?id=bfa2dbfe-1e79-44ee-9df4-62197aec047e HTTP/1.1" status: 200 len: 917 time: 0.0886676 Feb 08 18:21:45.177756 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6a3184d0-3872-40c7-b30c-67b3efdd7508 req-5e2ad3bf-68f4-48ba-878d-2617f6f6dae6 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=99a68581-a41f-466f-b6d4-fd8d25cc9536 HTTP/1.1" status: 200 len: 217 time: 0.0374155 Feb 08 18:21:45.178698 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53e8d4e2-f9fc-4880-80d8-aadff0814839 req-1aa39b84-0ffe-42bc-8631-75ab36fcc4f5 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:45.180271 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-53e8d4e2-f9fc-4880-80d8-aadff0814839 req-1aa39b84-0ffe-42bc-8631-75ab36fcc4f5 tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.109 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 945 time: 0.0565205 Feb 08 18:21:45.234067 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a3184d0-3872-40c7-b30c-67b3efdd7508 req-66678e71-2b81-4026-952b-e1dcca6429ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:45.235563 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6a3184d0-3872-40c7-b30c-67b3efdd7508 req-66678e71-2b81-4026-952b-e1dcca6429ec service neutron] 10.222.0.109 "GET /v2.0/subnets?id=96b794ac-bea5-4ac6-8b01-835f4cdef825 HTTP/1.1" status: 200 len: 854 time: 0.0482512 Feb 08 18:21:45.285312 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-53e8d4e2-f9fc-4880-80d8-aadff0814839 req-acff858d-3bdf-4415-b190-d4680d68111e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Deleting port 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:21:45.285649 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-53e8d4e2-f9fc-4880-80d8-aadff0814839 req-acff858d-3bdf-4415-b190-d4680d68111e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (8f5b70dd-2b98-47c5-9288-4dabd9ca45e6), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:45.296811 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a3184d0-3872-40c7-b30c-67b3efdd7508 req-fcc5087e-4ac3-49f7-b6d9-b37b22872a71 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:45.298362 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6a3184d0-3872-40c7-b30c-67b3efdd7508 req-fcc5087e-4ac3-49f7-b6d9-b37b22872a71 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=bfa2dbfe-1e79-44ee-9df4-62197aec047e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0558023 Feb 08 18:21:45.379955 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-fae2abb5-158b-482f-b306-967eb587334e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:45.385896 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-53e8d4e2-f9fc-4880-80d8-aadff0814839 req-acff858d-3bdf-4415-b190-d4680d68111e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] For port 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=8f5b70dd-2b98-47c5-9288-4dabd9ca45e6,segment=NetworkSegment(fc5ec9ee-df90-46f3-bddf-aef0221d9066),segment_id=fc5ec9ee-df90-46f3-bddf-aef0221d9066)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:21:45.386259 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-53e8d4e2-f9fc-4880-80d8-aadff0814839 req-acff858d-3bdf-4415-b190-d4680d68111e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (8f5b70dd-2b98-47c5-9288-4dabd9ca45e6), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:45.390716 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6a3184d0-3872-40c7-b30c-67b3efdd7508 req-de0417f3-7897-4d48-8d4f-5901edf0263d service neutron] 10.222.0.109 "GET /v2.0/networks/bfa2dbfe-1e79-44ee-9df4-62197aec047e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0849395 Feb 08 18:21:45.399052 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-53e8d4e2-f9fc-4880-80d8-aadff0814839 req-acff858d-3bdf-4415-b190-d4680d68111e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Calling delete_port for 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 owned by compute:nova {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:21:45.487399 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6a3184d0-3872-40c7-b30c-67b3efdd7508 req-39b1d9b4-1088-47d1-96f4-be1a5ade1c80 service neutron] 10.222.0.109 "GET /v2.0/networks/bfa2dbfe-1e79-44ee-9df4-62197aec047e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0905201 Feb 08 18:21:45.531144 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-53e8d4e2-f9fc-4880-80d8-aadff0814839 req-acff858d-3bdf-4415-b190-d4680d68111e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (8f5b70dd-2b98-47c5-9288-4dabd9ca45e6), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:45.557108 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99fbaf5e-d07e-471f-bf78-aadf9c27a93b req-7c17cb79-d13e-4e19-a80b-717a5c49864e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:45.558830 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-99fbaf5e-d07e-471f-bf78-aadf9c27a93b req-7c17cb79-d13e-4e19-a80b-717a5c49864e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/ports?device_id=7b68b868-44af-459b-8cc4-7ec714415497 HTTP/1.1" status: 200 len: 867 time: 0.0552542 Feb 08 18:21:45.558963 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acff858d-3bdf-4415-b190-d4680d68111e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Pushing event deleted for resources: {'Port': ['ID=8f5b70dd-2b98-47c5-9288-4dabd9ca45e6,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:45.605786 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [req-53e8d4e2-f9fc-4880-80d8-aadff0814839 req-acff858d-3bdf-4415-b190-d4680d68111e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] No DVR routers for this DVR port 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 on host hv-cinder-77398 {{(pid=102560) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:21:45.608413 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-53e8d4e2-f9fc-4880-80d8-aadff0814839 req-acff858d-3bdf-4415-b190-d4680d68111e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:45.611800 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-53e8d4e2-f9fc-4880-80d8-aadff0814839 req-acff858d-3bdf-4415-b190-d4680d68111e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.109 "DELETE /v2.0/ports/8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 HTTP/1.1" status: 204 len: 173 time: 0.4240108 Feb 08 18:21:45.612230 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7b68b868-44af-459b-8cc4-7ec714415497', 'name': 'network-vif-deleted', 'tag': '8f5b70dd-2b98-47c5-9288-4dabd9ca45e6'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:21:45.615986 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aa4ab0f9-54b8-4b23-9dcc-8d8b5b7d647b" -d '{"events": [{"server_uuid": "7b68b868-44af-459b-8cc4-7ec714415497", "name": "network-vif-deleted", "tag": "8f5b70dd-2b98-47c5-9288-4dabd9ca45e6"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:21:45.617055 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-99fbaf5e-d07e-471f-bf78-aadf9c27a93b req-63340b10-6b5f-4c49-8026-273276c94e5f tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "GET /v2.0/security-groups?id=2d4a2503-75cd-4739-b472-f29476744b67&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0521848 Feb 08 18:21:45.656355 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:21:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-12efcaff-f29f-4902-90bc-20d142b73b89 x-openstack-request-id: req-12efcaff-f29f-4902-90bc-20d142b73b89 {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:21:45.656753 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7b68b868-44af-459b-8cc4-7ec714415497", "name": "network-vif-deleted", "tag": "8f5b70dd-2b98-47c5-9288-4dabd9ca45e6", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:21:45.657089 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-12efcaff-f29f-4902-90bc-20d142b73b89 {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:21:45.657672 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7b68b868-44af-459b-8cc4-7ec714415497', 'name': 'network-vif-deleted', 'tag': '8f5b70dd-2b98-47c5-9288-4dabd9ca45e6', 'status': 'completed', 'code': 200} Feb 08 18:21:46.217158 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f24c1b0-9741-4708-8400-3c947d29799c req-1854f92d-be65-4d14-a97c-0f3ea7bcb4e5 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:46.219416 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5f24c1b0-9741-4708-8400-3c947d29799c req-1854f92d-be65-4d14-a97c-0f3ea7bcb4e5 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 943 time: 0.0619903 Feb 08 18:21:46.268539 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5f24c1b0-9741-4708-8400-3c947d29799c req-69d2fc65-4f6c-4a58-b657-cf68678a7560 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439539 Feb 08 18:21:46.695312 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45590) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:46.820524 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-96c81ffc-ac25-4dea-962a-0ed68f80133e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Deleting port f67d5f70-99da-48d9-9034-aeeb1285d87d {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:21:46.820819 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-96c81ffc-ac25-4dea-962a-0ed68f80133e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (f67d5f70-99da-48d9-9034-aeeb1285d87d), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:46.908412 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-96c81ffc-ac25-4dea-962a-0ed68f80133e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (f67d5f70-99da-48d9-9034-aeeb1285d87d), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:46.908661 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-96c81ffc-ac25-4dea-962a-0ed68f80133e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for floatingip (f67d5f70-99da-48d9-9034-aeeb1285d87d), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:46.923940 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-96c81ffc-ac25-4dea-962a-0ed68f80133e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Calling delete_port for f67d5f70-99da-48d9-9034-aeeb1285d87d owned by network:floatingip {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:21:47.060745 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-96c81ffc-ac25-4dea-962a-0ed68f80133e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (f67d5f70-99da-48d9-9034-aeeb1285d87d), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:47.089274 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96c81ffc-ac25-4dea-962a-0ed68f80133e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Pushing event deleted for resources: {'Port': ['ID=f67d5f70-99da-48d9-9034-aeeb1285d87d,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:47.152108 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-96c81ffc-ac25-4dea-962a-0ed68f80133e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for floatingip (00651317-6b63-457e-ae80-8fd5622d070a), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:47.154675 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-96c81ffc-ac25-4dea-962a-0ed68f80133e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for floatingip (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:47.155877 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-96c81ffc-ac25-4dea-962a-0ed68f80133e tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "DELETE /v2.0/floatingips/00651317-6b63-457e-ae80-8fd5622d070a HTTP/1.1" status: 204 len: 168 time: 0.4595733 Feb 08 18:21:47.393270 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6475dbd-d447-4786-a630-90c0ea98e0f1 req-01b945ec-0fcb-4ed8-87e3-51ac7d38e22b tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:47.395355 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b6475dbd-d447-4786-a630-90c0ea98e0f1 req-01b945ec-0fcb-4ed8-87e3-51ac7d38e22b tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 943 time: 0.0586424 Feb 08 18:21:47.447110 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-b6475dbd-d447-4786-a630-90c0ea98e0f1 req-2dd82543-a4ff-4643-8ed7-49cd1eea549b tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0446291 Feb 08 18:21:47.511176 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 99a68581-a41f-466f-b6d4-fd8d25cc9536 details requested by agent hyperv_hv-cinder-77398 with host hv-cinder-77398 {{(pid=102561) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Feb 08 18:21:47.608298 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 99a68581-a41f-466f-b6d4-fd8d25cc9536, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=99a68581-a41f-466f-b6d4-fd8d25cc9536,segment=NetworkSegment(d7f921a8-081c-445a-b287-4ebec76c43ab),segment_id=d7f921a8-081c-445a-b287-4ebec76c43ab)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:21:47.619703 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Returning: {'device': '99a68581-a41f-466f-b6d4-fd8d25cc9536', 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e', 'port_id': '99a68581-a41f-466f-b6d4-fd8d25cc9536', 'mac_address': 'fa:16:3e:ef:3b:b6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 1074, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '96b794ac-bea5-4ac6-8b01-835f4cdef825', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102561) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Feb 08 18:21:47.657993 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 99a68581-a41f-466f-b6d4-fd8d25cc9536 is: DOWN; New status is: BUILD {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:21:47.658401 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:47.671460 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 99a68581-a41f-466f-b6d4-fd8d25cc9536 {{(pid=102561) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:233}} Feb 08 18:21:47.690351 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 99a68581-a41f-466f-b6d4-fd8d25cc9536, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=99a68581-a41f-466f-b6d4-fd8d25cc9536,segment=NetworkSegment(d7f921a8-081c-445a-b287-4ebec76c43ab),segment_id=d7f921a8-081c-445a-b287-4ebec76c43ab)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:21:47.697254 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:47.745008 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=99a68581-a41f-466f-b6d4-fd8d25cc9536,revision_number=4']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:47.826692 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2ce55b80-7f1a-461a-93e7-8afa6e5e2472 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:47.932731 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['99a68581-a41f-466f-b6d4-fd8d25cc9536'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:21:48.089740 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:48.371399 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45604) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:48.428333 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8a8cf429-0118-4448-ac34-be7e5789130a tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group (2d4a2503-75cd-4739-b472-f29476744b67), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:48.457783 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8a8cf429-0118-4448-ac34-be7e5789130a tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group (2d4a2503-75cd-4739-b472-f29476744b67), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:48.525416 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:48.555911 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8a8cf429-0118-4448-ac34-be7e5789130a tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (2d4a2503-75cd-4739-b472-f29476744b67), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:48.558648 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8a8cf429-0118-4448-ac34-be7e5789130a tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:48.559991 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-8a8cf429-0118-4448-ac34-be7e5789130a tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] 10.222.0.118 "DELETE /v2.0/security-groups/2d4a2503-75cd-4739-b472-f29476744b67 HTTP/1.1" status: 204 len: 168 time: 0.1876352 Feb 08 18:21:48.572374 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8a8cf429-0118-4448-ac34-be7e5789130a tempest-TestVolumeBootPattern-101145490 tempest-TestVolumeBootPattern-101145490-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=2d4a2503-75cd-4739-b472-f29476744b67,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:48.585209 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03cd5df0-b06b-4204-8755-07de29b67391 req-3b412c46-b324-4327-a42b-b2eebe4cc462 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:48.593732 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-03cd5df0-b06b-4204-8755-07de29b67391 req-3b412c46-b324-4327-a42b-b2eebe4cc462 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 944 time: 0.0761828 Feb 08 18:21:48.615676 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45610) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:48.636578 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-03cd5df0-b06b-4204-8755-07de29b67391 req-40f10e3a-bcd0-48aa-8447-e5d673d03d33 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434017 Feb 08 18:21:49.180467 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7ef05d15-3815-4c28-9bf5-5b48638f0c48 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-559978'] for router_interface (72b4fd56-6775-4076-9195-fe85693f53aa), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:49.485857 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-7ef05d15-3815-4c28-9bf5-5b48638f0c48 admin admin] Deleting port 13fcfd03-fc49-4bba-8574-ec74e795e2bd {{(pid=102559) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:21:49.486172 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7ef05d15-3815-4c28-9bf5-5b48638f0c48 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (13fcfd03-fc49-4bba-8574-ec74e795e2bd), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:49.520838 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 99a68581-a41f-466f-b6d4-fd8d25cc9536 up at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Feb 08 18:21:49.562404 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [None req-7ef05d15-3815-4c28-9bf5-5b48638f0c48 admin admin] For port 13fcfd03-fc49-4bba-8574-ec74e795e2bd, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=13fcfd03-fc49-4bba-8574-ec74e795e2bd,segment=NetworkSegment(fc5ec9ee-df90-46f3-bddf-aef0221d9066),segment_id=fc5ec9ee-df90-46f3-bddf-aef0221d9066)] {{(pid=102559) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:21:49.562748 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7ef05d15-3815-4c28-9bf5-5b48638f0c48 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (13fcfd03-fc49-4bba-8574-ec74e795e2bd), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:49.572762 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning for port 99a68581-a41f-466f-b6d4-fd8d25cc9536 completed by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Feb 08 18:21:49.576788 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Provisioning complete for port 99a68581-a41f-466f-b6d4-fd8d25cc9536 triggered by entity L2. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:21:49.577159 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:49.581813 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-7ef05d15-3815-4c28-9bf5-5b48638f0c48 admin admin] Calling delete_port for 13fcfd03-fc49-4bba-8574-ec74e795e2bd owned by network:router_interface {{(pid=102559) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:21:49.656413 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Current status of the port 99a68581-a41f-466f-b6d4-fd8d25cc9536 is: BUILD; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:21:49.656799 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), before_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:49.680557 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd80c03fe-3e2c-4e43-acfd-5b5af96404cc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '99a68581-a41f-466f-b6d4-fd8d25cc9536'}] {{(pid=102561) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:21:49.682882 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f8faf55814e58096badb8c2a68752f32ee08598612bd814326947a1d1617de04" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cfe21d7d-c6a3-42f8-a057-a404daa4aae7" -d '{"events": [{"server_uuid": "d80c03fe-3e2c-4e43-acfd-5b5af96404cc", "name": "network-vif-plugged", "status": "completed", "tag": "99a68581-a41f-466f-b6d4-fd8d25cc9536"}]}' {{(pid=102561) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:21:49.695314 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] For port 99a68581-a41f-466f-b6d4-fd8d25cc9536, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=99a68581-a41f-466f-b6d4-fd8d25cc9536,segment=NetworkSegment(d7f921a8-081c-445a-b287-4ebec76c43ab),segment_id=d7f921a8-081c-445a-b287-4ebec76c43ab)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:21:49.700792 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469'] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:49.701179 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:21:49.738882 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:21:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f4f3793f-6042-451e-8e49-26ac5fcb22d4 x-openstack-request-id: req-f4f3793f-6042-451e-8e49-26ac5fcb22d4 {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:21:49.739171 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d80c03fe-3e2c-4e43-acfd-5b5af96404cc", "name": "network-vif-plugged", "status": "completed", "tag": "99a68581-a41f-466f-b6d4-fd8d25cc9536", "code": 200}]} {{(pid=102561) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:21:49.739600 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-f4f3793f-6042-451e-8e49-26ac5fcb22d4 {{(pid=102561) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:21:49.739993 dv-cinder-773985-21-iscsi neutron-server[102561]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd80c03fe-3e2c-4e43-acfd-5b5af96404cc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '99a68581-a41f-466f-b6d4-fd8d25cc9536', 'code': 200} Feb 08 18:21:49.742606 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] No Port match for: 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:21:49.742975 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 8f5b70dd-2b98-47c5-9288-4dabd9ca45e6 not bound to the agent host hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:21:49.767852 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Pushing event updated for resources: {'Port': ['ID=99a68581-a41f-466f-b6d4-fd8d25cc9536,revision_number=5']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:49.801100 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7ef05d15-3815-4c28-9bf5-5b48638f0c48 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (13fcfd03-fc49-4bba-8574-ec74e795e2bd), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:49.831688 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ef05d15-3815-4c28-9bf5-5b48638f0c48 admin admin] Pushing event deleted for resources: {'Port': ['ID=13fcfd03-fc49-4bba-8574-ec74e795e2bd,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:49.862341 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a37f8eaa-7e59-4fdb-bb56-50fd30bdbd73 req-f84d8f9a-5f24-4110-a0f1-890cc3e498d0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:49.863938 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a37f8eaa-7e59-4fdb-bb56-50fd30bdbd73 req-f84d8f9a-5f24-4110-a0f1-890cc3e498d0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 945 time: 0.1372206 Feb 08 18:21:49.919524 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5131a3a7-0e29-458a-a273-b8885d3ddb0e req-85eb4684-e949-4b11-a1b0-10cbc30898dd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:49.921342 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5131a3a7-0e29-458a-a273-b8885d3ddb0e req-85eb4684-e949-4b11-a1b0-10cbc30898dd service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 1129 time: 0.0466452 Feb 08 18:21:49.970140 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5131a3a7-0e29-458a-a273-b8885d3ddb0e req-7afbdc7a-92ff-4629-a714-e2b1bd059626 service neutron] 10.222.0.109 "GET /v2.0/security-groups?id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421855 Feb 08 18:21:50.004202 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-a37f8eaa-7e59-4fdb-bb56-50fd30bdbd73 req-9bcbd80e-e989-4565-bafc-b34dce5d4a0c tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1191225 Feb 08 18:21:50.045564 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7ef05d15-3815-4c28-9bf5-5b48638f0c48 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-631690', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-560126'] for router_interface (72b4fd56-6775-4076-9195-fe85693f53aa), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:50.147940 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:50.267371 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7ef05d15-3815-4c28-9bf5-5b48638f0c48 admin admin] Router 72b4fd56-6775-4076-9195-fe85693f53aa has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102559) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:21:50.413036 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7ef05d15-3815-4c28-9bf5-5b48638f0c48 admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102559) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:21:50.418619 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-7ef05d15-3815-4c28-9bf5-5b48638f0c48 admin admin] 10.222.0.118 "PUT /v2.0/routers/72b4fd56-6775-4076-9195-fe85693f53aa/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8013189 Feb 08 18:21:50.421302 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45618) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:50.422996 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b542ae95-2843-4783-8289-e423638db516 None None] Sync routers for ids ['72b4fd56-6775-4076-9195-fe85693f53aa'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:21:50.434287 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b542ae95-2843-4783-8289-e423638db516 None None] Routers {'72b4fd56-6775-4076-9195-fe85693f53aa'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:21:50.434943 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-b542ae95-2843-4783-8289-e423638db516 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:21:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['72b4fd56-6775-4076-9195-fe85693f53aa'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:50.528172 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da9e8bd3-287f-479f-8d1c-286bb80a4670 admin admin] Publish callbacks [] for router (72b4fd56-6775-4076-9195-fe85693f53aa), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:50.542716 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-b542ae95-2843-4783-8289-e423638db516 None None] Set router 72b4fd56-6775-4076-9195-fe85693f53aa gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:21:50.631719 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da9e8bd3-287f-479f-8d1c-286bb80a4670 admin admin] Publish callbacks [] for router_gateway (72b4fd56-6775-4076-9195-fe85693f53aa), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:50.698744 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-da9e8bd3-287f-479f-8d1c-286bb80a4670 admin admin] Deleting port a7d5d25e-891f-4939-b21a-46de63af2d71 {{(pid=102559) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:21:50.699123 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da9e8bd3-287f-479f-8d1c-286bb80a4670 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (a7d5d25e-891f-4939-b21a-46de63af2d71), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:50.729754 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-b542ae95-2843-4783-8289-e423638db516 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81'}], 'enable_snat': True}, 'gw_port_id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:21:49Z', 'revision_number': 5, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port': {'id': 'a7d5d25e-891f-4939-b21a-46de63af2d71', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:83:b6:f0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'device_owner': 'network:router_gateway', 'standard_attr_id': 374, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.81', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:13:47Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:50.755806 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b542ae95-2843-4783-8289-e423638db516 None None] Checking router: 72b4fd56-6775-4076-9195-fe85693f53aa for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:21:50.764205 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b542ae95-2843-4783-8289-e423638db516 None None] Routers {'72b4fd56-6775-4076-9195-fe85693f53aa'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:21:50.764802 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-b542ae95-2843-4783-8289-e423638db516 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:21:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['72b4fd56-6775-4076-9195-fe85693f53aa'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:50.779750 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [None req-da9e8bd3-287f-479f-8d1c-286bb80a4670 admin admin] For port a7d5d25e-891f-4939-b21a-46de63af2d71, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=a7d5d25e-891f-4939-b21a-46de63af2d71,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102559) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:21:50.780081 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da9e8bd3-287f-479f-8d1c-286bb80a4670 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (a7d5d25e-891f-4939-b21a-46de63af2d71), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:50.792981 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-da9e8bd3-287f-479f-8d1c-286bb80a4670 admin admin] Calling delete_port for a7d5d25e-891f-4939-b21a-46de63af2d71 owned by network:router_gateway {{(pid=102559) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:21:50.970555 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da9e8bd3-287f-479f-8d1c-286bb80a4670 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (a7d5d25e-891f-4939-b21a-46de63af2d71), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:50.990477 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-b542ae95-2843-4783-8289-e423638db516 None None] Set router 72b4fd56-6775-4076-9195-fe85693f53aa gateway port host: None {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:21:51.004255 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da9e8bd3-287f-479f-8d1c-286bb80a4670 admin admin] Pushing event deleted for resources: {'Port': ['ID=a7d5d25e-891f-4939-b21a-46de63af2d71,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:51.053279 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-b542ae95-2843-4783-8289-e423638db516 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:21:50Z', 'revision_number': 6, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port_host': None}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:51.067255 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da9e8bd3-287f-479f-8d1c-286bb80a4670 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-560668'] for router_gateway (72b4fd56-6775-4076-9195-fe85693f53aa), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:51.082656 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b542ae95-2843-4783-8289-e423638db516 None None] The sync data for ids ['72b4fd56-6775-4076-9195-fe85693f53aa'] in dv-cinder-773985-21-iscsi is: [{'id': '72b4fd56-6775-4076-9195-fe85693f53aa', 'name': 'tempest-TestVolumeBootPattern-835787450-router', 'tenant_id': '768f50510c57419e8a49ed0988014174', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:42Z', 'updated_at': '2022-02-08T18:21:50Z', 'revision_number': 6, 'project_id': '768f50510c57419e8a49ed0988014174', 'gw_port_host': None}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:21:51.139084 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b48aa32a-e44e-4bb9-91cb-75080d0ea7f9 req-2afdffb1-90df-4e67-ba61-49c92938db72 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:51.140565 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b48aa32a-e44e-4bb9-91cb-75080d0ea7f9 req-2afdffb1-90df-4e67-ba61-49c92938db72 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 945 time: 0.0651963 Feb 08 18:21:51.160698 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da9e8bd3-287f-479f-8d1c-286bb80a4670 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-557467', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6918'] for router (72b4fd56-6775-4076-9195-fe85693f53aa), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:51.162855 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da9e8bd3-287f-479f-8d1c-286bb80a4670 admin admin] Publish callbacks [] for router_controller (72b4fd56-6775-4076-9195-fe85693f53aa), precommit_delete_associations {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:51.186903 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b48aa32a-e44e-4bb9-91cb-75080d0ea7f9 req-14c32813-5c69-4541-bbfa-9e416523765f tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0406008 Feb 08 18:21:51.208764 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da9e8bd3-287f-479f-8d1c-286bb80a4670 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-557452'] for router (72b4fd56-6775-4076-9195-fe85693f53aa), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:51.209546 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-da9e8bd3-287f-479f-8d1c-286bb80a4670 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 72b4fd56-6775-4076-9195-fe85693f53aa {{(pid=102559) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Feb 08 18:21:51.214213 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-da9e8bd3-287f-479f-8d1c-286bb80a4670 admin admin] Publish callbacks [] for router (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:51.215601 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-da9e8bd3-287f-479f-8d1c-286bb80a4670 admin admin] 10.222.0.118 "DELETE /v2.0/routers/72b4fd56-6775-4076-9195-fe85693f53aa HTTP/1.1" status: 204 len: 168 time: 0.7931480 Feb 08 18:21:51.218168 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45624) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:51.261182 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_v2 [None req-08d2f446-195e-4ae8-8c86-cf81a0cf4fdc admin admin] Deleting subnet 7b1e16de-d9af-4f50-86d7-ee22c9e14b1b {{(pid=102560) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Feb 08 18:21:51.264340 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-08d2f446-195e-4ae8-8c86-cf81a0cf4fdc admin admin] Publish callbacks [] for subnet (7b1e16de-d9af-4f50-86d7-ee22c9e14b1b), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:51.299074 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-08d2f446-195e-4ae8-8c86-cf81a0cf4fdc admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-64533851'] for subnet (7b1e16de-d9af-4f50-86d7-ee22c9e14b1b), precommit_delete_associations {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:51.305233 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6190a8bc-e226-42e0-9e28-0dd577795692 req-7a89b3ec-28bf-4e01-b98e-dfcabcfcf2c0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:51.306803 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6190a8bc-e226-42e0-9e28-0dd577795692 req-7a89b3ec-28bf-4e01-b98e-dfcabcfcf2c0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 945 time: 0.0532043 Feb 08 18:21:51.353516 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6190a8bc-e226-42e0-9e28-0dd577795692 req-47fba0b7-b81e-4b6d-8bf1-a412e945f503 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0409260 Feb 08 18:21:51.406294 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-08d2f446-195e-4ae8-8c86-cf81a0cf4fdc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1801023'] for subnet (7b1e16de-d9af-4f50-86d7-ee22c9e14b1b), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:51.466016 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-08d2f446-195e-4ae8-8c86-cf81a0cf4fdc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1801156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-64531538', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-64597460'] for subnet (7b1e16de-d9af-4f50-86d7-ee22c9e14b1b), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:51.492421 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08d2f446-195e-4ae8-8c86-cf81a0cf4fdc admin admin] Pushing event deleted for resources: {'Subnet': ['ID=7b1e16de-d9af-4f50-86d7-ee22c9e14b1b,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:51.496058 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-08d2f446-195e-4ae8-8c86-cf81a0cf4fdc admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:51.499246 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-08d2f446-195e-4ae8-8c86-cf81a0cf4fdc admin admin] 10.222.0.118 "DELETE /v2.0/subnets/7b1e16de-d9af-4f50-86d7-ee22c9e14b1b HTTP/1.1" status: 204 len: 168 time: 0.2800200 Feb 08 18:21:51.502400 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45628) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:51.506862 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-28f2af9e-72cc-4d8b-bad0-bbaea8d5177f None None] Network 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:21:51.583817 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3bf1c110-ead6-451c-b458-e148ebdb3943 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1860329'] for network (2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:51.639904 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-3bf1c110-ead6-451c-b458-e148ebdb3943 admin admin] Deleting port c2028811-a043-476c-9ae2-a8c0c41ed569 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:21:51.640236 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3bf1c110-ead6-451c-b458-e148ebdb3943 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (c2028811-a043-476c-9ae2-a8c0c41ed569), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:51.677321 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:51.707403 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [None req-3bf1c110-ead6-451c-b458-e148ebdb3943 admin admin] For port c2028811-a043-476c-9ae2-a8c0c41ed569, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=c2028811-a043-476c-9ae2-a8c0c41ed569,segment=NetworkSegment(fc5ec9ee-df90-46f3-bddf-aef0221d9066),segment_id=fc5ec9ee-df90-46f3-bddf-aef0221d9066)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:21:51.707761 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3bf1c110-ead6-451c-b458-e148ebdb3943 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (c2028811-a043-476c-9ae2-a8c0c41ed569), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:51.720126 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-3bf1c110-ead6-451c-b458-e148ebdb3943 admin admin] Calling delete_port for c2028811-a043-476c-9ae2-a8c0c41ed569 owned by network:dhcp {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:21:51.797915 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3bf1c110-ead6-451c-b458-e148ebdb3943 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (c2028811-a043-476c-9ae2-a8c0c41ed569), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:51.825063 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3bf1c110-ead6-451c-b458-e148ebdb3943 admin admin] No DVR routers for this DVR port c2028811-a043-476c-9ae2-a8c0c41ed569 on host dv-cinder-773985-21-iscsi {{(pid=102560) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:21:51.828666 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bf1c110-ead6-451c-b458-e148ebdb3943 admin admin] Pushing event deleted for resources: {'Port': ['ID=c2028811-a043-476c-9ae2-a8c0c41ed569,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:51.856510 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f3c957d-587b-4f8f-b6a7-23b3f152d46b req-c75d8bde-503d-4589-ab8d-4b73738bbb40 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:21:51.858161 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5f3c957d-587b-4f8f-b6a7-23b3f152d46b req-c75d8bde-503d-4589-ab8d-4b73738bbb40 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 945 time: 0.0527408 Feb 08 18:21:51.906674 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3bf1c110-ead6-451c-b458-e148ebdb3943 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1721768', 'neutron.services.segments.db._delete_segments_for_network-8770558865089'] for network (2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:51.911678 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2e6b1d31-1e5e-47f6-9568-b7334567c035 None None] DHCP port deletion for 2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 request from dv-cinder-773985-21-iscsi {{(pid=102561) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Feb 08 18:21:51.920849 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5f3c957d-587b-4f8f-b6a7-23b3f152d46b req-eda294a1-195a-417c-9f26-2101169239e9 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0569630 Feb 08 18:21:51.931870 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-3bf1c110-ead6-451c-b458-e148ebdb3943 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74']}} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:51.942099 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-3bf1c110-ead6-451c-b458-e148ebdb3943 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'fc5ec9ee-df90-46f3-bddf-aef0221d9066') {'for_net_delete': True} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:51.942400 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-3bf1c110-ead6-451c-b458-e148ebdb3943 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'fc5ec9ee-df90-46f3-bddf-aef0221d9066') {} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:51.952102 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3bf1c110-ead6-451c-b458-e148ebdb3943 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8770558866122', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-64533840'] for segment (fc5ec9ee-df90-46f3-bddf-aef0221d9066), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:51.965655 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3bf1c110-ead6-451c-b458-e148ebdb3943 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (fc5ec9ee-df90-46f3-bddf-aef0221d9066), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:51.972136 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3bf1c110-ead6-451c-b458-e148ebdb3943 admin admin] Releasing vlan 1066 on physical network physnet1 to pool {{(pid=102560) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Feb 08 18:21:51.972602 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3bf1c110-ead6-451c-b458-e148ebdb3943 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-64531704'] for segment (fc5ec9ee-df90-46f3-bddf-aef0221d9066), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: Traceback (most recent call last): Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: timer() Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: cb(*args, **kw) Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: return func(*args, **kwargs) Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: self._notify() Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: self.callback(batched_events) Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: event.method(event) Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: aggregate_uuid = self.p_client.list_aggregates( Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: return f(self, *a, **k) Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: return self._get(url).json() Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: return self._client.get(url, endpoint_filter=self._ks_filter, Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: return self.request(url, 'GET', **kwargs) Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: base_url = self.get_endpoint(auth, allow=allow, Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 08 18:21:51.974352 dv-cinder-773985-21-iscsi neutron-server[102560]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 08 18:21:52.047386 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3bf1c110-ead6-451c-b458-e148ebdb3943 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1721777', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-560760'] for network (2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:52.056494 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-3bf1c110-ead6-451c-b458-e148ebdb3943 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:52.059829 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-3bf1c110-ead6-451c-b458-e148ebdb3943 admin admin] 10.222.0.118 "DELETE /v2.0/networks/2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74 HTTP/1.1" status: 204 len: 168 time: 0.5564804 Feb 08 18:21:52.062917 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45634) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:52.070918 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3bf1c110-ead6-451c-b458-e148ebdb3943 admin admin] Pushing event deleted for resources: {'Network': ['ID=2f3a70b4-e3a0-4fbd-bc79-bc8e0cbd8b74,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:52.160856 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device a7d5d25e-891f-4939-b21a-46de63af2d71 no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:21:52.183467 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: a7d5d25e-891f-4939-b21a-46de63af2d71 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:21:52.183900 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device a7d5d25e-891f-4939-b21a-46de63af2d71 not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:21:52.184565 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device c2028811-a043-476c-9ae2-a8c0c41ed569 no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:21:52.206472 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: c2028811-a043-476c-9ae2-a8c0c41ed569 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:21:52.207004 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device c2028811-a043-476c-9ae2-a8c0c41ed569 not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:21:52.207627 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 13fcfd03-fc49-4bba-8574-ec74e795e2bd no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:21:52.242650 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: 13fcfd03-fc49-4bba-8574-ec74e795e2bd {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:21:52.243236 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 13fcfd03-fc49-4bba-8574-ec74e795e2bd not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:21:52.740219 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a9dc18c7-bfca-4e3c-a6cb-d6cecfc224de admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-559978'] for router_interface (4383a61e-2e1d-48ae-94de-32830e84c9c4), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:52.990370 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-a9dc18c7-bfca-4e3c-a6cb-d6cecfc224de admin admin] Deleting port 91ab6805-d053-4617-b07e-1f7786dcb82f {{(pid=102559) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:21:52.990622 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a9dc18c7-bfca-4e3c-a6cb-d6cecfc224de admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (91ab6805-d053-4617-b07e-1f7786dcb82f), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:53.073875 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [None req-a9dc18c7-bfca-4e3c-a6cb-d6cecfc224de admin admin] For port 91ab6805-d053-4617-b07e-1f7786dcb82f, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=91ab6805-d053-4617-b07e-1f7786dcb82f,segment=NetworkSegment(5a4471c8-e699-485f-ade3-bde146c6c0bb),segment_id=5a4471c8-e699-485f-ade3-bde146c6c0bb)] {{(pid=102559) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:21:53.074529 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a9dc18c7-bfca-4e3c-a6cb-d6cecfc224de admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (91ab6805-d053-4617-b07e-1f7786dcb82f), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:53.087802 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-a9dc18c7-bfca-4e3c-a6cb-d6cecfc224de admin admin] Calling delete_port for 91ab6805-d053-4617-b07e-1f7786dcb82f owned by network:router_interface {{(pid=102559) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:21:53.294724 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a9dc18c7-bfca-4e3c-a6cb-d6cecfc224de admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (91ab6805-d053-4617-b07e-1f7786dcb82f), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:53.322231 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9dc18c7-bfca-4e3c-a6cb-d6cecfc224de admin admin] Pushing event deleted for resources: {'Port': ['ID=91ab6805-d053-4617-b07e-1f7786dcb82f,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:53.507526 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-a9dc18c7-bfca-4e3c-a6cb-d6cecfc224de admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-631690', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-560126'] for router_interface (4383a61e-2e1d-48ae-94de-32830e84c9c4), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:53.728166 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a9dc18c7-bfca-4e3c-a6cb-d6cecfc224de admin admin] Router 4383a61e-2e1d-48ae-94de-32830e84c9c4 has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102559) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:21:53.843859 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a9dc18c7-bfca-4e3c-a6cb-d6cecfc224de admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102559) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:21:53.849158 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-a9dc18c7-bfca-4e3c-a6cb-d6cecfc224de admin admin] 10.222.0.118 "PUT /v2.0/routers/4383a61e-2e1d-48ae-94de-32830e84c9c4/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7852302 Feb 08 18:21:53.851724 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45658) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:53.859660 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e2a0536-3b40-4df0-b028-c2374370a534 None None] Sync routers for ids ['4383a61e-2e1d-48ae-94de-32830e84c9c4'] in dv-cinder-773985-21-iscsi {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:21:53.869862 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e2a0536-3b40-4df0-b028-c2374370a534 None None] Routers {'4383a61e-2e1d-48ae-94de-32830e84c9c4'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:21:53.870529 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-9e2a0536-3b40-4df0-b028-c2374370a534 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:21:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['4383a61e-2e1d-48ae-94de-32830e84c9c4'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:53.960831 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-952265ea-3a83-4420-be7e-d52a8003f9be admin admin] Publish callbacks [] for router (4383a61e-2e1d-48ae-94de-32830e84c9c4), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:53.974610 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-9e2a0536-3b40-4df0-b028-c2374370a534 None None] Set router 4383a61e-2e1d-48ae-94de-32830e84c9c4 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:21:54.063840 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-952265ea-3a83-4420-be7e-d52a8003f9be admin admin] Publish callbacks [] for router_gateway (4383a61e-2e1d-48ae-94de-32830e84c9c4), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:54.132449 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-952265ea-3a83-4420-be7e-d52a8003f9be admin admin] Deleting port 6bd2e4e4-f071-46c0-b5fe-db175f638a13 {{(pid=102559) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:21:54.133132 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-952265ea-3a83-4420-be7e-d52a8003f9be admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (6bd2e4e4-f071-46c0-b5fe-db175f638a13), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:54.156750 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-9e2a0536-3b40-4df0-b028-c2374370a534 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4383a61e-2e1d-48ae-94de-32830e84c9c4', 'name': 'tempest-TestVolumeBootPattern-458105507-router', 'tenant_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.252'}], 'enable_snat': True}, 'gw_port_id': '6bd2e4e4-f071-46c0-b5fe-db175f638a13', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:48Z', 'updated_at': '2022-02-08T18:21:53Z', 'revision_number': 5, 'project_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'gw_port': {'id': '6bd2e4e4-f071-46c0-b5fe-db175f638a13', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:10:51:18', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4383a61e-2e1d-48ae-94de-32830e84c9c4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 387, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.252', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:13:48Z', 'updated_at': '2022-02-08T18:13:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:54.183993 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e2a0536-3b40-4df0-b028-c2374370a534 None None] Checking router: 4383a61e-2e1d-48ae-94de-32830e84c9c4 for host: dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:21:54.192193 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9e2a0536-3b40-4df0-b028-c2374370a534 None None] Routers {'4383a61e-2e1d-48ae-94de-32830e84c9c4'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:21:54.192852 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-9e2a0536-3b40-4df0-b028-c2374370a534 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:21:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['4383a61e-2e1d-48ae-94de-32830e84c9c4'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:54.211269 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [None req-952265ea-3a83-4420-be7e-d52a8003f9be admin admin] For port 6bd2e4e4-f071-46c0-b5fe-db175f638a13, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=6bd2e4e4-f071-46c0-b5fe-db175f638a13,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102559) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:21:54.211638 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-952265ea-3a83-4420-be7e-d52a8003f9be admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (6bd2e4e4-f071-46c0-b5fe-db175f638a13), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:54.224105 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-952265ea-3a83-4420-be7e-d52a8003f9be admin admin] Calling delete_port for 6bd2e4e4-f071-46c0-b5fe-db175f638a13 owned by network:router_gateway {{(pid=102559) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:21:54.367475 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-9e2a0536-3b40-4df0-b028-c2374370a534 None None] Set router 4383a61e-2e1d-48ae-94de-32830e84c9c4 gateway port host: None {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:21:54.397397 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-952265ea-3a83-4420-be7e-d52a8003f9be admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (6bd2e4e4-f071-46c0-b5fe-db175f638a13), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:54.420485 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-9e2a0536-3b40-4df0-b028-c2374370a534 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4383a61e-2e1d-48ae-94de-32830e84c9c4', 'name': 'tempest-TestVolumeBootPattern-458105507-router', 'tenant_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:48Z', 'updated_at': '2022-02-08T18:21:54Z', 'revision_number': 6, 'project_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'gw_port_host': None}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:54.423672 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-952265ea-3a83-4420-be7e-d52a8003f9be admin admin] Pushing event deleted for resources: {'Port': ['ID=6bd2e4e4-f071-46c0-b5fe-db175f638a13,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:54.447809 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9e2a0536-3b40-4df0-b028-c2374370a534 None None] The sync data for ids ['4383a61e-2e1d-48ae-94de-32830e84c9c4'] in dv-cinder-773985-21-iscsi is: [{'id': '4383a61e-2e1d-48ae-94de-32830e84c9c4', 'name': 'tempest-TestVolumeBootPattern-458105507-router', 'tenant_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:13:48Z', 'updated_at': '2022-02-08T18:21:54Z', 'revision_number': 6, 'project_id': '2fd83c0bbedb4efca9d6f4979aac10db', 'gw_port_host': None}] {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:21:54.484166 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-952265ea-3a83-4420-be7e-d52a8003f9be admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-560668'] for router_gateway (4383a61e-2e1d-48ae-94de-32830e84c9c4), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:54.574524 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-952265ea-3a83-4420-be7e-d52a8003f9be admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-557467', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6918'] for router (4383a61e-2e1d-48ae-94de-32830e84c9c4), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:54.576764 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-952265ea-3a83-4420-be7e-d52a8003f9be admin admin] Publish callbacks [] for router_controller (4383a61e-2e1d-48ae-94de-32830e84c9c4), precommit_delete_associations {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:54.625097 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-952265ea-3a83-4420-be7e-d52a8003f9be admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-557452'] for router (4383a61e-2e1d-48ae-94de-32830e84c9c4), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:54.625627 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-952265ea-3a83-4420-be7e-d52a8003f9be admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4383a61e-2e1d-48ae-94de-32830e84c9c4 {{(pid=102559) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Feb 08 18:21:54.630782 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-952265ea-3a83-4420-be7e-d52a8003f9be admin admin] Publish callbacks [] for router (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:54.631926 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-952265ea-3a83-4420-be7e-d52a8003f9be admin admin] 10.222.0.118 "DELETE /v2.0/routers/4383a61e-2e1d-48ae-94de-32830e84c9c4 HTTP/1.1" status: 204 len: 168 time: 0.7793658 Feb 08 18:21:54.635537 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45662) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:54.681239 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_v2 [None req-f42f049c-0b65-4569-94d7-081fdc445b41 admin admin] Deleting subnet 24466b5d-d35d-4ad0-812e-ceb5c371f644 {{(pid=102559) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Feb 08 18:21:54.684683 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f42f049c-0b65-4569-94d7-081fdc445b41 admin admin] Publish callbacks [] for subnet (24466b5d-d35d-4ad0-812e-ceb5c371f644), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:54.720187 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f42f049c-0b65-4569-94d7-081fdc445b41 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-63850237'] for subnet (24466b5d-d35d-4ad0-812e-ceb5c371f644), precommit_delete_associations {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:54.814415 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f42f049c-0b65-4569-94d7-081fdc445b41 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1801023'] for subnet (24466b5d-d35d-4ad0-812e-ceb5c371f644), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:54.879096 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f42f049c-0b65-4569-94d7-081fdc445b41 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1801156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-63856520', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-63685312'] for subnet (24466b5d-d35d-4ad0-812e-ceb5c371f644), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:54.910418 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f42f049c-0b65-4569-94d7-081fdc445b41 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=24466b5d-d35d-4ad0-812e-ceb5c371f644,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:54.912445 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-f42f049c-0b65-4569-94d7-081fdc445b41 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for subnet (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:54.915987 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-f42f049c-0b65-4569-94d7-081fdc445b41 admin admin] 10.222.0.118 "DELETE /v2.0/subnets/24466b5d-d35d-4ad0-812e-ceb5c371f644 HTTP/1.1" status: 204 len: 168 time: 0.2795348 Feb 08 18:21:54.917504 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8624952f-8b77-40c4-980b-a16c98f9b93d None None] Network 3b72196e-a88b-47cc-8d61-dbdb9bd382b8 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:21:54.918538 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45666) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:54.983299 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-65da5044-92d3-4010-95e4-e294c15c0fa3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1860329'] for network (3b72196e-a88b-47cc-8d61-dbdb9bd382b8), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:55.002325 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:21:55.043540 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-65da5044-92d3-4010-95e4-e294c15c0fa3 admin admin] Deleting port 0cad626a-b423-4561-8abb-3bb66a3cad8d {{(pid=102559) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:21:55.043879 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-65da5044-92d3-4010-95e4-e294c15c0fa3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (0cad626a-b423-4561-8abb-3bb66a3cad8d), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:55.104914 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [None req-65da5044-92d3-4010-95e4-e294c15c0fa3 admin admin] For port 0cad626a-b423-4561-8abb-3bb66a3cad8d, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=0cad626a-b423-4561-8abb-3bb66a3cad8d,segment=NetworkSegment(5a4471c8-e699-485f-ade3-bde146c6c0bb),segment_id=5a4471c8-e699-485f-ade3-bde146c6c0bb)] {{(pid=102559) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:21:55.105259 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-65da5044-92d3-4010-95e4-e294c15c0fa3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (0cad626a-b423-4561-8abb-3bb66a3cad8d), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:55.118741 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-65da5044-92d3-4010-95e4-e294c15c0fa3 admin admin] Calling delete_port for 0cad626a-b423-4561-8abb-3bb66a3cad8d owned by network:dhcp {{(pid=102559) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:21:55.209382 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-65da5044-92d3-4010-95e4-e294c15c0fa3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (0cad626a-b423-4561-8abb-3bb66a3cad8d), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:55.229279 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4feb0969-65ec-47cc-8a7d-40dfcce2391f None None] DHCP port deletion for 3b72196e-a88b-47cc-8d61-dbdb9bd382b8 request from dv-cinder-773985-21-iscsi {{(pid=102561) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Feb 08 18:21:55.238134 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65da5044-92d3-4010-95e4-e294c15c0fa3 admin admin] Pushing event deleted for resources: {'Port': ['ID=0cad626a-b423-4561-8abb-3bb66a3cad8d,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:55.242411 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [None req-65da5044-92d3-4010-95e4-e294c15c0fa3 admin admin] No DVR routers for this DVR port 0cad626a-b423-4561-8abb-3bb66a3cad8d on host dv-cinder-773985-21-iscsi {{(pid=102559) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:21:55.311351 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-65da5044-92d3-4010-95e4-e294c15c0fa3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1721768', 'neutron.services.segments.db._delete_segments_for_network-8770558865089'] for network (3b72196e-a88b-47cc-8d61-dbdb9bd382b8), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:55.336422 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.services.segments.db [None req-65da5044-92d3-4010-95e4-e294c15c0fa3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['3b72196e-a88b-47cc-8d61-dbdb9bd382b8']}} {{(pid=102559) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:55.346569 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.services.segments.db [None req-65da5044-92d3-4010-95e4-e294c15c0fa3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5a4471c8-e699-485f-ade3-bde146c6c0bb') {'for_net_delete': True} {{(pid=102559) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:55.346893 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.services.segments.db [None req-65da5044-92d3-4010-95e4-e294c15c0fa3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5a4471c8-e699-485f-ade3-bde146c6c0bb') {} {{(pid=102559) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:21:55.357216 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-65da5044-92d3-4010-95e4-e294c15c0fa3 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8770558866122', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-63850230'] for segment (5a4471c8-e699-485f-ade3-bde146c6c0bb), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:55.370936 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-65da5044-92d3-4010-95e4-e294c15c0fa3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (5a4471c8-e699-485f-ade3-bde146c6c0bb), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:55.377006 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-65da5044-92d3-4010-95e4-e294c15c0fa3 admin admin] Releasing vlan 1064 on physical network physnet1 to pool {{(pid=102559) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Feb 08 18:21:55.377394 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-65da5044-92d3-4010-95e4-e294c15c0fa3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-63856418'] for segment (5a4471c8-e699-485f-ade3-bde146c6c0bb), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: Traceback (most recent call last): Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: timer() Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: cb(*args, **kw) Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: return func(*args, **kwargs) Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: self._notify() Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: self.callback(batched_events) Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: event.method(event) Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: aggregate_uuid = self.p_client.list_aggregates( Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: return f(self, *a, **k) Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: return self._get(url).json() Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: return self._client.get(url, endpoint_filter=self._ks_filter, Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: return self.request(url, 'GET', **kwargs) Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: base_url = self.get_endpoint(auth, allow=allow, Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 08 18:21:55.379065 dv-cinder-773985-21-iscsi neutron-server[102559]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 08 18:21:55.433909 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-65da5044-92d3-4010-95e4-e294c15c0fa3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1721777', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-560760'] for network (3b72196e-a88b-47cc-8d61-dbdb9bd382b8), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:55.439519 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-65da5044-92d3-4010-95e4-e294c15c0fa3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:55.442894 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-65da5044-92d3-4010-95e4-e294c15c0fa3 admin admin] 10.222.0.118 "DELETE /v2.0/networks/3b72196e-a88b-47cc-8d61-dbdb9bd382b8 HTTP/1.1" status: 204 len: 168 time: 0.5232272 Feb 08 18:21:55.454459 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65da5044-92d3-4010-95e4-e294c15c0fa3 admin admin] Pushing event deleted for resources: {'Network': ['ID=3b72196e-a88b-47cc-8d61-dbdb9bd382b8,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:55.574452 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45670) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:55.615553 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-69e2f92d-1c6d-42da-abdf-e3b8f1160174 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=768f50510c57419e8a49ed0988014174&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0399294 Feb 08 18:21:55.619188 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45672) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:55.667446 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e76f1834-6b26-4ca3-b3a5-83736d3469ea admin admin] Publish callbacks [] for security_group (0e4ad37c-be38-425e-861c-c171db8e9663), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:55.691795 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e76f1834-6b26-4ca3-b3a5-83736d3469ea admin admin] Publish callbacks [] for security_group (0e4ad37c-be38-425e-861c-c171db8e9663), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:55.740970 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e76f1834-6b26-4ca3-b3a5-83736d3469ea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (0e4ad37c-be38-425e-861c-c171db8e9663), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:55.744921 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-e76f1834-6b26-4ca3-b3a5-83736d3469ea admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:55.746248 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-e76f1834-6b26-4ca3-b3a5-83736d3469ea admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/0e4ad37c-be38-425e-861c-c171db8e9663 HTTP/1.1" status: 204 len: 168 time: 0.1261222 Feb 08 18:21:55.755978 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e76f1834-6b26-4ca3-b3a5-83736d3469ea admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0e4ad37c-be38-425e-861c-c171db8e9663,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:21:56.071876 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45680) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:56.112890 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-363d2eb7-4a94-4a53-b84b-f41c205d615d admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=2fd83c0bbedb4efca9d6f4979aac10db&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0398228 Feb 08 18:21:56.115618 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45682) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:21:56.135401 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 6bd2e4e4-f071-46c0-b5fe-db175f638a13 no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:21:56.159789 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: 6bd2e4e4-f071-46c0-b5fe-db175f638a13 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:21:56.160106 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 6bd2e4e4-f071-46c0-b5fe-db175f638a13 not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:21:56.160538 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 91ab6805-d053-4617-b07e-1f7786dcb82f no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:21:56.163290 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-92726fea-6b15-4f75-9e82-9a05d1e52adc admin admin] Publish callbacks [] for security_group (27334ad3-e9f3-46d4-aeb4-1e87073bd786), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:56.179990 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: 91ab6805-d053-4617-b07e-1f7786dcb82f {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:21:56.180323 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 91ab6805-d053-4617-b07e-1f7786dcb82f not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:21:56.180698 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 0cad626a-b423-4561-8abb-3bb66a3cad8d no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:21:56.183871 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-92726fea-6b15-4f75-9e82-9a05d1e52adc admin admin] Publish callbacks [] for security_group (27334ad3-e9f3-46d4-aeb4-1e87073bd786), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:56.199051 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: 0cad626a-b423-4561-8abb-3bb66a3cad8d {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:21:56.199312 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 0cad626a-b423-4561-8abb-3bb66a3cad8d not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:21:56.232845 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-92726fea-6b15-4f75-9e82-9a05d1e52adc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (27334ad3-e9f3-46d4-aeb4-1e87073bd786), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:56.235854 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-92726fea-6b15-4f75-9e82-9a05d1e52adc admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:21:56.236983 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-92726fea-6b15-4f75-9e82-9a05d1e52adc admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/27334ad3-e9f3-46d4-aeb4-1e87073bd786 HTTP/1.1" status: 204 len: 168 time: 0.1204095 Feb 08 18:21:56.244312 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92726fea-6b15-4f75-9e82-9a05d1e52adc admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=27334ad3-e9f3-46d4-aeb4-1e87073bd786,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:22:00.375410 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d732b4f2-6cd1-4888-b561-fbc98eaa23aa req-ef303034-d303-491a-a597-e986fffef232 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:00.376923 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d732b4f2-6cd1-4888-b561-fbc98eaa23aa req-ef303034-d303-491a-a597-e986fffef232 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 945 time: 0.0542285 Feb 08 18:22:00.424187 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-d732b4f2-6cd1-4888-b561-fbc98eaa23aa req-ffaa33d8-dbe8-4acd-8c63-b4d9b053d206 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416863 Feb 08 18:22:00.455255 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45700) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:22:00.725004 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e113ed57-6328-4cb8-9798-af17378c8040 tempest-TestMinimumBasicScenario-1596485191 tempest-TestMinimumBasicScenario-1596485191-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:00.726540 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-e113ed57-6328-4cb8-9798-af17378c8040 tempest-TestMinimumBasicScenario-1596485191 tempest-TestMinimumBasicScenario-1596485191-project-admin] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 1124 time: 0.2703364 Feb 08 18:22:00.729688 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45704) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:22:00.734058 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-5f0b4b87-1ebf-4a10-887e-4898533bb2a2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Request body: {'floatingip': {'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'port_id': '99a68581-a41f-466f-b6d4-fd8d25cc9536', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'fixed_ip_address': '172.20.0.5'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:22:00.757396 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5f0b4b87-1ebf-4a10-887e-4898533bb2a2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for floatingip (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:00.854528 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5f0b4b87-1ebf-4a10-887e-4898533bb2a2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (None), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:00.962829 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.db_base_plugin_common [None req-5f0b4b87-1ebf-4a10-887e-4898533bb2a2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Allocated IP 172.27.1.149 (77055816-7c88-403d-8f8a-9be2c1faa10d/18547c52-7b23-42cd-bb53-214663ed102b/ffdb317d-dfa5-4733-bdd4-81b145da0942) {{(pid=102559) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Feb 08 18:22:01.067292 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5f0b4b87-1ebf-4a10-887e-4898533bb2a2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for port (ffdb317d-dfa5-4733-bdd4-81b145da0942), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:01.102597 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5f0b4b87-1ebf-4a10-887e-4898533bb2a2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8770558538433', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (ffdb317d-dfa5-4733-bdd4-81b145da0942), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:01.144610 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f0b4b87-1ebf-4a10-887e-4898533bb2a2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Network 77055816-7c88-403d-8f8a-9be2c1faa10d is already hosted by enough agents. {{(pid=102559) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Feb 08 18:22:01.147523 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.base_scheduler [None req-5f0b4b87-1ebf-4a10-887e-4898533bb2a2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Resources bound (agent type, host, resource id): {{(pid=102559) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Feb 08 18:22:01.150221 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f0b4b87-1ebf-4a10-887e-4898533bb2a2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Received port after_create {{(pid=102559) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:536}} Feb 08 18:22:01.173069 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f0b4b87-1ebf-4a10-887e-4898533bb2a2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Pushing event updated for resources: {'Port': ['ID=ffdb317d-dfa5-4733-bdd4-81b145da0942,revision_number=1']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:22:01.772251 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5f0b4b87-1ebf-4a10-887e-4898533bb2a2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for floatingip (1a0caead-0ec8-4f47-9bf2-c303006ae1f5), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:01.844758 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5f0b4b87-1ebf-4a10-887e-4898533bb2a2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (ffdb317d-dfa5-4733-bdd4-81b145da0942), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:02.003842 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5f0b4b87-1ebf-4a10-887e-4898533bb2a2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for port (ffdb317d-dfa5-4733-bdd4-81b145da0942), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:02.010249 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5f0b4b87-1ebf-4a10-887e-4898533bb2a2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-63856478'] for port (ffdb317d-dfa5-4733-bdd4-81b145da0942), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:02.083300 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f0b4b87-1ebf-4a10-887e-4898533bb2a2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Pushing event updated for resources: {'Port': ['ID=ffdb317d-dfa5-4733-bdd4-81b145da0942,revision_number=2']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:22:02.092320 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5f0b4b87-1ebf-4a10-887e-4898533bb2a2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-560746'] for floatingip (1a0caead-0ec8-4f47-9bf2-c303006ae1f5), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:02.192107 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.db.l3_db [None req-5f0b4b87-1ebf-4a10-887e-4898533bb2a2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Floating IP 1a0caead-0ec8-4f47-9bf2-c303006ae1f5 associated. External IP: 172.27.1.149, port: 99a68581-a41f-466f-b6d4-fd8d25cc9536. Feb 08 18:22:02.409373 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5f0b4b87-1ebf-4a10-887e-4898533bb2a2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Router 4840b53c-7786-4bda-8326-dd7d53cf4097 has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102559) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:22:02.517109 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5f0b4b87-1ebf-4a10-887e-4898533bb2a2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102559) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:22:02.527271 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-20bec56a-6be2-4b4f-9168-27403348d746 None None] Sync routers for ids ['4840b53c-7786-4bda-8326-dd7d53cf4097'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:22:02.535666 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-5f0b4b87-1ebf-4a10-887e-4898533bb2a2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for floatingip (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:02.536936 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20bec56a-6be2-4b4f-9168-27403348d746 None None] Routers {'4840b53c-7786-4bda-8326-dd7d53cf4097'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:22:02.537548 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-20bec56a-6be2-4b4f-9168-27403348d746 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:21:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['4840b53c-7786-4bda-8326-dd7d53cf4097'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:22:02.566504 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-5f0b4b87-1ebf-4a10-887e-4898533bb2a2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 1.8358090 Feb 08 18:22:02.567124 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd80c03fe-3e2c-4e43-acfd-5b5af96404cc', 'tag': '99a68581-a41f-466f-b6d4-fd8d25cc9536'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:22:02.569425 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cd5f1748-3375-4b78-94e4-238586a36857" -d '{"events": [{"name": "network-changed", "server_uuid": "d80c03fe-3e2c-4e43-acfd-5b5af96404cc", "tag": "99a68581-a41f-466f-b6d4-fd8d25cc9536"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:22:02.569654 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45706) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:22:02.574815 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-4f96774e-3eec-4cff-8670-f8bad94166d2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-79178740', 'description': 'tempest-secgroup-smoke-79178740 description', 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:22:02.596473 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4f96774e-3eec-4cff-8670-f8bad94166d2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group (None), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:02.609295 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:22:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7366a5f2-2b52-4f19-83cb-74e47c283e4f x-openstack-request-id: req-7366a5f2-2b52-4f19-83cb-74e47c283e4f {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:22:02.609807 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d80c03fe-3e2c-4e43-acfd-5b5af96404cc", "tag": "99a68581-a41f-466f-b6d4-fd8d25cc9536", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:22:02.610243 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-7366a5f2-2b52-4f19-83cb-74e47c283e4f {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:22:02.610655 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd80c03fe-3e2c-4e43-acfd-5b5af96404cc', 'tag': '99a68581-a41f-466f-b6d4-fd8d25cc9536', 'status': 'completed', 'code': 200} Feb 08 18:22:02.649240 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-20bec56a-6be2-4b4f-9168-27403348d746 None None] Set router 4840b53c-7786-4bda-8326-dd7d53cf4097 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:22:02.701655 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4f96774e-3eec-4cff-8670-f8bad94166d2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group (0bd697a2-acf0-46fa-9402-7664c0905691), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:02.707030 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4f96774e-3eec-4cff-8670-f8bad94166d2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (0bd697a2-acf0-46fa-9402-7664c0905691), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:02.713780 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd5f1748-3375-4b78-94e4-238586a36857 req-bf769458-44f2-40a6-ac8e-5b4494ff6cd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:02.715275 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-cd5f1748-3375-4b78-94e4-238586a36857 req-bf769458-44f2-40a6-ac8e-5b4494ff6cd6 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=a49c4d8ef7824a87af0bd566f0854d0a&device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 1129 time: 0.0773664 Feb 08 18:22:02.753564 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-4f96774e-3eec-4cff-8670-f8bad94166d2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:02.757576 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-4f96774e-3eec-4cff-8670-f8bad94166d2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1807 time: 0.1839850 Feb 08 18:22:02.758032 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45710) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:22:02.764221 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-77e48d7c-0674-42f7-9b42-281ea6183139 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Request body: {'security_group_rule': {'security_group_id': '0bd697a2-acf0-46fa-9402-7664c0905691', 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:22:02.787385 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f96774e-3eec-4cff-8670-f8bad94166d2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Pushing event updated for resources: {'SecurityGroup': ['ID=0bd697a2-acf0-46fa-9402-7664c0905691,revision_number=1']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:22:02.809641 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-77e48d7c-0674-42f7-9b42-281ea6183139 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group_rule (96da6f2f-b902-496f-b491-2abe0747cff0), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:02.825962 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd5f1748-3375-4b78-94e4-238586a36857 req-a7c6da47-e764-4010-9544-b38710343f35 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:02.827480 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-cd5f1748-3375-4b78-94e4-238586a36857 req-a7c6da47-e764-4010-9544-b38710343f35 service neutron] 10.222.0.109 "GET /v2.0/networks?id=bfa2dbfe-1e79-44ee-9df4-62197aec047e HTTP/1.1" status: 200 len: 917 time: 0.1061988 Feb 08 18:22:02.870804 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-77e48d7c-0674-42f7-9b42-281ea6183139 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group_rule (96da6f2f-b902-496f-b491-2abe0747cff0), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:02.875155 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-77e48d7c-0674-42f7-9b42-281ea6183139 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (96da6f2f-b902-496f-b491-2abe0747cff0), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:02.884935 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-20bec56a-6be2-4b4f-9168-27403348d746 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'name': 'tempest-TestMinimumBasicScenario-1869431064-router', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '227490ec-5281-4713-bf74-27f395237029', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:14Z', 'updated_at': '2022-02-08T18:21:17Z', 'revision_number': 4, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'gw_port': {'id': '227490ec-5281-4713-bf74-27f395237029', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:89:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:15Z', 'updated_at': '2022-02-08T18:21:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '1a0caead-0ec8-4f47-9bf2-c303006ae1f5', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'floating_ip_address': '172.27.1.149', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'port_id': '99a68581-a41f-466f-b6d4-fd8d25cc9536', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 693, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e', 'mac_address': 'fa:16:3e:ef:3b:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd80c03fe-3e2c-4e43-acfd-5b5af96404cc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:22:01Z', 'updated_at': '2022-02-08T18:22:01Z', 'revision_number': 0, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2', 'name': '', 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'mac_address': 'fa:16:3e:ab:a4:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '96b794ac-bea5-4ac6-8b01-835f4cdef825', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:17Z', 'updated_at': '2022-02-08T18:21:21Z', 'revision_number': 5, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'subnets': [{'id': '96b794ac-bea5-4ac6-8b01-835f4cdef825', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:22:02.893225 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77e48d7c-0674-42f7-9b42-281ea6183139 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=96da6f2f-b902-496f-b491-2abe0747cff0,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:22:02.903703 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-77e48d7c-0674-42f7-9b42-281ea6183139 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:02.906110 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-cd5f1748-3375-4b78-94e4-238586a36857 req-737224ba-9185-4f37-afe7-787a11ce336d service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=99a68581-a41f-466f-b6d4-fd8d25cc9536 HTTP/1.1" status: 200 len: 999 time: 0.0717173 Feb 08 18:22:02.907771 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45712) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:22:02.907968 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-77e48d7c-0674-42f7-9b42-281ea6183139 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1475298 Feb 08 18:22:02.912317 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-20bec56a-6be2-4b4f-9168-27403348d746 None None] Checking router: 4840b53c-7786-4bda-8326-dd7d53cf4097 for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:22:02.912620 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-1d2e0f99-2206-4bdc-87f7-9eed2d95960f tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Request body: {'security_group_rule': {'security_group_id': '0bd697a2-acf0-46fa-9402-7664c0905691', 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:22:02.922225 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-20bec56a-6be2-4b4f-9168-27403348d746 None None] Routers {'4840b53c-7786-4bda-8326-dd7d53cf4097'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:22:02.922856 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-20bec56a-6be2-4b4f-9168-27403348d746 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:21:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['4840b53c-7786-4bda-8326-dd7d53cf4097'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:22:02.973050 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd5f1748-3375-4b78-94e4-238586a36857 req-a1984909-8111-49fc-89ad-5183e1752e25 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:02.974401 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-cd5f1748-3375-4b78-94e4-238586a36857 req-a1984909-8111-49fc-89ad-5183e1752e25 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=96b794ac-bea5-4ac6-8b01-835f4cdef825 HTTP/1.1" status: 200 len: 854 time: 0.0562828 Feb 08 18:22:02.975218 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1d2e0f99-2206-4bdc-87f7-9eed2d95960f tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group_rule (36cf8a9d-15a7-4fa5-a094-5dd9b9cb2761), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:03.037946 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-20bec56a-6be2-4b4f-9168-27403348d746 None None] Set router 4840b53c-7786-4bda-8326-dd7d53cf4097 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:22:03.060114 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd5f1748-3375-4b78-94e4-238586a36857 req-6dde73fb-0725-416d-b782-30cabbf514c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:03.061596 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-cd5f1748-3375-4b78-94e4-238586a36857 req-6dde73fb-0725-416d-b782-30cabbf514c3 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=bfa2dbfe-1e79-44ee-9df4-62197aec047e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0778353 Feb 08 18:22:03.066987 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1d2e0f99-2206-4bdc-87f7-9eed2d95960f tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group_rule (36cf8a9d-15a7-4fa5-a094-5dd9b9cb2761), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:03.077102 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1d2e0f99-2206-4bdc-87f7-9eed2d95960f tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (36cf8a9d-15a7-4fa5-a094-5dd9b9cb2761), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:03.132773 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d2e0f99-2206-4bdc-87f7-9eed2d95960f tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=36cf8a9d-15a7-4fa5-a094-5dd9b9cb2761,revision_number=0']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:22:03.148825 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1d2e0f99-2206-4bdc-87f7-9eed2d95960f tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:03.150251 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-1d2e0f99-2206-4bdc-87f7-9eed2d95960f tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2413387 Feb 08 18:22:03.154652 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45714) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:22:03.160482 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-b65389bf-5b11-4a14-a805-140deaa56830 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Request body: {'security_group_rule': {'security_group_id': '0bd697a2-acf0-46fa-9402-7664c0905691', 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:22:03.196940 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-b65389bf-5b11-4a14-a805-140deaa56830 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group_rule (3e87a2d7-a920-4eb4-8954-f33b84b48fa2), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:03.200665 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-cd5f1748-3375-4b78-94e4-238586a36857 req-c340dccc-639a-4d82-928c-74824c68da56 service neutron] 10.222.0.109 "GET /v2.0/networks/bfa2dbfe-1e79-44ee-9df4-62197aec047e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1319406 Feb 08 18:22:03.256125 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-b65389bf-5b11-4a14-a805-140deaa56830 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group_rule (3e87a2d7-a920-4eb4-8954-f33b84b48fa2), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:03.261230 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-b65389bf-5b11-4a14-a805-140deaa56830 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (3e87a2d7-a920-4eb4-8954-f33b84b48fa2), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:03.282946 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-20bec56a-6be2-4b4f-9168-27403348d746 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'name': 'tempest-TestMinimumBasicScenario-1869431064-router', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '227490ec-5281-4713-bf74-27f395237029', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:14Z', 'updated_at': '2022-02-08T18:21:17Z', 'revision_number': 4, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'gw_port': {'id': '227490ec-5281-4713-bf74-27f395237029', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:89:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:15Z', 'updated_at': '2022-02-08T18:21:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '1a0caead-0ec8-4f47-9bf2-c303006ae1f5', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'floating_ip_address': '172.27.1.149', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'port_id': '99a68581-a41f-466f-b6d4-fd8d25cc9536', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 693, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e', 'mac_address': 'fa:16:3e:ef:3b:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd80c03fe-3e2c-4e43-acfd-5b5af96404cc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:22:01Z', 'updated_at': '2022-02-08T18:22:01Z', 'revision_number': 0, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2', 'name': '', 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'mac_address': 'fa:16:3e:ab:a4:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '96b794ac-bea5-4ac6-8b01-835f4cdef825', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:17Z', 'updated_at': '2022-02-08T18:21:21Z', 'revision_number': 5, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'subnets': [{'id': '96b794ac-bea5-4ac6-8b01-835f4cdef825', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:22:03.285131 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-b65389bf-5b11-4a14-a805-140deaa56830 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:03.286466 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-b65389bf-5b11-4a14-a805-140deaa56830 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1306710 Feb 08 18:22:03.287682 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b65389bf-5b11-4a14-a805-140deaa56830 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3e87a2d7-a920-4eb4-8954-f33b84b48fa2,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:22:03.290531 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45716) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:22:03.295216 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-ed85d2a8-3d1a-4c0e-9157-ffc833ff3f5b tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Request body: {'security_group_rule': {'security_group_id': '0bd697a2-acf0-46fa-9402-7664c0905691', 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:22:03.305919 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-cd5f1748-3375-4b78-94e4-238586a36857 req-03e100cb-7970-4e9a-bfdf-c38286642ef1 service neutron] 10.222.0.109 "GET /v2.0/networks/bfa2dbfe-1e79-44ee-9df4-62197aec047e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0988419 Feb 08 18:22:03.312529 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-20bec56a-6be2-4b4f-9168-27403348d746 None None] The sync data for ids ['4840b53c-7786-4bda-8326-dd7d53cf4097'] in dv-cinder-773985-21-iscsi is: [{'id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'name': 'tempest-TestMinimumBasicScenario-1869431064-router', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '227490ec-5281-4713-bf74-27f395237029', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:14Z', 'updated_at': '2022-02-08T18:21:17Z', 'revision_number': 4, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'gw_port': {'id': '227490ec-5281-4713-bf74-27f395237029', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:89:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:15Z', 'updated_at': '2022-02-08T18:21:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_floatingips': [{'id': '1a0caead-0ec8-4f47-9bf2-c303006ae1f5', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'floating_ip_address': '172.27.1.149', 'floating_network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'router_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'port_id': '99a68581-a41f-466f-b6d4-fd8d25cc9536', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 693, 'description': '', 'qos_policy_id': None, 'qos_network_policy_id': None, 'port_details': {'name': '', 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e', 'mac_address': 'fa:16:3e:ef:3b:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd80c03fe-3e2c-4e43-acfd-5b5af96404cc', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2022-02-08T18:22:01Z', 'updated_at': '2022-02-08T18:22:01Z', 'revision_number': 0, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2', 'name': '', 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'mac_address': 'fa:16:3e:ab:a4:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '96b794ac-bea5-4ac6-8b01-835f4cdef825', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:17Z', 'updated_at': '2022-02-08T18:21:21Z', 'revision_number': 5, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'subnets': [{'id': '96b794ac-bea5-4ac6-8b01-835f4cdef825', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:22:03.322303 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-ed85d2a8-3d1a-4c0e-9157-ffc833ff3f5b tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group_rule (fd30065b-df1d-4709-97b4-42130308dc2e), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:03.387153 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-ed85d2a8-3d1a-4c0e-9157-ffc833ff3f5b tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group_rule (fd30065b-df1d-4709-97b4-42130308dc2e), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:03.391793 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-ed85d2a8-3d1a-4c0e-9157-ffc833ff3f5b tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (fd30065b-df1d-4709-97b4-42130308dc2e), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:03.410008 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed85d2a8-3d1a-4c0e-9157-ffc833ff3f5b tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fd30065b-df1d-4709-97b4-42130308dc2e,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:22:03.418732 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-ed85d2a8-3d1a-4c0e-9157-ffc833ff3f5b tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:03.420204 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-ed85d2a8-3d1a-4c0e-9157-ffc833ff3f5b tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.1284485 Feb 08 18:22:03.422998 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45718) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:22:03.427622 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [None req-32e9dd1c-da94-41b8-9a88-ea556897f804 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Request body: {'security_group_rule': {'security_group_id': '0bd697a2-acf0-46fa-9402-7664c0905691', 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:22:03.449017 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.db.securitygroups_db [None req-32e9dd1c-da94-41b8-9a88-ea556897f804 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Project a49c4d8ef7824a87af0bd566f0854d0a added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Feb 08 18:22:03.454658 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-32e9dd1c-da94-41b8-9a88-ea556897f804 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group_rule (19b4b00c-c46a-4f5b-b375-458554a92517), before_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:03.513309 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aeecf081-b03a-4585-a80a-b122d31315c0 None None] New status for floating IP 1a0caead-0ec8-4f47-9bf2-c303006ae1f5: ACTIVE {{(pid=102562) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Feb 08 18:22:03.526333 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-32e9dd1c-da94-41b8-9a88-ea556897f804 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group_rule (19b4b00c-c46a-4f5b-b375-458554a92517), precommit_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:03.530291 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-32e9dd1c-da94-41b8-9a88-ea556897f804 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (19b4b00c-c46a-4f5b-b375-458554a92517), after_create {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:03.550308 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32e9dd1c-da94-41b8-9a88-ea556897f804 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=19b4b00c-c46a-4f5b-b375-458554a92517,revision_number=0']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:22:03.558944 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-32e9dd1c-da94-41b8-9a88-ea556897f804 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:03.562972 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-32e9dd1c-da94-41b8-9a88-ea556897f804 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1361785 Feb 08 18:22:03.562972 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e9dd1c-da94-41b8-9a88-ea556897f804 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.562972 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e9dd1c-da94-41b8-9a88-ea556897f804 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.562972 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e9dd1c-da94-41b8-9a88-ea556897f804 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.562972 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e9dd1c-da94-41b8-9a88-ea556897f804 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.563467 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e9dd1c-da94-41b8-9a88-ea556897f804 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.563612 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e9dd1c-da94-41b8-9a88-ea556897f804 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.563888 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45720) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:22:03.564016 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e9dd1c-da94-41b8-9a88-ea556897f804 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.564256 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e9dd1c-da94-41b8-9a88-ea556897f804 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.564582 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e9dd1c-da94-41b8-9a88-ea556897f804 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.564910 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e9dd1c-da94-41b8-9a88-ea556897f804 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.565239 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e9dd1c-da94-41b8-9a88-ea556897f804 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.565567 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e9dd1c-da94-41b8-9a88-ea556897f804 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.565974 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-32e9dd1c-da94-41b8-9a88-ea556897f804 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.569151 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [None req-eba0ed1e-5778-473c-bd1d-d84bd41e95e0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Request body: {'security_group_rule': {'security_group_id': '0bd697a2-acf0-46fa-9402-7664c0905691', 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:22:03.590654 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.securitygroups_db [None req-eba0ed1e-5778-473c-bd1d-d84bd41e95e0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Project a49c4d8ef7824a87af0bd566f0854d0a added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Feb 08 18:22:03.595589 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-eba0ed1e-5778-473c-bd1d-d84bd41e95e0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group_rule (3486f05d-3b49-45b6-8d0d-b024df4f6bbf), before_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:03.656130 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-eba0ed1e-5778-473c-bd1d-d84bd41e95e0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group_rule (3486f05d-3b49-45b6-8d0d-b024df4f6bbf), precommit_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:03.660210 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-eba0ed1e-5778-473c-bd1d-d84bd41e95e0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586153'] for security_group_rule (3486f05d-3b49-45b6-8d0d-b024df4f6bbf), after_create {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:03.678563 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eba0ed1e-5778-473c-bd1d-d84bd41e95e0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3486f05d-3b49-45b6-8d0d-b024df4f6bbf,revision_number=0']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:22:03.687208 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba0ed1e-5778-473c-bd1d-d84bd41e95e0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.687707 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba0ed1e-5778-473c-bd1d-d84bd41e95e0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.688081 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba0ed1e-5778-473c-bd1d-d84bd41e95e0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.688422 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba0ed1e-5778-473c-bd1d-d84bd41e95e0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.688757 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba0ed1e-5778-473c-bd1d-d84bd41e95e0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.689092 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba0ed1e-5778-473c-bd1d-d84bd41e95e0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.689419 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba0ed1e-5778-473c-bd1d-d84bd41e95e0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.689744 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba0ed1e-5778-473c-bd1d-d84bd41e95e0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.690068 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba0ed1e-5778-473c-bd1d-d84bd41e95e0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.690389 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba0ed1e-5778-473c-bd1d-d84bd41e95e0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.690734 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba0ed1e-5778-473c-bd1d-d84bd41e95e0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.691078 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba0ed1e-5778-473c-bd1d-d84bd41e95e0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.691408 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-eba0ed1e-5778-473c-bd1d-d84bd41e95e0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:22:03.696186 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-eba0ed1e-5778-473c-bd1d-d84bd41e95e0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group_rule (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:03.697290 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-eba0ed1e-5778-473c-bd1d-d84bd41e95e0 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1320550 Feb 08 18:22:03.788062 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5669f4fb-e4b4-499e-8389-da73f6752fe0 req-e59afa0f-9bca-46a8-88a6-ffc0b9f64069 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-79178740&fields=id&tenant_id=a49c4d8ef7824a87af0bd566f0854d0a HTTP/1.1" status: 200 len: 267 time: 0.0457461 Feb 08 18:22:03.846117 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5669f4fb-e4b4-499e-8389-da73f6752fe0 req-f14a763c-757a-4d90-a0bf-07ad84357ace tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:03.848278 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5669f4fb-e4b4-499e-8389-da73f6752fe0 req-f14a763c-757a-4d90-a0bf-07ad84357ace tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 945 time: 0.0539417 Feb 08 18:22:03.858521 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.v2.base [req-5669f4fb-e4b4-499e-8389-da73f6752fe0 req-ecabb1ea-b15a-4a69-907e-db40ff749361 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Request body: {'port': {'security_groups': ['9075e248-9f79-4172-8836-235f98d20c89', '0bd697a2-acf0-46fa-9402-7664c0905691']}} {{(pid=102559) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:22:03.930187 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-5669f4fb-e4b4-499e-8389-da73f6752fe0 req-ecabb1ea-b15a-4a69-907e-db40ff749361 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), before_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:04.116133 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [req-5669f4fb-e4b4-499e-8389-da73f6752fe0 req-ecabb1ea-b15a-4a69-907e-db40ff749361 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] For port 99a68581-a41f-466f-b6d4-fd8d25cc9536, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=99a68581-a41f-466f-b6d4-fd8d25cc9536,segment=NetworkSegment(d7f921a8-081c-445a-b287-4ebec76c43ab),segment_id=d7f921a8-081c-445a-b287-4ebec76c43ab)] {{(pid=102559) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:22:04.151116 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-5669f4fb-e4b4-499e-8389-da73f6752fe0 req-ecabb1ea-b15a-4a69-907e-db40ff749361 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), precommit_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:04.159769 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-5669f4fb-e4b4-499e-8389-da73f6752fe0 req-ecabb1ea-b15a-4a69-907e-db40ff749361 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-63856478'] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), after_update {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:04.173155 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['99a68581-a41f-466f-b6d4-fd8d25cc9536'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:22:04.205518 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5669f4fb-e4b4-499e-8389-da73f6752fe0 req-ecabb1ea-b15a-4a69-907e-db40ff749361 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:04.206158 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [req-5669f4fb-e4b4-499e-8389-da73f6752fe0 req-ecabb1ea-b15a-4a69-907e-db40ff749361 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:04.207572 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-5669f4fb-e4b4-499e-8389-da73f6752fe0 req-ecabb1ea-b15a-4a69-907e-db40ff749361 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "PUT /v2.0/ports/99a68581-a41f-466f-b6d4-fd8d25cc9536 HTTP/1.1" status: 200 len: 981 time: 0.3537652 Feb 08 18:22:04.234917 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecabb1ea-b15a-4a69-907e-db40ff749361 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Pushing event updated for resources: {'Port': ['ID=99a68581-a41f-466f-b6d4-fd8d25cc9536,revision_number=6']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:22:04.274196 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['99a68581-a41f-466f-b6d4-fd8d25cc9536'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:22:04.333716 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49fbff14-4acd-47d4-814a-d8f641ffd756 req-db0a16a8-425c-4d56-b1b0-c0d6e2a11062 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:04.335846 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-49fbff14-4acd-47d4-814a-d8f641ffd756 req-db0a16a8-425c-4d56-b1b0-c0d6e2a11062 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 984 time: 0.0577118 Feb 08 18:22:04.403210 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-49fbff14-4acd-47d4-814a-d8f641ffd756 req-cad11fec-457f-4733-81f3-32770c80de61 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=0bd697a2-acf0-46fa-9402-7664c0905691&id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0582416 Feb 08 18:22:04.552994 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-9175f534-8f60-4210-82b7-b44294a27558 None None] Provisioning complete for port 99a68581-a41f-466f-b6d4-fd8d25cc9536 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:22:04.553366 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-9175f534-8f60-4210-82b7-b44294a27558 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:04.612076 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd80c03fe-3e2c-4e43-acfd-5b5af96404cc', 'tag': '99a68581-a41f-466f-b6d4-fd8d25cc9536'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:22:04.614527 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-02667d55-749c-4886-99c2-92c88fb17d9a" -d '{"events": [{"name": "network-changed", "server_uuid": "d80c03fe-3e2c-4e43-acfd-5b5af96404cc", "tag": "99a68581-a41f-466f-b6d4-fd8d25cc9536"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:22:04.652015 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:22:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-040578d0-ea46-472f-997c-ade951c48efe x-openstack-request-id: req-040578d0-ea46-472f-997c-ade951c48efe {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:22:04.652299 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d80c03fe-3e2c-4e43-acfd-5b5af96404cc", "tag": "99a68581-a41f-466f-b6d4-fd8d25cc9536", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:22:04.652546 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-040578d0-ea46-472f-997c-ade951c48efe {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:22:04.652937 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd80c03fe-3e2c-4e43-acfd-5b5af96404cc', 'tag': '99a68581-a41f-466f-b6d4-fd8d25cc9536', 'status': 'completed', 'code': 200} Feb 08 18:22:04.720396 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02667d55-749c-4886-99c2-92c88fb17d9a req-1e1c3822-31c8-4a2d-8b4b-d14cb197bb67 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:04.721961 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-02667d55-749c-4886-99c2-92c88fb17d9a req-1e1c3822-31c8-4a2d-8b4b-d14cb197bb67 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=a49c4d8ef7824a87af0bd566f0854d0a&device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 1168 time: 0.0484872 Feb 08 18:22:04.755628 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-9175f534-8f60-4210-82b7-b44294a27558 None None] Current status of the port 99a68581-a41f-466f-b6d4-fd8d25cc9536 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:22:04.813118 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02667d55-749c-4886-99c2-92c88fb17d9a req-7d98375c-cdef-4947-a832-30b1e1be2238 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:04.814601 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-02667d55-749c-4886-99c2-92c88fb17d9a req-7d98375c-cdef-4947-a832-30b1e1be2238 service neutron] 10.222.0.109 "GET /v2.0/networks?id=bfa2dbfe-1e79-44ee-9df4-62197aec047e HTTP/1.1" status: 200 len: 917 time: 0.0863333 Feb 08 18:22:04.882265 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-02667d55-749c-4886-99c2-92c88fb17d9a req-74da9122-ed9b-47d3-a755-b83798cde0db service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=99a68581-a41f-466f-b6d4-fd8d25cc9536 HTTP/1.1" status: 200 len: 1001 time: 0.0617869 Feb 08 18:22:04.931365 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02667d55-749c-4886-99c2-92c88fb17d9a req-bf7e4ba0-1135-4fa8-87de-5580e85ffe39 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:04.932762 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-02667d55-749c-4886-99c2-92c88fb17d9a req-bf7e4ba0-1135-4fa8-87de-5580e85ffe39 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=96b794ac-bea5-4ac6-8b01-835f4cdef825 HTTP/1.1" status: 200 len: 854 time: 0.0439062 Feb 08 18:22:04.982201 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02667d55-749c-4886-99c2-92c88fb17d9a req-1f0a2160-0cd7-4160-b159-a2e626c62f28 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:04.983686 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-02667d55-749c-4886-99c2-92c88fb17d9a req-1f0a2160-0cd7-4160-b159-a2e626c62f28 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=bfa2dbfe-1e79-44ee-9df4-62197aec047e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0444982 Feb 08 18:22:05.074151 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-02667d55-749c-4886-99c2-92c88fb17d9a req-47f029df-c366-43a9-be98-f43caa8b9e45 service neutron] 10.222.0.109 "GET /v2.0/networks/bfa2dbfe-1e79-44ee-9df4-62197aec047e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0834017 Feb 08 18:22:05.166788 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-02667d55-749c-4886-99c2-92c88fb17d9a req-d8156e41-e238-43f1-bd31-13ebda4de6db service neutron] 10.222.0.109 "GET /v2.0/networks/bfa2dbfe-1e79-44ee-9df4-62197aec047e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0868244 Feb 08 18:22:15.383756 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-91dc6cb2-e5d8-4305-ae2e-e696f2a51b59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:17.823583 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-eb107577-9732-4080-b87d-a0494e78b40d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:18.096803 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:18.533843 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:20.160949 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:21.694353 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:25.543545 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b9aa9447-66fe-491c-be1e-be8e1d3f0d45 req-518267cf-99b9-4ae6-bdb9-9b7d4d0449e1 service neutron] 10.222.0.109 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0966570 Feb 08 18:22:25.639789 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9aa9447-66fe-491c-be1e-be8e1d3f0d45 req-80108382-4b48-4402-8c2b-e8573de1880b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:25.641318 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b9aa9447-66fe-491c-be1e-be8e1d3f0d45 req-80108382-4b48-4402-8c2b-e8573de1880b service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=c504038b02a545d8a8b1873a4dfee655&device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 1130 time: 0.0524931 Feb 08 18:22:25.999240 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9aa9447-66fe-491c-be1e-be8e1d3f0d45 req-965bd1c3-35b0-432c-befd-43dd75913f94 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:26.000717 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b9aa9447-66fe-491c-be1e-be8e1d3f0d45 req-965bd1c3-35b0-432c-befd-43dd75913f94 service neutron] 10.222.0.109 "GET /v2.0/networks?id=ad3e14dd-35bd-4c6d-8d94-5b851458e927 HTTP/1.1" status: 200 len: 911 time: 0.3359160 Feb 08 18:22:26.067584 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b9aa9447-66fe-491c-be1e-be8e1d3f0d45 req-b539d6d8-79e1-4c64-8529-d724fc8cdd49 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=012af0ea-fa3b-4267-a4da-80c767055b16 HTTP/1.1" status: 200 len: 1002 time: 0.0603848 Feb 08 18:22:26.113928 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9aa9447-66fe-491c-be1e-be8e1d3f0d45 req-e2b20349-b345-4ac8-9d08-41c9d1997bb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:26.115365 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b9aa9447-66fe-491c-be1e-be8e1d3f0d45 req-e2b20349-b345-4ac8-9d08-41c9d1997bb9 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=58f829ef-859d-415d-b810-791456a616fc HTTP/1.1" status: 200 len: 848 time: 0.0424392 Feb 08 18:22:26.164950 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9aa9447-66fe-491c-be1e-be8e1d3f0d45 req-dec8c6b9-2a00-46a4-ac00-73a9328f230a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:26.166468 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b9aa9447-66fe-491c-be1e-be8e1d3f0d45 req-dec8c6b9-2a00-46a4-ac00-73a9328f230a service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=ad3e14dd-35bd-4c6d-8d94-5b851458e927&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0446422 Feb 08 18:22:26.176357 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [req-b9aa9447-66fe-491c-be1e-be8e1d3f0d45 req-cbcdb441-6eed-49a6-b41f-813f726a0202 service neutron] http://10.222.0.118:9696/v2.0/extensions returned with HTTP 200 {{(pid=102560) __call__ /opt/stack/neutron/neutron/wsgi.py:730}} Feb 08 18:22:26.177262 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b9aa9447-66fe-491c-be1e-be8e1d3f0d45 req-cbcdb441-6eed-49a6-b41f-813f726a0202 service neutron] 10.222.0.109 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0048113 Feb 08 18:22:26.280213 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b9aa9447-66fe-491c-be1e-be8e1d3f0d45 req-e0a79ee8-aedf-408f-8b58-40bd90b3015a service neutron] 10.222.0.109 "GET /v2.0/networks/ad3e14dd-35bd-4c6d-8d94-5b851458e927?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0966699 Feb 08 18:22:26.371740 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-b9aa9447-66fe-491c-be1e-be8e1d3f0d45 req-68001780-e6bb-45f3-9552-c87e04fdbea7 service neutron] 10.222.0.109 "GET /v2.0/networks/ad3e14dd-35bd-4c6d-8d94-5b851458e927?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0861666 Feb 08 18:22:27.300000 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bb15a87-ab8f-4aea-aca6-c15131b8f91c req-4fa99e02-ed0c-479a-99cd-1854363d8531 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:27.301552 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4bb15a87-ab8f-4aea-aca6-c15131b8f91c req-4fa99e02-ed0c-479a-99cd-1854363d8531 service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=a49c4d8ef7824a87af0bd566f0854d0a&device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 1168 time: 0.0463128 Feb 08 18:22:27.395344 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bb15a87-ab8f-4aea-aca6-c15131b8f91c req-14552674-d533-484d-b097-907bd4fa3c94 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:27.396869 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4bb15a87-ab8f-4aea-aca6-c15131b8f91c req-14552674-d533-484d-b097-907bd4fa3c94 service neutron] 10.222.0.109 "GET /v2.0/networks?id=bfa2dbfe-1e79-44ee-9df4-62197aec047e HTTP/1.1" status: 200 len: 917 time: 0.0889468 Feb 08 18:22:27.408402 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fcc1075-c8a0-4cfb-911c-c9e0d8912ef2 req-731d6075-1a2c-46b6-b1f2-5738ff9d0763 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:27.409886 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-4fcc1075-c8a0-4cfb-911c-c9e0d8912ef2 req-731d6075-1a2c-46b6-b1f2-5738ff9d0763 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 984 time: 0.1672475 Feb 08 18:22:27.461997 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4bb15a87-ab8f-4aea-aca6-c15131b8f91c req-004c829b-298e-46e2-9f21-ead744e05963 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=99a68581-a41f-466f-b6d4-fd8d25cc9536 HTTP/1.1" status: 200 len: 1001 time: 0.0587695 Feb 08 18:22:27.469102 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-4fcc1075-c8a0-4cfb-911c-c9e0d8912ef2 req-23712e0b-4dc2-4efe-b2aa-c9bb2587b330 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=0bd697a2-acf0-46fa-9402-7664c0905691&id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0529885 Feb 08 18:22:27.516661 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bb15a87-ab8f-4aea-aca6-c15131b8f91c req-305ae615-26d8-4384-8bf7-554107010cd7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:27.518117 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4bb15a87-ab8f-4aea-aca6-c15131b8f91c req-305ae615-26d8-4384-8bf7-554107010cd7 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=96b794ac-bea5-4ac6-8b01-835f4cdef825 HTTP/1.1" status: 200 len: 854 time: 0.0488625 Feb 08 18:22:27.569057 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4bb15a87-ab8f-4aea-aca6-c15131b8f91c req-bb8ad7f0-b6bf-4f5f-987f-219a15e0e4f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:27.570444 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4bb15a87-ab8f-4aea-aca6-c15131b8f91c req-bb8ad7f0-b6bf-4f5f-987f-219a15e0e4f6 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=bfa2dbfe-1e79-44ee-9df4-62197aec047e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0451536 Feb 08 18:22:27.660037 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4bb15a87-ab8f-4aea-aca6-c15131b8f91c req-49a6dd87-0be9-4d8d-8fd8-210d377159af service neutron] 10.222.0.109 "GET /v2.0/networks/bfa2dbfe-1e79-44ee-9df4-62197aec047e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0829325 Feb 08 18:22:27.760019 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-4bb15a87-ab8f-4aea-aca6-c15131b8f91c req-4732c6ea-bfb3-4ba9-874b-09f7efef36dc service neutron] 10.222.0.109 "GET /v2.0/networks/bfa2dbfe-1e79-44ee-9df4-62197aec047e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0934780 Feb 08 18:22:28.660034 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7f95115-22b7-4b39-8c54-91e9da609558 req-ace26b86-04e5-487b-b4c8-926023518559 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:28.661534 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c7f95115-22b7-4b39-8c54-91e9da609558 req-ace26b86-04e5-487b-b4c8-926023518559 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 984 time: 0.1123681 Feb 08 18:22:28.723195 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c7f95115-22b7-4b39-8c54-91e9da609558 req-6dcb9cb9-3ef8-4fda-8ed1-997b6f8c561a tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=0bd697a2-acf0-46fa-9402-7664c0905691&id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0532739 Feb 08 18:22:29.861659 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e14e002f-caf2-41c9-aab1-7f6f2400ed89 req-4e811080-d357-4337-8430-0e743e9ba122 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:29.863166 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e14e002f-caf2-41c9-aab1-7f6f2400ed89 req-4e811080-d357-4337-8430-0e743e9ba122 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 984 time: 0.0616572 Feb 08 18:22:29.922678 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-e14e002f-caf2-41c9-aab1-7f6f2400ed89 req-3d8076ff-5bc2-4612-a812-5741eaa309d3 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=0bd697a2-acf0-46fa-9402-7664c0905691&id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0537317 Feb 08 18:22:31.054422 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84196c8d-0e16-4116-aa06-8facb6294426 req-1344aebf-3aea-4681-b168-d83cfc15ad4e tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:31.055949 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-84196c8d-0e16-4116-aa06-8facb6294426 req-1344aebf-3aea-4681-b168-d83cfc15ad4e tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 984 time: 0.0606184 Feb 08 18:22:31.116310 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-84196c8d-0e16-4116-aa06-8facb6294426 req-ec63ef20-4abb-4dea-ae02-69554109bbf6 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=0bd697a2-acf0-46fa-9402-7664c0905691&id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0543907 Feb 08 18:22:32.007398 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:22:32.248321 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd0fd669-d094-4de0-9686-72af4b4c84a9 req-6c5e5c1f-51a5-4af6-9711-0ea817d08578 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:32.249788 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-fd0fd669-d094-4de0-9686-72af4b4c84a9 req-6c5e5c1f-51a5-4af6-9711-0ea817d08578 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 984 time: 0.0550721 Feb 08 18:22:32.314487 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-fd0fd669-d094-4de0-9686-72af4b4c84a9 req-ed9902f0-9523-4772-9f99-a7a3591794a6 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=0bd697a2-acf0-46fa-9402-7664c0905691&id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0587204 Feb 08 18:22:33.451343 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1afb2af8-4c2d-4853-bedf-4d076b5a4514 req-f14eb394-08fe-4e0f-9637-75e563990c76 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:33.452851 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1afb2af8-4c2d-4853-bedf-4d076b5a4514 req-f14eb394-08fe-4e0f-9637-75e563990c76 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 984 time: 0.0612161 Feb 08 18:22:33.510581 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-1afb2af8-4c2d-4853-bedf-4d076b5a4514 req-81d396f1-fbb6-497c-af13-8466fcd80902 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=0bd697a2-acf0-46fa-9402-7664c0905691&id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0518754 Feb 08 18:22:34.644941 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2dba5dcb-fe6e-4b06-b523-674c1f6a39c0 req-beaadd7c-7b71-462e-a5dd-42bc93ece4f6 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:34.646570 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2dba5dcb-fe6e-4b06-b523-674c1f6a39c0 req-beaadd7c-7b71-462e-a5dd-42bc93ece4f6 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 984 time: 0.0557885 Feb 08 18:22:34.707807 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-2dba5dcb-fe6e-4b06-b523-674c1f6a39c0 req-6c39caee-689d-49f8-a9f1-7b03b051889c tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=0bd697a2-acf0-46fa-9402-7664c0905691&id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0554748 Feb 08 18:22:35.841104 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccf0bac7-dedc-4e30-ba11-48c8f0831044 req-8c9e7dde-c976-4dd7-aa79-442eee799dcc tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:35.842853 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ccf0bac7-dedc-4e30-ba11-48c8f0831044 req-8c9e7dde-c976-4dd7-aa79-442eee799dcc tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 984 time: 0.0642450 Feb 08 18:22:35.905567 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-ccf0bac7-dedc-4e30-ba11-48c8f0831044 req-b8d47db5-d514-4dff-9125-ca1a95b9660d tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=0bd697a2-acf0-46fa-9402-7664c0905691&id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0567181 Feb 08 18:22:37.035395 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-868a2fe4-46a3-4f1c-807c-52b5f9011981 req-b588afdf-ec68-4b0d-84e7-8d86e60578d3 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:37.036923 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-868a2fe4-46a3-4f1c-807c-52b5f9011981 req-b588afdf-ec68-4b0d-84e7-8d86e60578d3 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 984 time: 0.0590589 Feb 08 18:22:37.097839 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-868a2fe4-46a3-4f1c-807c-52b5f9011981 req-eb6a25a3-afcd-4e49-b6cf-d175b8e0212a tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=0bd697a2-acf0-46fa-9402-7664c0905691&id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0547717 Feb 08 18:22:38.227282 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c549d66d-7c10-44f2-a584-5d97068257ed req-d67872fb-444e-41ac-a306-257d49b6052d tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:38.228755 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c549d66d-7c10-44f2-a584-5d97068257ed req-d67872fb-444e-41ac-a306-257d49b6052d tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 984 time: 0.0596600 Feb 08 18:22:38.309110 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-c549d66d-7c10-44f2-a584-5d97068257ed req-28a7a62d-3972-4a83-8838-f011d69bf184 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=0bd697a2-acf0-46fa-9402-7664c0905691&id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0741107 Feb 08 18:22:39.448531 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72f3d8be-da07-4a8f-821a-c7ca992c0212 req-92de12dc-05d4-4086-9255-e725aa21a61a tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:39.450013 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-72f3d8be-da07-4a8f-821a-c7ca992c0212 req-92de12dc-05d4-4086-9255-e725aa21a61a tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 984 time: 0.0603132 Feb 08 18:22:39.511400 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-72f3d8be-da07-4a8f-821a-c7ca992c0212 req-87caedc1-f05b-43f7-81d2-1ac824d79d9e tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=0bd697a2-acf0-46fa-9402-7664c0905691&id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0534775 Feb 08 18:22:40.646101 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-681869a0-76fd-4aab-b0d9-6da629df2fb9 req-39e28097-e030-43e0-9169-4b790372cad3 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:40.648302 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-681869a0-76fd-4aab-b0d9-6da629df2fb9 req-39e28097-e030-43e0-9169-4b790372cad3 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 984 time: 0.0550399 Feb 08 18:22:40.711042 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-681869a0-76fd-4aab-b0d9-6da629df2fb9 req-5b2d157a-4bdc-4d2b-919b-7de0c64a2915 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=0bd697a2-acf0-46fa-9402-7664c0905691&id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0545850 Feb 08 18:22:41.853690 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e27e815-f3cd-4619-b7bb-e4a106efa66c req-96e5dcfa-fd00-436b-b7dc-f32040e06fa9 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:41.855253 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8e27e815-f3cd-4619-b7bb-e4a106efa66c req-96e5dcfa-fd00-436b-b7dc-f32040e06fa9 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 984 time: 0.0569096 Feb 08 18:22:41.916544 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-8e27e815-f3cd-4619-b7bb-e4a106efa66c req-da9b7039-3652-4b7d-889e-9f473aeb485e tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=0bd697a2-acf0-46fa-9402-7664c0905691&id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0532827 Feb 08 18:22:43.051431 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-046f6226-aadd-4ca4-852a-30f713346c26 req-77f2c381-c297-4ce0-86d9-3d252903dfe6 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:43.052914 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-046f6226-aadd-4ca4-852a-30f713346c26 req-77f2c381-c297-4ce0-86d9-3d252903dfe6 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 984 time: 0.0602736 Feb 08 18:22:43.115845 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-046f6226-aadd-4ca4-852a-30f713346c26 req-d4c5ee48-2d9e-42e5-9c61-59c7ecc9dc30 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=0bd697a2-acf0-46fa-9402-7664c0905691&id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0543046 Feb 08 18:22:44.236739 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f67f3c1-c0c6-4155-b9a9-e50355b56a1b req-0c74a484-b8bf-4ef6-a7a1-23edd758bcd9 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:22:44.238219 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6f67f3c1-c0c6-4155-b9a9-e50355b56a1b req-0c74a484-b8bf-4ef6-a7a1-23edd758bcd9 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 984 time: 0.0543168 Feb 08 18:22:44.310436 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-6f67f3c1-c0c6-4155-b9a9-e50355b56a1b req-8ef69c10-47d3-4625-9fdd-25c96b9992d1 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=0bd697a2-acf0-46fa-9402-7664c0905691&id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 378 time: 0.0631998 Feb 08 18:22:45.399049 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bbbc862d-5e29-4998-8409-01d8201a61e1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:47.827540 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-1ee53142-3c06-4715-a441-49f3b361a612 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:48.120774 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:48.541765 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:50.158506 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:22:51.691996 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:09.012131 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:23:15.389231 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-5427a117-aba1-4aae-90cc-09efce27278f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:16.398825 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5e45e196-f3fe-4c35-9823-b42be3bfb7c4 req-1174d350-d19c-44c2-b8c4-024ce6b09da2 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-79178740&fields=id&tenant_id=a49c4d8ef7824a87af0bd566f0854d0a HTTP/1.1" status: 200 len: 267 time: 0.0468991 Feb 08 18:23:16.457447 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e45e196-f3fe-4c35-9823-b42be3bfb7c4 req-2af90e82-4453-42fb-b071-20efcc564ecc tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:23:16.458942 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5e45e196-f3fe-4c35-9823-b42be3bfb7c4 req-2af90e82-4453-42fb-b071-20efcc564ecc tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 984 time: 0.0525289 Feb 08 18:23:16.469876 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.v2.base [req-5e45e196-f3fe-4c35-9823-b42be3bfb7c4 req-2d7b51a0-cafe-4c9b-b9e8-7d812b9452ae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Request body: {'port': {'security_groups': ['9075e248-9f79-4172-8836-235f98d20c89']}} {{(pid=102560) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Feb 08 18:23:16.546144 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-5e45e196-f3fe-4c35-9823-b42be3bfb7c4 req-2d7b51a0-cafe-4c9b-b9e8-7d812b9452ae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1768090'] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), before_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:16.722057 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-5e45e196-f3fe-4c35-9823-b42be3bfb7c4 req-2d7b51a0-cafe-4c9b-b9e8-7d812b9452ae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] For port 99a68581-a41f-466f-b6d4-fd8d25cc9536, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=99a68581-a41f-466f-b6d4-fd8d25cc9536,segment=NetworkSegment(d7f921a8-081c-445a-b287-4ebec76c43ab),segment_id=d7f921a8-081c-445a-b287-4ebec76c43ab)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:23:16.750719 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-5e45e196-f3fe-4c35-9823-b42be3bfb7c4 req-2d7b51a0-cafe-4c9b-b9e8-7d812b9452ae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), precommit_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:16.757277 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-5e45e196-f3fe-4c35-9823-b42be3bfb7c4 req-2d7b51a0-cafe-4c9b-b9e8-7d812b9452ae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8770559041549', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8770558538451', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8770558538469', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-64531588'] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), after_update {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:16.770997 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['99a68581-a41f-466f-b6d4-fd8d25cc9536'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:23:16.804930 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e45e196-f3fe-4c35-9823-b42be3bfb7c4 req-2d7b51a0-cafe-4c9b-b9e8-7d812b9452ae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:23:16.805569 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-5e45e196-f3fe-4c35-9823-b42be3bfb7c4 req-2d7b51a0-cafe-4c9b-b9e8-7d812b9452ae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:16.807006 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5e45e196-f3fe-4c35-9823-b42be3bfb7c4 req-2d7b51a0-cafe-4c9b-b9e8-7d812b9452ae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "PUT /v2.0/ports/99a68581-a41f-466f-b6d4-fd8d25cc9536 HTTP/1.1" status: 200 len: 942 time: 0.3418460 Feb 08 18:23:16.807522 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd80c03fe-3e2c-4e43-acfd-5b5af96404cc', 'tag': '99a68581-a41f-466f-b6d4-fd8d25cc9536'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:23:16.810012 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0cab2103-be51-4d20-97c6-7fe399a3f52d" -d '{"events": [{"name": "network-changed", "server_uuid": "d80c03fe-3e2c-4e43-acfd-5b5af96404cc", "tag": "99a68581-a41f-466f-b6d4-fd8d25cc9536"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:23:16.813204 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45796) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:23:16.836250 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d7b51a0-cafe-4c9b-b9e8-7d812b9452ae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Pushing event updated for resources: {'Port': ['ID=99a68581-a41f-466f-b6d4-fd8d25cc9536,revision_number=7']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:23:16.852314 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d7b51a0-cafe-4c9b-b9e8-7d812b9452ae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:16.852875 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d7b51a0-cafe-4c9b-b9e8-7d812b9452ae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:16.853004 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d7b51a0-cafe-4c9b-b9e8-7d812b9452ae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:16.853340 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d7b51a0-cafe-4c9b-b9e8-7d812b9452ae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:16.853783 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d7b51a0-cafe-4c9b-b9e8-7d812b9452ae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:16.854114 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d7b51a0-cafe-4c9b-b9e8-7d812b9452ae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:16.854454 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d7b51a0-cafe-4c9b-b9e8-7d812b9452ae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:16.854847 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d7b51a0-cafe-4c9b-b9e8-7d812b9452ae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:16.855490 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d7b51a0-cafe-4c9b-b9e8-7d812b9452ae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:16.855837 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d7b51a0-cafe-4c9b-b9e8-7d812b9452ae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:16.856169 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d7b51a0-cafe-4c9b-b9e8-7d812b9452ae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:16.856621 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d7b51a0-cafe-4c9b-b9e8-7d812b9452ae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:16.856951 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d7b51a0-cafe-4c9b-b9e8-7d812b9452ae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:16.894198 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-ee40fbf4-604d-42f6-b858-86223e52b5be tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group (0bd697a2-acf0-46fa-9402-7664c0905691), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:16.901744 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['99a68581-a41f-466f-b6d4-fd8d25cc9536'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:23:16.922598 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-ee40fbf4-604d-42f6-b858-86223e52b5be tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group (0bd697a2-acf0-46fa-9402-7664c0905691), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:16.949822 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:23:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7434347c-0469-408d-ba12-33c4e9283280 x-openstack-request-id: req-7434347c-0469-408d-ba12-33c4e9283280 {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:23:16.950043 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d80c03fe-3e2c-4e43-acfd-5b5af96404cc", "tag": "99a68581-a41f-466f-b6d4-fd8d25cc9536", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:23:16.950308 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-7434347c-0469-408d-ba12-33c4e9283280 {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:23:16.950716 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd80c03fe-3e2c-4e43-acfd-5b5af96404cc', 'tag': '99a68581-a41f-466f-b6d4-fd8d25cc9536', 'status': 'completed', 'code': 200} Feb 08 18:23:16.995787 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-ee40fbf4-604d-42f6-b858-86223e52b5be tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (0bd697a2-acf0-46fa-9402-7664c0905691), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:16.998953 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-ee40fbf4-604d-42f6-b858-86223e52b5be tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:17.000236 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-ee40fbf4-604d-42f6-b858-86223e52b5be tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "DELETE /v2.0/security-groups/0bd697a2-acf0-46fa-9402-7664c0905691 HTTP/1.1" status: 204 len: 168 time: 0.1859488 Feb 08 18:23:17.003848 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45800) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:23:17.042355 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cab2103-be51-4d20-97c6-7fe399a3f52d req-9983a1ec-634d-4f80-8973-cfa46111bf7c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:23:17.044216 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0cab2103-be51-4d20-97c6-7fe399a3f52d req-9983a1ec-634d-4f80-8973-cfa46111bf7c service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=a49c4d8ef7824a87af0bd566f0854d0a&device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 1129 time: 0.0687232 Feb 08 18:23:17.058031 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ee40fbf4-604d-42f6-b858-86223e52b5be tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=0bd697a2-acf0-46fa-9402-7664c0905691,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:23:17.074627 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee40fbf4-604d-42f6-b858-86223e52b5be tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:17.075787 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee40fbf4-604d-42f6-b858-86223e52b5be tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:17.076326 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee40fbf4-604d-42f6-b858-86223e52b5be tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:17.076673 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee40fbf4-604d-42f6-b858-86223e52b5be tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:17.077016 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee40fbf4-604d-42f6-b858-86223e52b5be tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:17.077353 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee40fbf4-604d-42f6-b858-86223e52b5be tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:17.077886 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee40fbf4-604d-42f6-b858-86223e52b5be tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:17.078226 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee40fbf4-604d-42f6-b858-86223e52b5be tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:17.078562 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee40fbf4-604d-42f6-b858-86223e52b5be tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:17.078930 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee40fbf4-604d-42f6-b858-86223e52b5be tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:17.079265 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee40fbf4-604d-42f6-b858-86223e52b5be tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:17.079598 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee40fbf4-604d-42f6-b858-86223e52b5be tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:17.080118 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ee40fbf4-604d-42f6-b858-86223e52b5be tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:17.112014 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.provisioning_blocks [None req-69fcd90a-5692-460e-8756-a81f1335c085 None None] Provisioning complete for port 99a68581-a41f-466f-b6d4-fd8d25cc9536 triggered by entity DHCP. {{(pid=102561) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Feb 08 18:23:17.112567 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-69fcd90a-5692-460e-8756-a81f1335c085 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-1723597'] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), provisioning_complete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:17.143312 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cab2103-be51-4d20-97c6-7fe399a3f52d req-c111da73-2353-4203-b361-543dfd323389 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:23:17.144895 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0cab2103-be51-4d20-97c6-7fe399a3f52d req-c111da73-2353-4203-b361-543dfd323389 service neutron] 10.222.0.109 "GET /v2.0/networks?id=bfa2dbfe-1e79-44ee-9df4-62197aec047e HTTP/1.1" status: 200 len: 917 time: 0.0942235 Feb 08 18:23:17.193458 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-69fcd90a-5692-460e-8756-a81f1335c085 None None] Current status of the port 99a68581-a41f-466f-b6d4-fd8d25cc9536 is: ACTIVE; New status is: ACTIVE {{(pid=102561) _update_individual_port_db_status /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2232}} Feb 08 18:23:17.210151 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0cab2103-be51-4d20-97c6-7fe399a3f52d req-11dd2b53-b118-4b8b-87d7-acd48a820718 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=99a68581-a41f-466f-b6d4-fd8d25cc9536 HTTP/1.1" status: 200 len: 1001 time: 0.0589330 Feb 08 18:23:17.214550 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-7d7dbdac-1eef-4c84-9465-c94708729b57 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Deleting port ffdb317d-dfa5-4733-bdd4-81b145da0942 {{(pid=102559) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:23:17.214938 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7d7dbdac-1eef-4c84-9465-c94708729b57 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (ffdb317d-dfa5-4733-bdd4-81b145da0942), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:17.257324 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cab2103-be51-4d20-97c6-7fe399a3f52d req-c9400daa-8a7d-43bf-9d3d-fe91b956c865 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:23:17.258672 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0cab2103-be51-4d20-97c6-7fe399a3f52d req-c9400daa-8a7d-43bf-9d3d-fe91b956c865 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=96b794ac-bea5-4ac6-8b01-835f4cdef825 HTTP/1.1" status: 200 len: 854 time: 0.0420380 Feb 08 18:23:17.292838 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7d7dbdac-1eef-4c84-9465-c94708729b57 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (ffdb317d-dfa5-4733-bdd4-81b145da0942), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:17.293179 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7d7dbdac-1eef-4c84-9465-c94708729b57 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for floatingip (ffdb317d-dfa5-4733-bdd4-81b145da0942), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:17.305529 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-7d7dbdac-1eef-4c84-9465-c94708729b57 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Calling delete_port for ffdb317d-dfa5-4733-bdd4-81b145da0942 owned by network:floatingip {{(pid=102559) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:23:17.312449 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cab2103-be51-4d20-97c6-7fe399a3f52d req-6dc54e6b-4dcf-4f7f-b554-2ce618635ca6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:23:17.313985 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0cab2103-be51-4d20-97c6-7fe399a3f52d req-6dc54e6b-4dcf-4f7f-b554-2ce618635ca6 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=bfa2dbfe-1e79-44ee-9df4-62197aec047e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0487268 Feb 08 18:23:17.400142 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0cab2103-be51-4d20-97c6-7fe399a3f52d req-b071c40f-503d-42c7-be3b-03c2acf92fd4 service neutron] 10.222.0.109 "GET /v2.0/networks/bfa2dbfe-1e79-44ee-9df4-62197aec047e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0802219 Feb 08 18:23:17.453860 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7d7dbdac-1eef-4c84-9465-c94708729b57 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (ffdb317d-dfa5-4733-bdd4-81b145da0942), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:17.478902 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d7dbdac-1eef-4c84-9465-c94708729b57 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Pushing event deleted for resources: {'Port': ['ID=ffdb317d-dfa5-4733-bdd4-81b145da0942,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:23:17.498325 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-0cab2103-be51-4d20-97c6-7fe399a3f52d req-9fb4fae2-e612-47ee-b237-8180e7549979 service neutron] 10.222.0.109 "GET /v2.0/networks/bfa2dbfe-1e79-44ee-9df4-62197aec047e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0916364 Feb 08 18:23:17.541604 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7d7dbdac-1eef-4c84-9465-c94708729b57 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks [] for floatingip (1a0caead-0ec8-4f47-9bf2-c303006ae1f5), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:17.541832 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.db.l3_db [None req-7d7dbdac-1eef-4c84-9465-c94708729b57 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Floating IP 1a0caead-0ec8-4f47-9bf2-c303006ae1f5 disassociated (deleted). External IP: 172.27.1.149, port: 99a68581-a41f-466f-b6d4-fd8d25cc9536. Feb 08 18:23:17.764278 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7d7dbdac-1eef-4c84-9465-c94708729b57 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Router 4840b53c-7786-4bda-8326-dd7d53cf4097 has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102559) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:23:17.833827 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-e5ab75c2-88ef-4d6a-94a0-e61d1209887d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:17.885094 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7d7dbdac-1eef-4c84-9465-c94708729b57 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102559) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:23:17.889925 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-7d7dbdac-1eef-4c84-9465-c94708729b57 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for floatingip (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:17.895967 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f516bdca-536f-4bf3-8314-9d3a88b32700 None None] Sync routers for ids ['4840b53c-7786-4bda-8326-dd7d53cf4097'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:23:17.906450 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f516bdca-536f-4bf3-8314-9d3a88b32700 None None] Routers {'4840b53c-7786-4bda-8326-dd7d53cf4097'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:23:17.907094 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-f516bdca-536f-4bf3-8314-9d3a88b32700 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:23:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['4840b53c-7786-4bda-8326-dd7d53cf4097'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:23:17.922362 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-7d7dbdac-1eef-4c84-9465-c94708729b57 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "DELETE /v2.0/floatingips/1a0caead-0ec8-4f47-9bf2-c303006ae1f5 HTTP/1.1" status: 204 len: 168 time: 0.9165192 Feb 08 18:23:17.922984 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd80c03fe-3e2c-4e43-acfd-5b5af96404cc', 'tag': '99a68581-a41f-466f-b6d4-fd8d25cc9536'}] {{(pid=102559) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:23:17.925233 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}2807b350cce5d86d5ed915fe96da494f5d00b50804c5b07a733ab8df5b1b25c2" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5607fc71-7c20-49da-8863-552920130444" -d '{"events": [{"name": "network-changed", "server_uuid": "d80c03fe-3e2c-4e43-acfd-5b5af96404cc", "tag": "99a68581-a41f-466f-b6d4-fd8d25cc9536"}]}' {{(pid=102559) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:23:17.963001 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:23:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8fedbc35-03ee-450c-a3b4-a983a3d14dcc x-openstack-request-id: req-8fedbc35-03ee-450c-a3b4-a983a3d14dcc {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:23:17.963286 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d80c03fe-3e2c-4e43-acfd-5b5af96404cc", "tag": "99a68581-a41f-466f-b6d4-fd8d25cc9536", "status": "completed", "code": 200}]} {{(pid=102559) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:23:17.963547 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-8fedbc35-03ee-450c-a3b4-a983a3d14dcc {{(pid=102559) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:23:17.963988 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd80c03fe-3e2c-4e43-acfd-5b5af96404cc', 'tag': '99a68581-a41f-466f-b6d4-fd8d25cc9536', 'status': 'completed', 'code': 200} Feb 08 18:23:18.044047 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5607fc71-7c20-49da-8863-552920130444 req-5292c248-cdf1-4401-9be2-6386c153278c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:23:18.045594 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5607fc71-7c20-49da-8863-552920130444 req-5292c248-cdf1-4401-9be2-6386c153278c service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=a49c4d8ef7824a87af0bd566f0854d0a&device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 1129 time: 0.0598075 Feb 08 18:23:18.150309 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5607fc71-7c20-49da-8863-552920130444 req-e5f443e0-e4a5-4433-9679-4e05e54cbeff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:23:18.152075 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5607fc71-7c20-49da-8863-552920130444 req-e5f443e0-e4a5-4433-9679-4e05e54cbeff service neutron] 10.222.0.109 "GET /v2.0/networks?id=bfa2dbfe-1e79-44ee-9df4-62197aec047e HTTP/1.1" status: 200 len: 917 time: 0.1008162 Feb 08 18:23:18.171882 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:18.203414 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5607fc71-7c20-49da-8863-552920130444 req-a23d32bc-cee0-48b2-bed7-4d50db0e5fec service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=99a68581-a41f-466f-b6d4-fd8d25cc9536 HTTP/1.1" status: 200 len: 217 time: 0.0405223 Feb 08 18:23:18.208453 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-f516bdca-536f-4bf3-8314-9d3a88b32700 None None] Set router 4840b53c-7786-4bda-8326-dd7d53cf4097 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:23:18.250658 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5607fc71-7c20-49da-8863-552920130444 req-eda0221b-6449-4f46-96e1-51b18ff888b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:23:18.252191 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5607fc71-7c20-49da-8863-552920130444 req-eda0221b-6449-4f46-96e1-51b18ff888b7 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=96b794ac-bea5-4ac6-8b01-835f4cdef825 HTTP/1.1" status: 200 len: 854 time: 0.0438423 Feb 08 18:23:18.301410 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5607fc71-7c20-49da-8863-552920130444 req-82671005-6cd4-496e-b098-4bec41c20fda service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:23:18.302941 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5607fc71-7c20-49da-8863-552920130444 req-82671005-6cd4-496e-b098-4bec41c20fda service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=bfa2dbfe-1e79-44ee-9df4-62197aec047e&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0452559 Feb 08 18:23:18.391603 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5607fc71-7c20-49da-8863-552920130444 req-6514f5b4-5490-43dd-a690-d715c02d9e92 service neutron] 10.222.0.109 "GET /v2.0/networks/bfa2dbfe-1e79-44ee-9df4-62197aec047e?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0822825 Feb 08 18:23:18.421523 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-f516bdca-536f-4bf3-8314-9d3a88b32700 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'name': 'tempest-TestMinimumBasicScenario-1869431064-router', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '227490ec-5281-4713-bf74-27f395237029', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:14Z', 'updated_at': '2022-02-08T18:21:17Z', 'revision_number': 4, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'gw_port': {'id': '227490ec-5281-4713-bf74-27f395237029', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:89:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:15Z', 'updated_at': '2022-02-08T18:21:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2', 'name': '', 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'mac_address': 'fa:16:3e:ab:a4:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '96b794ac-bea5-4ac6-8b01-835f4cdef825', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:17Z', 'updated_at': '2022-02-08T18:21:21Z', 'revision_number': 5, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'subnets': [{'id': '96b794ac-bea5-4ac6-8b01-835f4cdef825', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:23:18.447450 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f516bdca-536f-4bf3-8314-9d3a88b32700 None None] Checking router: 4840b53c-7786-4bda-8326-dd7d53cf4097 for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:23:18.456426 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f516bdca-536f-4bf3-8314-9d3a88b32700 None None] Routers {'4840b53c-7786-4bda-8326-dd7d53cf4097'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:23:18.457038 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-f516bdca-536f-4bf3-8314-9d3a88b32700 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:23:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['4840b53c-7786-4bda-8326-dd7d53cf4097'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:23:18.479989 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-5607fc71-7c20-49da-8863-552920130444 req-bbb29c92-4dbc-40ad-aec2-3859b26ac992 service neutron] 10.222.0.109 "GET /v2.0/networks/bfa2dbfe-1e79-44ee-9df4-62197aec047e?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0809975 Feb 08 18:23:18.543109 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:18.576308 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-f516bdca-536f-4bf3-8314-9d3a88b32700 None None] Set router 4840b53c-7786-4bda-8326-dd7d53cf4097 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:23:18.780515 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-f516bdca-536f-4bf3-8314-9d3a88b32700 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'name': 'tempest-TestMinimumBasicScenario-1869431064-router', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '227490ec-5281-4713-bf74-27f395237029', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:14Z', 'updated_at': '2022-02-08T18:21:17Z', 'revision_number': 4, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'gw_port': {'id': '227490ec-5281-4713-bf74-27f395237029', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:89:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:15Z', 'updated_at': '2022-02-08T18:21:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2', 'name': '', 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'mac_address': 'fa:16:3e:ab:a4:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '96b794ac-bea5-4ac6-8b01-835f4cdef825', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:17Z', 'updated_at': '2022-02-08T18:21:21Z', 'revision_number': 5, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'subnets': [{'id': '96b794ac-bea5-4ac6-8b01-835f4cdef825', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:23:18.810831 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f516bdca-536f-4bf3-8314-9d3a88b32700 None None] The sync data for ids ['4840b53c-7786-4bda-8326-dd7d53cf4097'] in dv-cinder-773985-21-iscsi is: [{'id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'name': 'tempest-TestMinimumBasicScenario-1869431064-router', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '227490ec-5281-4713-bf74-27f395237029', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:14Z', 'updated_at': '2022-02-08T18:21:17Z', 'revision_number': 4, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'gw_port': {'id': '227490ec-5281-4713-bf74-27f395237029', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:89:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:15Z', 'updated_at': '2022-02-08T18:21:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': '23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2', 'name': '', 'network_id': 'bfa2dbfe-1e79-44ee-9df4-62197aec047e', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'mac_address': 'fa:16:3e:ab:a4:9e', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '96b794ac-bea5-4ac6-8b01-835f4cdef825', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:17Z', 'updated_at': '2022-02-08T18:21:21Z', 'revision_number': 5, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'subnets': [{'id': '96b794ac-bea5-4ac6-8b01-835f4cdef825', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:23:19.024012 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c3d6a093-174f-4b12-895b-db4fd9f7d0d0 None None] New status for floating IP 1a0caead-0ec8-4f47-9bf2-c303006ae1f5: DOWN {{(pid=102562) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Feb 08 18:23:20.160539 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:20.688538 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-393dcee5-657e-40b3-a3fa-ffa87da2606e req-0c368b06-409d-4ef3-a83c-b9a812398060 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:23:20.690018 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-393dcee5-657e-40b3-a3fa-ffa87da2606e req-0c368b06-409d-4ef3-a83c-b9a812398060 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 945 time: 0.0537786 Feb 08 18:23:20.738124 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-393dcee5-657e-40b3-a3fa-ffa87da2606e req-26b6004b-65da-4332-8136-ba6fb339d2be tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0422943 Feb 08 18:23:21.679343 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:21.867977 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-502c767e-6c8e-44eb-bcc1-bf3c5260acc2 req-cc3b1483-473a-4df2-9d12-6e7f6fc43eae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:23:21.869444 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-502c767e-6c8e-44eb-bcc1-bf3c5260acc2 req-cc3b1483-473a-4df2-9d12-6e7f6fc43eae tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 945 time: 0.0584130 Feb 08 18:23:21.916601 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-502c767e-6c8e-44eb-bcc1-bf3c5260acc2 req-f9520842-d977-447b-a43a-98b324490092 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/security-groups?id=9075e248-9f79-4172-8836-235f98d20c89&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0413587 Feb 08 18:23:22.339030 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be6f8f0e-4031-4343-b895-056fb701b3de req-34e8c995-7037-4c25-8573-c6de8e94e1e8 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:23:22.340355 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-be6f8f0e-4031-4343-b895-056fb701b3de req-34e8c995-7037-4c25-8573-c6de8e94e1e8 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.109 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 945 time: 0.0609126 Feb 08 18:23:22.432970 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-be6f8f0e-4031-4343-b895-056fb701b3de req-b84092cb-b157-43de-8faf-22c6e0ae2e6d tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Deleting port 99a68581-a41f-466f-b6d4-fd8d25cc9536 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:23:22.433277 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-be6f8f0e-4031-4343-b895-056fb701b3de req-b84092cb-b157-43de-8faf-22c6e0ae2e6d tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:22.516825 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-be6f8f0e-4031-4343-b895-056fb701b3de req-b84092cb-b157-43de-8faf-22c6e0ae2e6d tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] For port 99a68581-a41f-466f-b6d4-fd8d25cc9536, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=99a68581-a41f-466f-b6d4-fd8d25cc9536,segment=NetworkSegment(d7f921a8-081c-445a-b287-4ebec76c43ab),segment_id=d7f921a8-081c-445a-b287-4ebec76c43ab)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:23:22.517151 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-be6f8f0e-4031-4343-b895-056fb701b3de req-b84092cb-b157-43de-8faf-22c6e0ae2e6d tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:22.529770 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-be6f8f0e-4031-4343-b895-056fb701b3de req-b84092cb-b157-43de-8faf-22c6e0ae2e6d tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Calling delete_port for 99a68581-a41f-466f-b6d4-fd8d25cc9536 owned by compute:nova {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:23:22.672091 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-be6f8f0e-4031-4343-b895-056fb701b3de req-b84092cb-b157-43de-8faf-22c6e0ae2e6d tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (99a68581-a41f-466f-b6d4-fd8d25cc9536), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:22.685252 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] get_ports_and_sgs() called for port_ids ['99a68581-a41f-466f-b6d4-fd8d25cc9536'] {{(pid=102561) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Feb 08 18:23:22.704847 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b84092cb-b157-43de-8faf-22c6e0ae2e6d tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Pushing event deleted for resources: {'Port': ['ID=99a68581-a41f-466f-b6d4-fd8d25cc9536,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:23:22.748983 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [req-be6f8f0e-4031-4343-b895-056fb701b3de req-b84092cb-b157-43de-8faf-22c6e0ae2e6d tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] No DVR routers for this DVR port 99a68581-a41f-466f-b6d4-fd8d25cc9536 on host hv-cinder-77398 {{(pid=102560) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:23:22.751519 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-be6f8f0e-4031-4343-b895-056fb701b3de req-b84092cb-b157-43de-8faf-22c6e0ae2e6d tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:22.754801 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-be6f8f0e-4031-4343-b895-056fb701b3de req-b84092cb-b157-43de-8faf-22c6e0ae2e6d tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.109 "DELETE /v2.0/ports/99a68581-a41f-466f-b6d4-fd8d25cc9536 HTTP/1.1" status: 204 len: 173 time: 0.4087083 Feb 08 18:23:22.755250 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd80c03fe-3e2c-4e43-acfd-5b5af96404cc', 'name': 'network-vif-deleted', 'tag': '99a68581-a41f-466f-b6d4-fd8d25cc9536'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:23:22.757526 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a701a85b-9a96-4a1b-9101-56c9d8ff2386" -d '{"events": [{"server_uuid": "d80c03fe-3e2c-4e43-acfd-5b5af96404cc", "name": "network-vif-deleted", "tag": "99a68581-a41f-466f-b6d4-fd8d25cc9536"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:23:22.794457 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:23:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d8d427a3-e03b-4ffd-a5c9-b8188e0be4f6 x-openstack-request-id: req-d8d427a3-e03b-4ffd-a5c9-b8188e0be4f6 {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:23:22.794742 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d80c03fe-3e2c-4e43-acfd-5b5af96404cc", "name": "network-vif-deleted", "tag": "99a68581-a41f-466f-b6d4-fd8d25cc9536", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:23:22.795005 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-d8d427a3-e03b-4ffd-a5c9-b8188e0be4f6 {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:23:22.795398 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd80c03fe-3e2c-4e43-acfd-5b5af96404cc', 'name': 'network-vif-deleted', 'tag': '99a68581-a41f-466f-b6d4-fd8d25cc9536', 'status': 'completed', 'code': 200} Feb 08 18:23:23.031741 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-649ecfac-23a5-4a1d-a89f-ab3894bb0d64 req-a905e076-68ca-4194-ad16-be6e341e8b64 tempest-TestMinimumBasicScenario-1110453973 tempest-TestMinimumBasicScenario-1110453973-project] 10.222.0.118 "GET /v2.0/ports?device_id=d80c03fe-3e2c-4e43-acfd-5b5af96404cc HTTP/1.1" status: 200 len: 210 time: 0.0282381 Feb 08 18:23:24.767719 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45888) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:23:25.112971 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-9ad309c8-7a5a-40c3-9f23-19643a3a2d21 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-559978'] for router_interface (4840b53c-7786-4bda-8326-dd7d53cf4097), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:25.374622 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-9ad309c8-7a5a-40c3-9f23-19643a3a2d21 admin admin] Deleting port 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:23:25.374865 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-9ad309c8-7a5a-40c3-9f23-19643a3a2d21 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:25.452202 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [None req-9ad309c8-7a5a-40c3-9f23-19643a3a2d21 admin admin] For port 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2,segment=NetworkSegment(d7f921a8-081c-445a-b287-4ebec76c43ab),segment_id=d7f921a8-081c-445a-b287-4ebec76c43ab)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:23:25.452562 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-9ad309c8-7a5a-40c3-9f23-19643a3a2d21 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:25.464794 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-9ad309c8-7a5a-40c3-9f23-19643a3a2d21 admin admin] Calling delete_port for 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2 owned by network:router_interface {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:23:25.644065 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-9ad309c8-7a5a-40c3-9f23-19643a3a2d21 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:25.668631 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ad309c8-7a5a-40c3-9f23-19643a3a2d21 admin admin] Pushing event deleted for resources: {'Port': ['ID=23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:23:25.831802 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-9ad309c8-7a5a-40c3-9f23-19643a3a2d21 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-631690', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-560126'] for router_interface (4840b53c-7786-4bda-8326-dd7d53cf4097), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:26.047624 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 99a68581-a41f-466f-b6d4-fd8d25cc9536 no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:23:26.070499 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] No Port match for: 99a68581-a41f-466f-b6d4-fd8d25cc9536 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:23:26.071023 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 99a68581-a41f-466f-b6d4-fd8d25cc9536 not bound to the agent host hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:23:26.306130 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9ad309c8-7a5a-40c3-9f23-19643a3a2d21 admin admin] Router 4840b53c-7786-4bda-8326-dd7d53cf4097 has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:23:26.414480 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9ad309c8-7a5a-40c3-9f23-19643a3a2d21 admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:23:26.419801 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-9ad309c8-7a5a-40c3-9f23-19643a3a2d21 admin admin] 10.222.0.118 "PUT /v2.0/routers/4840b53c-7786-4bda-8326-dd7d53cf4097/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6510360 Feb 08 18:23:26.422358 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45890) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:23:26.427989 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3fbe6e84-863f-48f0-85b7-f1e8daabb682 None None] Sync routers for ids ['4840b53c-7786-4bda-8326-dd7d53cf4097'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:23:26.439337 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3fbe6e84-863f-48f0-85b7-f1e8daabb682 None None] Routers {'4840b53c-7786-4bda-8326-dd7d53cf4097'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:23:26.439945 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-3fbe6e84-863f-48f0-85b7-f1e8daabb682 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:23:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['4840b53c-7786-4bda-8326-dd7d53cf4097'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:23:26.525225 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b4e37470-0c73-43fb-b2f3-e05fc943db65 admin admin] Publish callbacks [] for router (4840b53c-7786-4bda-8326-dd7d53cf4097), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:26.546377 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-3fbe6e84-863f-48f0-85b7-f1e8daabb682 None None] Set router 4840b53c-7786-4bda-8326-dd7d53cf4097 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:23:26.628848 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b4e37470-0c73-43fb-b2f3-e05fc943db65 admin admin] Publish callbacks [] for router_gateway (4840b53c-7786-4bda-8326-dd7d53cf4097), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:26.683718 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-b4e37470-0c73-43fb-b2f3-e05fc943db65 admin admin] Deleting port 227490ec-5281-4713-bf74-27f395237029 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:23:26.684078 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b4e37470-0c73-43fb-b2f3-e05fc943db65 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (227490ec-5281-4713-bf74-27f395237029), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:26.722102 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-3fbe6e84-863f-48f0-85b7-f1e8daabb682 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'name': 'tempest-TestMinimumBasicScenario-1869431064-router', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143'}], 'enable_snat': True}, 'gw_port_id': '227490ec-5281-4713-bf74-27f395237029', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:14Z', 'updated_at': '2022-02-08T18:23:25Z', 'revision_number': 5, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'gw_port': {'id': '227490ec-5281-4713-bf74-27f395237029', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:00:89:6c', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.143', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:15Z', 'updated_at': '2022-02-08T18:21:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:23:26.748353 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3fbe6e84-863f-48f0-85b7-f1e8daabb682 None None] Checking router: 4840b53c-7786-4bda-8326-dd7d53cf4097 for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:23:26.756890 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3fbe6e84-863f-48f0-85b7-f1e8daabb682 None None] Routers {'4840b53c-7786-4bda-8326-dd7d53cf4097'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:23:26.757532 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-3fbe6e84-863f-48f0-85b7-f1e8daabb682 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:23:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['4840b53c-7786-4bda-8326-dd7d53cf4097'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:23:26.762076 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [None req-b4e37470-0c73-43fb-b2f3-e05fc943db65 admin admin] For port 227490ec-5281-4713-bf74-27f395237029, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=227490ec-5281-4713-bf74-27f395237029,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:23:26.762442 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b4e37470-0c73-43fb-b2f3-e05fc943db65 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (227490ec-5281-4713-bf74-27f395237029), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:26.778548 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-b4e37470-0c73-43fb-b2f3-e05fc943db65 admin admin] Calling delete_port for 227490ec-5281-4713-bf74-27f395237029 owned by network:router_gateway {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:23:26.845360 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-3fbe6e84-863f-48f0-85b7-f1e8daabb682 None None] Set router 4840b53c-7786-4bda-8326-dd7d53cf4097 gateway port host: None {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:23:26.900030 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-3fbe6e84-863f-48f0-85b7-f1e8daabb682 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'name': 'tempest-TestMinimumBasicScenario-1869431064-router', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:14Z', 'updated_at': '2022-02-08T18:23:26Z', 'revision_number': 6, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'gw_port_host': None}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:23:26.926312 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3fbe6e84-863f-48f0-85b7-f1e8daabb682 None None] The sync data for ids ['4840b53c-7786-4bda-8326-dd7d53cf4097'] in dv-cinder-773985-21-iscsi is: [{'id': '4840b53c-7786-4bda-8326-dd7d53cf4097', 'name': 'tempest-TestMinimumBasicScenario-1869431064-router', 'tenant_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:14Z', 'updated_at': '2022-02-08T18:23:26Z', 'revision_number': 6, 'project_id': 'a49c4d8ef7824a87af0bd566f0854d0a', 'gw_port_host': None}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:23:26.944809 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b4e37470-0c73-43fb-b2f3-e05fc943db65 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (227490ec-5281-4713-bf74-27f395237029), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:26.971793 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4e37470-0c73-43fb-b2f3-e05fc943db65 admin admin] Pushing event deleted for resources: {'Port': ['ID=227490ec-5281-4713-bf74-27f395237029,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:23:27.030387 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b4e37470-0c73-43fb-b2f3-e05fc943db65 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-560668'] for router_gateway (4840b53c-7786-4bda-8326-dd7d53cf4097), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:27.119365 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b4e37470-0c73-43fb-b2f3-e05fc943db65 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-557467', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6918'] for router (4840b53c-7786-4bda-8326-dd7d53cf4097), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:27.122573 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b4e37470-0c73-43fb-b2f3-e05fc943db65 admin admin] Publish callbacks [] for router_controller (4840b53c-7786-4bda-8326-dd7d53cf4097), precommit_delete_associations {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:27.181332 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b4e37470-0c73-43fb-b2f3-e05fc943db65 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-557452'] for router (4840b53c-7786-4bda-8326-dd7d53cf4097), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:27.181937 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b4e37470-0c73-43fb-b2f3-e05fc943db65 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4840b53c-7786-4bda-8326-dd7d53cf4097 {{(pid=102560) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Feb 08 18:23:27.187218 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-b4e37470-0c73-43fb-b2f3-e05fc943db65 admin admin] Publish callbacks [] for router (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:27.188357 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-b4e37470-0c73-43fb-b2f3-e05fc943db65 admin admin] 10.222.0.118 "DELETE /v2.0/routers/4840b53c-7786-4bda-8326-dd7d53cf4097 HTTP/1.1" status: 204 len: 168 time: 0.7651062 Feb 08 18:23:27.191038 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45892) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:23:27.235366 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_v2 [None req-7af4fd63-c813-4b01-a984-36142ddedc3a admin admin] Deleting subnet 96b794ac-bea5-4ac6-8b01-835f4cdef825 {{(pid=102560) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Feb 08 18:23:27.238584 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7af4fd63-c813-4b01-a984-36142ddedc3a admin admin] Publish callbacks [] for subnet (96b794ac-bea5-4ac6-8b01-835f4cdef825), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:27.275775 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7af4fd63-c813-4b01-a984-36142ddedc3a admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-64533851'] for subnet (96b794ac-bea5-4ac6-8b01-835f4cdef825), precommit_delete_associations {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:27.358684 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7af4fd63-c813-4b01-a984-36142ddedc3a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1801023'] for subnet (96b794ac-bea5-4ac6-8b01-835f4cdef825), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:27.410587 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7af4fd63-c813-4b01-a984-36142ddedc3a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1801156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-64531538', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-64597460'] for subnet (96b794ac-bea5-4ac6-8b01-835f4cdef825), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:27.435418 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7af4fd63-c813-4b01-a984-36142ddedc3a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=96b794ac-bea5-4ac6-8b01-835f4cdef825,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:23:27.440881 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7af4fd63-c813-4b01-a984-36142ddedc3a admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:27.444751 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-7af4fd63-c813-4b01-a984-36142ddedc3a admin admin] 10.222.0.118 "DELETE /v2.0/subnets/96b794ac-bea5-4ac6-8b01-835f4cdef825 HTTP/1.1" status: 204 len: 168 time: 0.2524483 Feb 08 18:23:27.447284 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45894) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:23:27.447791 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7980c34-d598-46e4-8fb7-c7431f6a87f7 None None] Network bfa2dbfe-1e79-44ee-9df4-62197aec047e requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:23:27.524011 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-41905c59-dd89-4094-b875-282971dc2682 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1860329'] for network (bfa2dbfe-1e79-44ee-9df4-62197aec047e), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:27.579202 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-41905c59-dd89-4094-b875-282971dc2682 admin admin] Deleting port cc244935-cc99-4cc9-89b2-0d3e3ed3b616 {{(pid=102559) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:23:27.579548 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-41905c59-dd89-4094-b875-282971dc2682 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (cc244935-cc99-4cc9-89b2-0d3e3ed3b616), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:27.642220 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [None req-41905c59-dd89-4094-b875-282971dc2682 admin admin] For port cc244935-cc99-4cc9-89b2-0d3e3ed3b616, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=cc244935-cc99-4cc9-89b2-0d3e3ed3b616,segment=NetworkSegment(d7f921a8-081c-445a-b287-4ebec76c43ab),segment_id=d7f921a8-081c-445a-b287-4ebec76c43ab)] {{(pid=102559) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:23:27.642591 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-41905c59-dd89-4094-b875-282971dc2682 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (cc244935-cc99-4cc9-89b2-0d3e3ed3b616), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:27.664880 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-41905c59-dd89-4094-b875-282971dc2682 admin admin] Calling delete_port for cc244935-cc99-4cc9-89b2-0d3e3ed3b616 owned by network:dhcp {{(pid=102559) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:23:27.691671 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e07edd9b-27c8-4abf-8ecb-70420faeda47 None None] DHCP port deletion for bfa2dbfe-1e79-44ee-9df4-62197aec047e request from dv-cinder-773985-21-iscsi {{(pid=102561) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Feb 08 18:23:27.745127 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-e07edd9b-27c8-4abf-8ecb-70420faeda47 None None] Deleting port cc244935-cc99-4cc9-89b2-0d3e3ed3b616 {{(pid=102561) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:23:27.745565 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-e07edd9b-27c8-4abf-8ecb-70420faeda47 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (cc244935-cc99-4cc9-89b2-0d3e3ed3b616), before_delete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:27.753785 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-41905c59-dd89-4094-b875-282971dc2682 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (cc244935-cc99-4cc9-89b2-0d3e3ed3b616), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:27.782826 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41905c59-dd89-4094-b875-282971dc2682 admin admin] Pushing event deleted for resources: {'Port': ['ID=cc244935-cc99-4cc9-89b2-0d3e3ed3b616,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:23:27.787059 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41905c59-dd89-4094-b875-282971dc2682 admin admin] No DVR routers for this DVR port cc244935-cc99-4cc9-89b2-0d3e3ed3b616 on host dv-cinder-773985-21-iscsi {{(pid=102559) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:23:27.831569 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-e07edd9b-27c8-4abf-8ecb-70420faeda47 None None] For port cc244935-cc99-4cc9-89b2-0d3e3ed3b616, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=cc244935-cc99-4cc9-89b2-0d3e3ed3b616,segment=NetworkSegment(d7f921a8-081c-445a-b287-4ebec76c43ab),segment_id=d7f921a8-081c-445a-b287-4ebec76c43ab)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:23:27.831968 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-e07edd9b-27c8-4abf-8ecb-70420faeda47 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (cc244935-cc99-4cc9-89b2-0d3e3ed3b616), precommit_delete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:27.844076 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-e07edd9b-27c8-4abf-8ecb-70420faeda47 None None] Calling delete_port for cc244935-cc99-4cc9-89b2-0d3e3ed3b616 owned by network:dhcp {{(pid=102561) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:23:27.859486 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-41905c59-dd89-4094-b875-282971dc2682 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1721768', 'neutron.services.segments.db._delete_segments_for_network-8770558865089'] for network (bfa2dbfe-1e79-44ee-9df4-62197aec047e), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:27.881604 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.services.segments.db [None req-41905c59-dd89-4094-b875-282971dc2682 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bfa2dbfe-1e79-44ee-9df4-62197aec047e']}} {{(pid=102559) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:23:27.891804 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.services.segments.db [None req-41905c59-dd89-4094-b875-282971dc2682 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd7f921a8-081c-445a-b287-4ebec76c43ab') {'for_net_delete': True} {{(pid=102559) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:23:27.892109 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.services.segments.db [None req-41905c59-dd89-4094-b875-282971dc2682 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd7f921a8-081c-445a-b287-4ebec76c43ab') {} {{(pid=102559) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:23:27.903050 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-41905c59-dd89-4094-b875-282971dc2682 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8770558866122', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-63850230'] for segment (d7f921a8-081c-445a-b287-4ebec76c43ab), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:27.917625 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-41905c59-dd89-4094-b875-282971dc2682 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (d7f921a8-081c-445a-b287-4ebec76c43ab), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:27.927817 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-41905c59-dd89-4094-b875-282971dc2682 admin admin] Releasing vlan 1074 on physical network physnet1 to pool {{(pid=102559) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Feb 08 18:23:27.928003 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-41905c59-dd89-4094-b875-282971dc2682 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-63856418'] for segment (d7f921a8-081c-445a-b287-4ebec76c43ab), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:27.929135 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-e07edd9b-27c8-4abf-8ecb-70420faeda47 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442'] for port (cc244935-cc99-4cc9-89b2-0d3e3ed3b616), after_delete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: Traceback (most recent call last): Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: timer() Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: cb(*args, **kw) Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: return func(*args, **kwargs) Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: self._notify() Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: self.callback(batched_events) Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: event.method(event) Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: aggregate_uuid = self.p_client.list_aggregates( Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: return f(self, *a, **k) Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: return self._get(url).json() Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: return self._client.get(url, endpoint_filter=self._ks_filter, Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: return self.request(url, 'GET', **kwargs) Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: base_url = self.get_endpoint(auth, allow=allow, Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 08 18:23:27.929760 dv-cinder-773985-21-iscsi neutron-server[102559]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 08 18:23:27.962463 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e07edd9b-27c8-4abf-8ecb-70420faeda47 None None] Pushing event deleted for resources: {'Port': ['ID=cc244935-cc99-4cc9-89b2-0d3e3ed3b616,revision_number=None']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:23:27.965061 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e07edd9b-27c8-4abf-8ecb-70420faeda47 None None] No DVR routers for this DVR port cc244935-cc99-4cc9-89b2-0d3e3ed3b616 on host dv-cinder-773985-21-iscsi {{(pid=102561) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:23:27.973159 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e07edd9b-27c8-4abf-8ecb-70420faeda47 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:27.973629 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e07edd9b-27c8-4abf-8ecb-70420faeda47 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:27.973974 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e07edd9b-27c8-4abf-8ecb-70420faeda47 None None] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:27.974304 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e07edd9b-27c8-4abf-8ecb-70420faeda47 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:27.974628 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e07edd9b-27c8-4abf-8ecb-70420faeda47 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:27.974978 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e07edd9b-27c8-4abf-8ecb-70420faeda47 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:27.975308 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e07edd9b-27c8-4abf-8ecb-70420faeda47 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:27.975618 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e07edd9b-27c8-4abf-8ecb-70420faeda47 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:27.975937 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e07edd9b-27c8-4abf-8ecb-70420faeda47 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:27.976607 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e07edd9b-27c8-4abf-8ecb-70420faeda47 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:27.976607 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e07edd9b-27c8-4abf-8ecb-70420faeda47 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:27.976857 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e07edd9b-27c8-4abf-8ecb-70420faeda47 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:27.977169 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e07edd9b-27c8-4abf-8ecb-70420faeda47 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102561) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:23:27.996097 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-41905c59-dd89-4094-b875-282971dc2682 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1721777', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-560760'] for network (bfa2dbfe-1e79-44ee-9df4-62197aec047e), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:28.002058 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-41905c59-dd89-4094-b875-282971dc2682 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:28.005257 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-41905c59-dd89-4094-b875-282971dc2682 admin admin] 10.222.0.118 "DELETE /v2.0/networks/bfa2dbfe-1e79-44ee-9df4-62197aec047e HTTP/1.1" status: 204 len: 168 time: 0.5570080 Feb 08 18:23:28.008288 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45898) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:23:28.020064 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-41905c59-dd89-4094-b875-282971dc2682 admin admin] Pushing event deleted for resources: {'Network': ['ID=bfa2dbfe-1e79-44ee-9df4-62197aec047e,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:23:28.200702 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2 no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:23:28.221792 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:23:28.222147 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 23a2d7ef-216a-4f8f-a2b4-92ae6aa061b2 not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:23:28.222571 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device cc244935-cc99-4cc9-89b2-0d3e3ed3b616 no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:23:28.241789 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: cc244935-cc99-4cc9-89b2-0d3e3ed3b616 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:23:28.242024 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device cc244935-cc99-4cc9-89b2-0d3e3ed3b616 not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:23:28.242466 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 227490ec-5281-4713-bf74-27f395237029 no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:23:28.262015 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: 227490ec-5281-4713-bf74-27f395237029 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:23:28.262360 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 227490ec-5281-4713-bf74-27f395237029 not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:23:28.395273 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-401e5046-c917-43e9-b24a-777540a126fe admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-559978'] for router_interface (9af26cb5-3b1a-4b25-9d52-edaea753433a), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:28.649072 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-401e5046-c917-43e9-b24a-777540a126fe admin admin] Deleting port 771f4417-67cb-4a2b-a517-4e9b828487e2 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:23:28.649320 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-401e5046-c917-43e9-b24a-777540a126fe admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (771f4417-67cb-4a2b-a517-4e9b828487e2), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:28.740620 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [None req-401e5046-c917-43e9-b24a-777540a126fe admin admin] For port 771f4417-67cb-4a2b-a517-4e9b828487e2, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=771f4417-67cb-4a2b-a517-4e9b828487e2,segment=NetworkSegment(0d63bc5b-3ce8-454e-8bc9-2f9a2d079796),segment_id=0d63bc5b-3ce8-454e-8bc9-2f9a2d079796)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:23:28.740974 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-401e5046-c917-43e9-b24a-777540a126fe admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (771f4417-67cb-4a2b-a517-4e9b828487e2), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:28.754067 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-401e5046-c917-43e9-b24a-777540a126fe admin admin] Calling delete_port for 771f4417-67cb-4a2b-a517-4e9b828487e2 owned by network:router_interface {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:23:28.932934 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-401e5046-c917-43e9-b24a-777540a126fe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (771f4417-67cb-4a2b-a517-4e9b828487e2), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:28.957486 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-401e5046-c917-43e9-b24a-777540a126fe admin admin] Pushing event deleted for resources: {'Port': ['ID=771f4417-67cb-4a2b-a517-4e9b828487e2,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:23:29.125917 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-401e5046-c917-43e9-b24a-777540a126fe admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-631690', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-560126'] for router_interface (9af26cb5-3b1a-4b25-9d52-edaea753433a), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:29.344974 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-401e5046-c917-43e9-b24a-777540a126fe admin admin] Router 9af26cb5-3b1a-4b25-9d52-edaea753433a has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:23:29.453007 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-401e5046-c917-43e9-b24a-777540a126fe admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:23:29.458407 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-401e5046-c917-43e9-b24a-777540a126fe admin admin] 10.222.0.118 "PUT /v2.0/routers/9af26cb5-3b1a-4b25-9d52-edaea753433a/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4490707 Feb 08 18:23:29.462081 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45902) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:23:29.464876 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f8ea761-df56-4b68-9bfe-6c49367bfc85 None None] Sync routers for ids ['9af26cb5-3b1a-4b25-9d52-edaea753433a'] in dv-cinder-773985-21-iscsi {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:23:29.475540 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f8ea761-df56-4b68-9bfe-6c49367bfc85 None None] Routers {'9af26cb5-3b1a-4b25-9d52-edaea753433a'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:23:29.476141 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-6f8ea761-df56-4b68-9bfe-6c49367bfc85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:23:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['9af26cb5-3b1a-4b25-9d52-edaea753433a'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:23:29.567892 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-32311cb2-0835-4bc7-b03e-9216446b7237 admin admin] Publish callbacks [] for router (9af26cb5-3b1a-4b25-9d52-edaea753433a), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:29.582727 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-6f8ea761-df56-4b68-9bfe-6c49367bfc85 None None] Set router 9af26cb5-3b1a-4b25-9d52-edaea753433a gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:23:29.670198 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-32311cb2-0835-4bc7-b03e-9216446b7237 admin admin] Publish callbacks [] for router_gateway (9af26cb5-3b1a-4b25-9d52-edaea753433a), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:29.723829 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-32311cb2-0835-4bc7-b03e-9216446b7237 admin admin] Deleting port d387bf73-fc8b-4b08-959c-321d84fe4205 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:23:29.724156 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-32311cb2-0835-4bc7-b03e-9216446b7237 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (d387bf73-fc8b-4b08-959c-321d84fe4205), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:29.754242 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-6f8ea761-df56-4b68-9bfe-6c49367bfc85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9af26cb5-3b1a-4b25-9d52-edaea753433a', 'name': 'tempest-TestMinimumBasicScenario-1676436270-router', 'tenant_id': '5a27073c24ea479ab55d00b3886a010e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.119'}], 'enable_snat': True}, 'gw_port_id': 'd387bf73-fc8b-4b08-959c-321d84fe4205', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:19Z', 'updated_at': '2022-02-08T18:23:28Z', 'revision_number': 5, 'project_id': '5a27073c24ea479ab55d00b3886a010e', 'gw_port': {'id': 'd387bf73-fc8b-4b08-959c-321d84fe4205', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:52:36:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9af26cb5-3b1a-4b25-9d52-edaea753433a', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.119', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:21:19Z', 'updated_at': '2022-02-08T18:21:26Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:23:29.783597 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f8ea761-df56-4b68-9bfe-6c49367bfc85 None None] Checking router: 9af26cb5-3b1a-4b25-9d52-edaea753433a for host: dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:23:29.792209 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6f8ea761-df56-4b68-9bfe-6c49367bfc85 None None] Routers {'9af26cb5-3b1a-4b25-9d52-edaea753433a'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:23:29.792811 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-6f8ea761-df56-4b68-9bfe-6c49367bfc85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:23:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['9af26cb5-3b1a-4b25-9d52-edaea753433a'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:23:29.804383 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [None req-32311cb2-0835-4bc7-b03e-9216446b7237 admin admin] For port d387bf73-fc8b-4b08-959c-321d84fe4205, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=d387bf73-fc8b-4b08-959c-321d84fe4205,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:23:29.804773 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-32311cb2-0835-4bc7-b03e-9216446b7237 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (d387bf73-fc8b-4b08-959c-321d84fe4205), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:29.817073 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-32311cb2-0835-4bc7-b03e-9216446b7237 admin admin] Calling delete_port for d387bf73-fc8b-4b08-959c-321d84fe4205 owned by network:router_gateway {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:23:29.872921 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-6f8ea761-df56-4b68-9bfe-6c49367bfc85 None None] Set router 9af26cb5-3b1a-4b25-9d52-edaea753433a gateway port host: None {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:23:29.925473 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-6f8ea761-df56-4b68-9bfe-6c49367bfc85 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9af26cb5-3b1a-4b25-9d52-edaea753433a', 'name': 'tempest-TestMinimumBasicScenario-1676436270-router', 'tenant_id': '5a27073c24ea479ab55d00b3886a010e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:19Z', 'updated_at': '2022-02-08T18:23:29Z', 'revision_number': 6, 'project_id': '5a27073c24ea479ab55d00b3886a010e', 'gw_port_host': None}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:23:29.951705 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6f8ea761-df56-4b68-9bfe-6c49367bfc85 None None] The sync data for ids ['9af26cb5-3b1a-4b25-9d52-edaea753433a'] in dv-cinder-773985-21-iscsi is: [{'id': '9af26cb5-3b1a-4b25-9d52-edaea753433a', 'name': 'tempest-TestMinimumBasicScenario-1676436270-router', 'tenant_id': '5a27073c24ea479ab55d00b3886a010e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:21:19Z', 'updated_at': '2022-02-08T18:23:29Z', 'revision_number': 6, 'project_id': '5a27073c24ea479ab55d00b3886a010e', 'gw_port_host': None}] {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:23:29.994823 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-32311cb2-0835-4bc7-b03e-9216446b7237 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (d387bf73-fc8b-4b08-959c-321d84fe4205), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:30.019980 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32311cb2-0835-4bc7-b03e-9216446b7237 admin admin] Pushing event deleted for resources: {'Port': ['ID=d387bf73-fc8b-4b08-959c-321d84fe4205,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:23:30.079997 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-32311cb2-0835-4bc7-b03e-9216446b7237 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-560668'] for router_gateway (9af26cb5-3b1a-4b25-9d52-edaea753433a), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:30.169940 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-32311cb2-0835-4bc7-b03e-9216446b7237 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-557467', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6918'] for router (9af26cb5-3b1a-4b25-9d52-edaea753433a), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:30.172227 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-32311cb2-0835-4bc7-b03e-9216446b7237 admin admin] Publish callbacks [] for router_controller (9af26cb5-3b1a-4b25-9d52-edaea753433a), precommit_delete_associations {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:30.483562 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-32311cb2-0835-4bc7-b03e-9216446b7237 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-557452'] for router (9af26cb5-3b1a-4b25-9d52-edaea753433a), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:30.484151 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-32311cb2-0835-4bc7-b03e-9216446b7237 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 9af26cb5-3b1a-4b25-9d52-edaea753433a {{(pid=102560) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Feb 08 18:23:30.488584 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-32311cb2-0835-4bc7-b03e-9216446b7237 admin admin] Publish callbacks [] for router (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:30.489756 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-32311cb2-0835-4bc7-b03e-9216446b7237 admin admin] 10.222.0.118 "DELETE /v2.0/routers/9af26cb5-3b1a-4b25-9d52-edaea753433a HTTP/1.1" status: 204 len: 168 time: 1.0267498 Feb 08 18:23:30.492360 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45904) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:23:30.536700 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_v2 [None req-e4b074ec-617f-410f-8920-d13f9c765269 admin admin] Deleting subnet 4e9b7aec-e75c-4d79-bd59-c1154c6f66b2 {{(pid=102560) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Feb 08 18:23:30.540021 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e4b074ec-617f-410f-8920-d13f9c765269 admin admin] Publish callbacks [] for subnet (4e9b7aec-e75c-4d79-bd59-c1154c6f66b2), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:30.578402 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e4b074ec-617f-410f-8920-d13f9c765269 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-64533851'] for subnet (4e9b7aec-e75c-4d79-bd59-c1154c6f66b2), precommit_delete_associations {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:30.665901 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e4b074ec-617f-410f-8920-d13f9c765269 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1801023'] for subnet (4e9b7aec-e75c-4d79-bd59-c1154c6f66b2), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:30.705764 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 771f4417-67cb-4a2b-a517-4e9b828487e2 no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:23:30.724578 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e4b074ec-617f-410f-8920-d13f9c765269 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1801156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-64531538', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-64597460'] for subnet (4e9b7aec-e75c-4d79-bd59-c1154c6f66b2), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:30.731421 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: 771f4417-67cb-4a2b-a517-4e9b828487e2 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:23:30.731765 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 771f4417-67cb-4a2b-a517-4e9b828487e2 not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:23:30.750711 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e4b074ec-617f-410f-8920-d13f9c765269 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4e9b7aec-e75c-4d79-bd59-c1154c6f66b2,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:23:30.754399 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e4b074ec-617f-410f-8920-d13f9c765269 admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:30.758797 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-e4b074ec-617f-410f-8920-d13f9c765269 admin admin] 10.222.0.118 "DELETE /v2.0/subnets/4e9b7aec-e75c-4d79-bd59-c1154c6f66b2 HTTP/1.1" status: 204 len: 168 time: 0.2643516 Feb 08 18:23:30.760427 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45906) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:23:30.763240 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f4183c8e-b32d-49da-ac66-380b49aa4a7d None None] Network def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:23:30.836026 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e6e7e558-06aa-4f8a-b60b-927119b4f023 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1860329'] for network (def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:30.895397 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-e6e7e558-06aa-4f8a-b60b-927119b4f023 admin admin] Deleting port 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:23:30.895871 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e6e7e558-06aa-4f8a-b60b-927119b4f023 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:30.929572 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be8debe9-27a6-46db-85b9-adfe20389f03 None None] DHCP port deletion for def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13 request from dv-cinder-773985-21-iscsi {{(pid=102561) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Feb 08 18:23:30.967394 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [None req-e6e7e558-06aa-4f8a-b60b-927119b4f023 admin admin] For port 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a,segment=NetworkSegment(0d63bc5b-3ce8-454e-8bc9-2f9a2d079796),segment_id=0d63bc5b-3ce8-454e-8bc9-2f9a2d079796)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:23:30.967768 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e6e7e558-06aa-4f8a-b60b-927119b4f023 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:30.980798 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-e6e7e558-06aa-4f8a-b60b-927119b4f023 admin admin] Calling delete_port for 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a owned by network:dhcp {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:23:30.986494 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-be8debe9-27a6-46db-85b9-adfe20389f03 None None] Deleting port 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a {{(pid=102561) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:23:30.986909 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-be8debe9-27a6-46db-85b9-adfe20389f03 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a), before_delete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:31.048973 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-be8debe9-27a6-46db-85b9-adfe20389f03 None None] For port 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a,segment=NetworkSegment(0d63bc5b-3ce8-454e-8bc9-2f9a2d079796),segment_id=0d63bc5b-3ce8-454e-8bc9-2f9a2d079796)] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:23:31.049304 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-be8debe9-27a6-46db-85b9-adfe20389f03 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a), precommit_delete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:31.061146 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-be8debe9-27a6-46db-85b9-adfe20389f03 None None] Calling delete_port for 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a owned by network:dhcp {{(pid=102561) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:23:31.067925 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e6e7e558-06aa-4f8a-b60b-927119b4f023 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:31.094983 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e6e7e558-06aa-4f8a-b60b-927119b4f023 admin admin] No DVR routers for this DVR port 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a on host dv-cinder-773985-21-iscsi {{(pid=102560) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:23:31.098571 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6e7e558-06aa-4f8a-b60b-927119b4f023 admin admin] Pushing event deleted for resources: {'Port': ['ID=0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:23:31.137541 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-be8debe9-27a6-46db-85b9-adfe20389f03 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442'] for port (0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a), after_delete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:31.162305 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be8debe9-27a6-46db-85b9-adfe20389f03 None None] Pushing event deleted for resources: {'Port': ['ID=0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a,revision_number=None']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:23:31.166024 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be8debe9-27a6-46db-85b9-adfe20389f03 None None] No DVR routers for this DVR port 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a on host dv-cinder-773985-21-iscsi {{(pid=102561) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:23:31.172891 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e6e7e558-06aa-4f8a-b60b-927119b4f023 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1721768', 'neutron.services.segments.db._delete_segments_for_network-8770558865089'] for network (def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:31.192869 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-e6e7e558-06aa-4f8a-b60b-927119b4f023 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13']}} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:23:31.202125 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-e6e7e558-06aa-4f8a-b60b-927119b4f023 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0d63bc5b-3ce8-454e-8bc9-2f9a2d079796') {'for_net_delete': True} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:23:31.202420 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-e6e7e558-06aa-4f8a-b60b-927119b4f023 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0d63bc5b-3ce8-454e-8bc9-2f9a2d079796') {} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:23:31.211750 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e6e7e558-06aa-4f8a-b60b-927119b4f023 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8770558866122', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-64533840'] for segment (0d63bc5b-3ce8-454e-8bc9-2f9a2d079796), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:31.225477 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e6e7e558-06aa-4f8a-b60b-927119b4f023 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (0d63bc5b-3ce8-454e-8bc9-2f9a2d079796), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:31.232198 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e6e7e558-06aa-4f8a-b60b-927119b4f023 admin admin] Releasing vlan 1058 on physical network physnet1 to pool {{(pid=102560) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Feb 08 18:23:31.232580 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e6e7e558-06aa-4f8a-b60b-927119b4f023 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-64531704'] for segment (0d63bc5b-3ce8-454e-8bc9-2f9a2d079796), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: Traceback (most recent call last): Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: timer() Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: cb(*args, **kw) Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: return func(*args, **kwargs) Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: self._notify() Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: self.callback(batched_events) Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: event.method(event) Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: aggregate_uuid = self.p_client.list_aggregates( Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: return f(self, *a, **k) Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: return self._get(url).json() Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: return self._client.get(url, endpoint_filter=self._ks_filter, Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: return self.request(url, 'GET', **kwargs) Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: base_url = self.get_endpoint(auth, allow=allow, Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 08 18:23:31.234322 dv-cinder-773985-21-iscsi neutron-server[102560]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 08 18:23:31.290704 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e6e7e558-06aa-4f8a-b60b-927119b4f023 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1721777', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-560760'] for network (def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:31.298429 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-e6e7e558-06aa-4f8a-b60b-927119b4f023 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:31.302981 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-e6e7e558-06aa-4f8a-b60b-927119b4f023 admin admin] 10.222.0.118 "DELETE /v2.0/networks/def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13 HTTP/1.1" status: 204 len: 168 time: 0.5414569 Feb 08 18:23:31.314316 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6e7e558-06aa-4f8a-b60b-927119b4f023 admin admin] Pushing event deleted for resources: {'Network': ['ID=def78c1b-5ffb-4ba3-aa72-5dbb4f9cdf13,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:23:31.469920 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45910) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:23:31.514234 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-d0ce4d94-937b-48a9-89e0-cacb70a7ebcb admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=a49c4d8ef7824a87af0bd566f0854d0a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0431373 Feb 08 18:23:31.517882 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45912) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:23:31.565045 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6791fab7-83fd-4253-a8a2-d678073a4815 admin admin] Publish callbacks [] for security_group (9075e248-9f79-4172-8836-235f98d20c89), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:31.586795 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6791fab7-83fd-4253-a8a2-d678073a4815 admin admin] Publish callbacks [] for security_group (9075e248-9f79-4172-8836-235f98d20c89), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:31.634956 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6791fab7-83fd-4253-a8a2-d678073a4815 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (9075e248-9f79-4172-8836-235f98d20c89), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:31.637950 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-6791fab7-83fd-4253-a8a2-d678073a4815 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:31.639177 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-6791fab7-83fd-4253-a8a2-d678073a4815 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/9075e248-9f79-4172-8836-235f98d20c89 HTTP/1.1" status: 204 len: 168 time: 0.1204371 Feb 08 18:23:31.646883 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6791fab7-83fd-4253-a8a2-d678073a4815 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9075e248-9f79-4172-8836-235f98d20c89,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:23:31.951313 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45918) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:23:31.989980 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-37aaa6bc-0289-4f8a-98de-a6b14e8e770f admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=5a27073c24ea479ab55d00b3886a010e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0375159 Feb 08 18:23:31.992505 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45920) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:23:32.038858 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d67672eb-e12c-4a15-9781-d91349ef067d admin admin] Publish callbacks [] for security_group (9a00ae86-e139-4230-9fd9-9fd7caebd9c2), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:32.061030 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d67672eb-e12c-4a15-9781-d91349ef067d admin admin] Publish callbacks [] for security_group (9a00ae86-e139-4230-9fd9-9fd7caebd9c2), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:32.115158 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d67672eb-e12c-4a15-9781-d91349ef067d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (9a00ae86-e139-4230-9fd9-9fd7caebd9c2), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:32.117585 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d67672eb-e12c-4a15-9781-d91349ef067d admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:32.118756 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-d67672eb-e12c-4a15-9781-d91349ef067d admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/9a00ae86-e139-4230-9fd9-9fd7caebd9c2 HTTP/1.1" status: 204 len: 168 time: 0.1254041 Feb 08 18:23:32.126312 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d67672eb-e12c-4a15-9781-d91349ef067d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9a00ae86-e139-4230-9fd9-9fd7caebd9c2,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:23:32.205441 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:23:32.224933 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:23:32.225676 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 0f1c4c68-4dfd-4f15-b535-0c9ea54b9b3a not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:23:32.226050 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device d387bf73-fc8b-4b08-959c-321d84fe4205 no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:23:32.245893 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: d387bf73-fc8b-4b08-959c-321d84fe4205 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:23:32.246283 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device d387bf73-fc8b-4b08-959c-321d84fe4205 not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:23:45.392259 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-918c56d4-eea6-4bd2-86d7-f9e87fe7871f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:46.013079 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:23:47.829175 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-4ea5bd4d-1c09-4480-be45-47f905cecd2a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:48.134617 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:48.547730 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:50.173187 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:23:51.809331 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:08.956810 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45932) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:24:09.129608 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-8da43495-2fb9-44a0-9a80-15e0f1c07a66 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Deleting port 746ac0fb-244a-4f8e-9866-d7f1d1fb96ff {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:24:09.129848 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8da43495-2fb9-44a0-9a80-15e0f1c07a66 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (746ac0fb-244a-4f8e-9866-d7f1d1fb96ff), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:09.210056 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8da43495-2fb9-44a0-9a80-15e0f1c07a66 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (746ac0fb-244a-4f8e-9866-d7f1d1fb96ff), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:09.210355 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8da43495-2fb9-44a0-9a80-15e0f1c07a66 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for floatingip (746ac0fb-244a-4f8e-9866-d7f1d1fb96ff), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:09.222652 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-8da43495-2fb9-44a0-9a80-15e0f1c07a66 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Calling delete_port for 746ac0fb-244a-4f8e-9866-d7f1d1fb96ff owned by network:floatingip {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:24:09.396726 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8da43495-2fb9-44a0-9a80-15e0f1c07a66 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (746ac0fb-244a-4f8e-9866-d7f1d1fb96ff), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:09.421180 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8da43495-2fb9-44a0-9a80-15e0f1c07a66 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Pushing event deleted for resources: {'Port': ['ID=746ac0fb-244a-4f8e-9866-d7f1d1fb96ff,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:24:09.484211 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8da43495-2fb9-44a0-9a80-15e0f1c07a66 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for floatingip (74b63cc7-953c-4d03-8bb5-c84b365acf62), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:09.484510 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.db.l3_db [None req-8da43495-2fb9-44a0-9a80-15e0f1c07a66 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Floating IP 74b63cc7-953c-4d03-8bb5-c84b365acf62 disassociated (deleted). External IP: 172.27.1.198, port: 012af0ea-fa3b-4267-a4da-80c767055b16. Feb 08 18:24:09.696881 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8da43495-2fb9-44a0-9a80-15e0f1c07a66 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Router ca0e41d8-de98-4af8-80f4-29c2c72d8f6c has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:24:09.806403 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8da43495-2fb9-44a0-9a80-15e0f1c07a66 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:24:09.811575 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8da43495-2fb9-44a0-9a80-15e0f1c07a66 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for floatingip (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:09.816242 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-71095234-5800-4f49-b1b2-2615807dbd3c None None] Sync routers for ids ['ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:24:09.829268 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71095234-5800-4f49-b1b2-2615807dbd3c None None] Routers {'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:24:09.829879 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-71095234-5800-4f49-b1b2-2615807dbd3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:23:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:24:09.846594 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-8da43495-2fb9-44a0-9a80-15e0f1c07a66 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "DELETE /v2.0/floatingips/74b63cc7-953c-4d03-8bb5-c84b365acf62 HTTP/1.1" status: 204 len: 168 time: 0.8858287 Feb 08 18:24:09.846594 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd5ab9458-bd5e-49a0-b97b-1e388bb5af81', 'tag': '012af0ea-fa3b-4267-a4da-80c767055b16'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:24:09.847250 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-77dd8c96-c849-4f1d-b7f8-68e3eda0f004" -d '{"events": [{"name": "network-changed", "server_uuid": "d5ab9458-bd5e-49a0-b97b-1e388bb5af81", "tag": "012af0ea-fa3b-4267-a4da-80c767055b16"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:24:09.886231 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 08 Feb 2022 18:24:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1d0d1231-262c-47df-a643-f7a5a390363e x-openstack-request-id: req-1d0d1231-262c-47df-a643-f7a5a390363e {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:24:09.886484 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d5ab9458-bd5e-49a0-b97b-1e388bb5af81", "tag": "012af0ea-fa3b-4267-a4da-80c767055b16", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:24:09.886782 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-1d0d1231-262c-47df-a643-f7a5a390363e {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:24:09.887158 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd5ab9458-bd5e-49a0-b97b-1e388bb5af81', 'tag': '012af0ea-fa3b-4267-a4da-80c767055b16', 'status': 'completed', 'code': 200} Feb 08 18:24:09.947927 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-71095234-5800-4f49-b1b2-2615807dbd3c None None] Set router ca0e41d8-de98-4af8-80f4-29c2c72d8f6c gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:24:09.958586 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77dd8c96-c849-4f1d-b7f8-68e3eda0f004 req-33ee4d06-d406-4c92-bdaa-83c0ecb5ff2e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:24:09.960319 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-77dd8c96-c849-4f1d-b7f8-68e3eda0f004 req-33ee4d06-d406-4c92-bdaa-83c0ecb5ff2e service neutron] 10.222.0.109 "GET /v2.0/ports?tenant_id=c504038b02a545d8a8b1873a4dfee655&device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 1130 time: 0.0504029 Feb 08 18:24:10.065324 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77dd8c96-c849-4f1d-b7f8-68e3eda0f004 req-6b47182b-93c5-4ec9-b517-15602887d229 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:24:10.066846 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-77dd8c96-c849-4f1d-b7f8-68e3eda0f004 req-6b47182b-93c5-4ec9-b517-15602887d229 service neutron] 10.222.0.109 "GET /v2.0/networks?id=ad3e14dd-35bd-4c6d-8d94-5b851458e927 HTTP/1.1" status: 200 len: 911 time: 0.0985763 Feb 08 18:24:10.086184 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22790c7d-f5cc-4d93-827b-ca4d91ddf850 req-5be07b56-5cdc-478f-ab06-1e0d8af566fd tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102559) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:24:10.088558 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-22790c7d-f5cc-4d93-827b-ca4d91ddf850 req-5be07b56-5cdc-478f-ab06-1e0d8af566fd tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0545974 Feb 08 18:24:10.111526 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-77dd8c96-c849-4f1d-b7f8-68e3eda0f004 req-a72220cc-74de-419a-9b0a-b8a01413d9c4 service neutron] 10.222.0.109 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=012af0ea-fa3b-4267-a4da-80c767055b16 HTTP/1.1" status: 200 len: 217 time: 0.0385711 Feb 08 18:24:10.138305 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [req-22790c7d-f5cc-4d93-827b-ca4d91ddf850 req-961f4de2-d142-411b-83a8-38d619a2f537 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440552 Feb 08 18:24:10.162856 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77dd8c96-c849-4f1d-b7f8-68e3eda0f004 req-9bc500f3-84d2-496b-a6c5-64cac9aca495 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:24:10.164332 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-77dd8c96-c849-4f1d-b7f8-68e3eda0f004 req-9bc500f3-84d2-496b-a6c5-64cac9aca495 service neutron] 10.222.0.109 "GET /v2.0/subnets?id=58f829ef-859d-415d-b810-791456a616fc HTTP/1.1" status: 200 len: 848 time: 0.0475080 Feb 08 18:24:10.167720 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-71095234-5800-4f49-b1b2-2615807dbd3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'name': 'tempest-TestShelveInstance-1763644147-router', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:17Z', 'revision_number': 4, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'gw_port': {'id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:9d:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'fcd6795b-c979-4a72-b6dc-55c74ed312f1', 'name': '', 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'mac_address': 'fa:16:3e:3a:92:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': '58f829ef-859d-415d-b810-791456a616fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:17Z', 'updated_at': '2022-02-08T18:17:22Z', 'revision_number': 5, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'subnets': [{'id': '58f829ef-859d-415d-b810-791456a616fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:24:10.194741 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-71095234-5800-4f49-b1b2-2615807dbd3c None None] Checking router: ca0e41d8-de98-4af8-80f4-29c2c72d8f6c for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:24:10.203086 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-71095234-5800-4f49-b1b2-2615807dbd3c None None] Routers {'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:24:10.203692 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-71095234-5800-4f49-b1b2-2615807dbd3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:23:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:24:10.213567 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77dd8c96-c849-4f1d-b7f8-68e3eda0f004 req-1c3738a1-1056-46e4-a19d-6092941ae680 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:24:10.215152 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-77dd8c96-c849-4f1d-b7f8-68e3eda0f004 req-1c3738a1-1056-46e4-a19d-6092941ae680 service neutron] 10.222.0.109 "GET /v2.0/ports?network_id=ad3e14dd-35bd-4c6d-8d94-5b851458e927&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1213 time: 0.0436156 Feb 08 18:24:10.306953 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-77dd8c96-c849-4f1d-b7f8-68e3eda0f004 req-08fc5331-89a2-4bfe-99d4-daa196660022 service neutron] 10.222.0.109 "GET /v2.0/networks/ad3e14dd-35bd-4c6d-8d94-5b851458e927?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0854051 Feb 08 18:24:10.309789 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-71095234-5800-4f49-b1b2-2615807dbd3c None None] Set router ca0e41d8-de98-4af8-80f4-29c2c72d8f6c gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:24:10.394589 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-77dd8c96-c849-4f1d-b7f8-68e3eda0f004 req-8554fcc5-dd56-42b3-8b33-0fca5930585f service neutron] 10.222.0.109 "GET /v2.0/networks/ad3e14dd-35bd-4c6d-8d94-5b851458e927?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0804710 Feb 08 18:24:10.507439 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-71095234-5800-4f49-b1b2-2615807dbd3c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'name': 'tempest-TestShelveInstance-1763644147-router', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:17Z', 'revision_number': 4, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'gw_port': {'id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:9d:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'fcd6795b-c979-4a72-b6dc-55c74ed312f1', 'name': '', 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'mac_address': 'fa:16:3e:3a:92:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': '58f829ef-859d-415d-b810-791456a616fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:17Z', 'updated_at': '2022-02-08T18:17:22Z', 'revision_number': 5, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'subnets': [{'id': '58f829ef-859d-415d-b810-791456a616fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:24:10.532837 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-71095234-5800-4f49-b1b2-2615807dbd3c None None] The sync data for ids ['ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'] in dv-cinder-773985-21-iscsi is: [{'id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'name': 'tempest-TestShelveInstance-1763644147-router', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:17Z', 'revision_number': 4, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'gw_port': {'id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:9d:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi', '_interfaces': [{'id': 'fcd6795b-c979-4a72-b6dc-55c74ed312f1', 'name': '', 'network_id': 'ad3e14dd-35bd-4c6d-8d94-5b851458e927', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'mac_address': 'fa:16:3e:3a:92:a2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_interface', 'standard_attr_id': 527, 'fixed_ips': [{'subnet_id': '58f829ef-859d-415d-b810-791456a616fc', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:17Z', 'updated_at': '2022-02-08T18:17:22Z', 'revision_number': 5, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'subnets': [{'id': '58f829ef-859d-415d-b810-791456a616fc', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:24:10.757409 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a9c667ab-d08e-4c4a-a450-6cbeab324823 None None] New status for floating IP 74b63cc7-953c-4d03-8bb5-c84b365acf62: DOWN {{(pid=102562) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Feb 08 18:24:11.273354 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a40cb221-c93c-43d1-8f6f-887e5dd7db6b req-448bdbbd-dc1e-41ed-870a-63b2bd91cc3d tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:24:11.274801 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a40cb221-c93c-43d1-8f6f-887e5dd7db6b req-448bdbbd-dc1e-41ed-870a-63b2bd91cc3d tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0543437 Feb 08 18:24:11.329843 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-a40cb221-c93c-43d1-8f6f-887e5dd7db6b req-2f9e2c6d-7b8a-42be-865f-d7914b8d502a tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/security-groups?id=139768cd-8631-410a-b2f1-32ac28ffc91c&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0466413 Feb 08 18:24:11.679771 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f596da68-aac1-433f-8c29-01502989dc36 req-7658ca56-9abe-4eda-b5e1-9721b746e95b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102560) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Feb 08 18:24:11.681218 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f596da68-aac1-433f-8c29-01502989dc36 req-7658ca56-9abe-4eda-b5e1-9721b746e95b tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.109 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 946 time: 0.0613062 Feb 08 18:24:11.771887 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-f596da68-aac1-433f-8c29-01502989dc36 req-eaf9e04b-4ee6-4212-9d33-e1859f72fc8c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Deleting port 012af0ea-fa3b-4267-a4da-80c767055b16 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:24:11.772246 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-f596da68-aac1-433f-8c29-01502989dc36 req-eaf9e04b-4ee6-4212-9d33-e1859f72fc8c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (012af0ea-fa3b-4267-a4da-80c767055b16), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:11.858880 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [req-f596da68-aac1-433f-8c29-01502989dc36 req-eaf9e04b-4ee6-4212-9d33-e1859f72fc8c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] For port 012af0ea-fa3b-4267-a4da-80c767055b16, host hv-cinder-77398, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-77398',level=0,port_id=012af0ea-fa3b-4267-a4da-80c767055b16,segment=NetworkSegment(2daf4609-3228-47d5-8b2b-536e57ae3977),segment_id=2daf4609-3228-47d5-8b2b-536e57ae3977)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:24:11.859231 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-f596da68-aac1-433f-8c29-01502989dc36 req-eaf9e04b-4ee6-4212-9d33-e1859f72fc8c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (012af0ea-fa3b-4267-a4da-80c767055b16), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:11.871513 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [req-f596da68-aac1-433f-8c29-01502989dc36 req-eaf9e04b-4ee6-4212-9d33-e1859f72fc8c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Calling delete_port for 012af0ea-fa3b-4267-a4da-80c767055b16 owned by compute:nova {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:24:11.998084 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-f596da68-aac1-433f-8c29-01502989dc36 req-eaf9e04b-4ee6-4212-9d33-e1859f72fc8c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (012af0ea-fa3b-4267-a4da-80c767055b16), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:12.025362 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eaf9e04b-4ee6-4212-9d33-e1859f72fc8c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Pushing event deleted for resources: {'Port': ['ID=012af0ea-fa3b-4267-a4da-80c767055b16,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:24:12.071511 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [req-f596da68-aac1-433f-8c29-01502989dc36 req-eaf9e04b-4ee6-4212-9d33-e1859f72fc8c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] No DVR routers for this DVR port 012af0ea-fa3b-4267-a4da-80c767055b16 on host hv-cinder-77398 {{(pid=102560) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:24:12.073986 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [req-f596da68-aac1-433f-8c29-01502989dc36 req-eaf9e04b-4ee6-4212-9d33-e1859f72fc8c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-230776'] for port (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:12.077288 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-f596da68-aac1-433f-8c29-01502989dc36 req-eaf9e04b-4ee6-4212-9d33-e1859f72fc8c tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.109 "DELETE /v2.0/ports/012af0ea-fa3b-4267-a4da-80c767055b16 HTTP/1.1" status: 204 len: 173 time: 0.3905358 Feb 08 18:24:12.077722 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd5ab9458-bd5e-49a0-b97b-1e388bb5af81', 'name': 'network-vif-deleted', 'tag': '012af0ea-fa3b-4267-a4da-80c767055b16'}] {{(pid=102560) send_events /opt/stack/neutron/neutron/notifiers/nova.py:271}} Feb 08 18:24:12.080228 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.118/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}180f0d0d4cd082eb87fa50ae716b95c3165f5ad3e4c7043f9f716004aa3f71ee" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6d50625f-4c99-4446-b884-2e4ce4c1d300" -d '{"events": [{"server_uuid": "d5ab9458-bd5e-49a0-b97b-1e388bb5af81", "name": "network-vif-deleted", "tag": "012af0ea-fa3b-4267-a4da-80c767055b16"}]}' {{(pid=102560) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Feb 08 18:24:12.127168 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 08 Feb 2022 18:24:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-95df070e-18e9-464f-b541-abd1b701d488 x-openstack-request-id: req-95df070e-18e9-464f-b541-abd1b701d488 {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Feb 08 18:24:12.127465 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d5ab9458-bd5e-49a0-b97b-1e388bb5af81", "name": "network-vif-deleted", "tag": "012af0ea-fa3b-4267-a4da-80c767055b16", "status": "completed", "code": 200}]} {{(pid=102560) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Feb 08 18:24:12.127735 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.118/compute/v2.1/os-server-external-events used request id req-95df070e-18e9-464f-b541-abd1b701d488 {{(pid=102560) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Feb 08 18:24:12.128116 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd5ab9458-bd5e-49a0-b97b-1e388bb5af81', 'name': 'network-vif-deleted', 'tag': '012af0ea-fa3b-4267-a4da-80c767055b16', 'status': 'completed', 'code': 200} Feb 08 18:24:12.432766 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [req-9e5b9d6b-f5d5-40e0-92b4-4169d3c9287a req-ae12c37a-e5c2-490a-8dc1-9532e0b30296 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "GET /v2.0/ports?device_id=d5ab9458-bd5e-49a0-b97b-1e388bb5af81 HTTP/1.1" status: 200 len: 210 time: 0.0304260 Feb 08 18:24:13.490389 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45948) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:24:13.551523 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1ce80a83-c4a1-4bac-be17-e3d9c5d810b2 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group (139768cd-8631-410a-b2f1-32ac28ffc91c), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:13.580109 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1ce80a83-c4a1-4bac-be17-e3d9c5d810b2 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group (139768cd-8631-410a-b2f1-32ac28ffc91c), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:13.645237 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1ce80a83-c4a1-4bac-be17-e3d9c5d810b2 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (139768cd-8631-410a-b2f1-32ac28ffc91c), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:13.647958 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-1ce80a83-c4a1-4bac-be17-e3d9c5d810b2 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:13.649245 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-1ce80a83-c4a1-4bac-be17-e3d9c5d810b2 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] 10.222.0.118 "DELETE /v2.0/security-groups/139768cd-8631-410a-b2f1-32ac28ffc91c HTTP/1.1" status: 204 len: 168 time: 0.1575899 Feb 08 18:24:13.658251 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ce80a83-c4a1-4bac-be17-e3d9c5d810b2 tempest-TestShelveInstance-1534953866 tempest-TestShelveInstance-1534953866-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=139768cd-8631-410a-b2f1-32ac28ffc91c,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:24:13.700675 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45952) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:24:14.212000 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-a143d477-ac12-4779-b699-8010635e0468 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-559978'] for router_interface (ca0e41d8-de98-4af8-80f4-29c2c72d8f6c), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:14.297116 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 012af0ea-fa3b-4267-a4da-80c767055b16 no longer exists at agent hyperv_hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:24:14.320825 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] No Port match for: 012af0ea-fa3b-4267-a4da-80c767055b16 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:24:14.321172 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Device 012af0ea-fa3b-4267-a4da-80c767055b16 not bound to the agent host hv-cinder-77398 {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:24:14.463791 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-a143d477-ac12-4779-b699-8010635e0468 admin admin] Deleting port fcd6795b-c979-4a72-b6dc-55c74ed312f1 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:24:14.464105 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-a143d477-ac12-4779-b699-8010635e0468 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (fcd6795b-c979-4a72-b6dc-55c74ed312f1), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:14.545248 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [None req-a143d477-ac12-4779-b699-8010635e0468 admin admin] For port fcd6795b-c979-4a72-b6dc-55c74ed312f1, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=fcd6795b-c979-4a72-b6dc-55c74ed312f1,segment=NetworkSegment(2daf4609-3228-47d5-8b2b-536e57ae3977),segment_id=2daf4609-3228-47d5-8b2b-536e57ae3977)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:24:14.545975 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-a143d477-ac12-4779-b699-8010635e0468 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (fcd6795b-c979-4a72-b6dc-55c74ed312f1), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:14.558130 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-a143d477-ac12-4779-b699-8010635e0468 admin admin] Calling delete_port for fcd6795b-c979-4a72-b6dc-55c74ed312f1 owned by network:router_interface {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:24:14.997427 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-a143d477-ac12-4779-b699-8010635e0468 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (fcd6795b-c979-4a72-b6dc-55c74ed312f1), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:15.032336 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a143d477-ac12-4779-b699-8010635e0468 admin admin] Pushing event deleted for resources: {'Port': ['ID=fcd6795b-c979-4a72-b6dc-55c74ed312f1,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:24:15.193212 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-a143d477-ac12-4779-b699-8010635e0468 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-631690', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-560126'] for router_interface (ca0e41d8-de98-4af8-80f4-29c2c72d8f6c), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:15.389250 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-c4392b1e-13cd-412e-b6c5-d549603b7250 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:15.423518 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a143d477-ac12-4779-b699-8010635e0468 admin admin] Router ca0e41d8-de98-4af8-80f4-29c2c72d8f6c has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102560) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:24:15.530259 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a143d477-ac12-4779-b699-8010635e0468 admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102560) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:24:15.535712 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-a143d477-ac12-4779-b699-8010635e0468 admin admin] 10.222.0.118 "PUT /v2.0/routers/ca0e41d8-de98-4af8-80f4-29c2c72d8f6c/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.8336198 Feb 08 18:24:15.538669 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45956) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:24:15.539709 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d506a238-8671-4584-9e63-aebd6935e208 None None] Sync routers for ids ['ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'] in dv-cinder-773985-21-iscsi {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:24:15.551136 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d506a238-8671-4584-9e63-aebd6935e208 None None] Routers {'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:24:15.551754 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-d506a238-8671-4584-9e63-aebd6935e208 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:23:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:24:15.644757 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-6d2c6396-895e-4b6c-98f3-b95adc1432be admin admin] Publish callbacks [] for router (ca0e41d8-de98-4af8-80f4-29c2c72d8f6c), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:15.659381 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-d506a238-8671-4584-9e63-aebd6935e208 None None] Set router ca0e41d8-de98-4af8-80f4-29c2c72d8f6c gateway port host: dv-cinder-773985-21-iscsi {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:24:15.751563 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-6d2c6396-895e-4b6c-98f3-b95adc1432be admin admin] Publish callbacks [] for router_gateway (ca0e41d8-de98-4af8-80f4-29c2c72d8f6c), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:15.806358 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-6d2c6396-895e-4b6c-98f3-b95adc1432be admin admin] Deleting port b23f7769-8791-432a-ad36-c1022d3e09a4 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:24:15.806707 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-6d2c6396-895e-4b6c-98f3-b95adc1432be admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (b23f7769-8791-432a-ad36-c1022d3e09a4), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:15.834740 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-d506a238-8671-4584-9e63-aebd6935e208 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'name': 'tempest-TestShelveInstance-1763644147-router', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121'}], 'enable_snat': True}, 'gw_port_id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:24:14Z', 'revision_number': 5, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'gw_port': {'id': 'b23f7769-8791-432a-ad36-c1022d3e09a4', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:f4:9d:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'device_owner': 'network:router_gateway', 'standard_attr_id': 521, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.121', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:17:19Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:24:15.860998 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d506a238-8671-4584-9e63-aebd6935e208 None None] Checking router: ca0e41d8-de98-4af8-80f4-29c2c72d8f6c for host: dv-cinder-773985-21-iscsi {{(pid=102561) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:24:15.870385 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d506a238-8671-4584-9e63-aebd6935e208 None None] Routers {'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102561) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:24:15.871032 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-d506a238-8671-4584-9e63-aebd6935e208 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:23:48Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'], 'active': True} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:24:15.886626 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [None req-6d2c6396-895e-4b6c-98f3-b95adc1432be admin admin] For port b23f7769-8791-432a-ad36-c1022d3e09a4, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=b23f7769-8791-432a-ad36-c1022d3e09a4,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:24:15.887019 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-6d2c6396-895e-4b6c-98f3-b95adc1432be admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (b23f7769-8791-432a-ad36-c1022d3e09a4), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:15.899479 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-6d2c6396-895e-4b6c-98f3-b95adc1432be admin admin] Calling delete_port for b23f7769-8791-432a-ad36-c1022d3e09a4 owned by network:router_gateway {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:24:15.959601 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvr_db [None req-d506a238-8671-4584-9e63-aebd6935e208 None None] Set router ca0e41d8-de98-4af8-80f4-29c2c72d8f6c gateway port host: None {{(pid=102561) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:24:16.012861 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_hamode_db [None req-d506a238-8671-4584-9e63-aebd6935e208 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'name': 'tempest-TestShelveInstance-1763644147-router', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:24:15Z', 'revision_number': 6, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'gw_port_host': None}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102561) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:24:16.040851 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d506a238-8671-4584-9e63-aebd6935e208 None None] The sync data for ids ['ca0e41d8-de98-4af8-80f4-29c2c72d8f6c'] in dv-cinder-773985-21-iscsi is: [{'id': 'ca0e41d8-de98-4af8-80f4-29c2c72d8f6c', 'name': 'tempest-TestShelveInstance-1763644147-router', 'tenant_id': 'c504038b02a545d8a8b1873a4dfee655', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:14Z', 'updated_at': '2022-02-08T18:24:15Z', 'revision_number': 6, 'project_id': 'c504038b02a545d8a8b1873a4dfee655', 'gw_port_host': None}] {{(pid=102561) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:24:16.065936 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-6d2c6396-895e-4b6c-98f3-b95adc1432be admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (b23f7769-8791-432a-ad36-c1022d3e09a4), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:16.095548 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d2c6396-895e-4b6c-98f3-b95adc1432be admin admin] Pushing event deleted for resources: {'Port': ['ID=b23f7769-8791-432a-ad36-c1022d3e09a4,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:24:16.153875 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-6d2c6396-895e-4b6c-98f3-b95adc1432be admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-560668'] for router_gateway (ca0e41d8-de98-4af8-80f4-29c2c72d8f6c), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:16.252374 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-6d2c6396-895e-4b6c-98f3-b95adc1432be admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-557467', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6918'] for router (ca0e41d8-de98-4af8-80f4-29c2c72d8f6c), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:16.254546 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-6d2c6396-895e-4b6c-98f3-b95adc1432be admin admin] Publish callbacks [] for router_controller (ca0e41d8-de98-4af8-80f4-29c2c72d8f6c), precommit_delete_associations {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:16.298006 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-6d2c6396-895e-4b6c-98f3-b95adc1432be admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-557452'] for router (ca0e41d8-de98-4af8-80f4-29c2c72d8f6c), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:16.298684 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6d2c6396-895e-4b6c-98f3-b95adc1432be admin admin] Fanout notify agent at l3_agent the message router_deleted on router ca0e41d8-de98-4af8-80f4-29c2c72d8f6c {{(pid=102560) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Feb 08 18:24:16.303088 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-6d2c6396-895e-4b6c-98f3-b95adc1432be admin admin] Publish callbacks [] for router (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:16.304235 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-6d2c6396-895e-4b6c-98f3-b95adc1432be admin admin] 10.222.0.118 "DELETE /v2.0/routers/ca0e41d8-de98-4af8-80f4-29c2c72d8f6c HTTP/1.1" status: 204 len: 168 time: 0.7646110 Feb 08 18:24:16.306868 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45958) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:24:16.349549 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_v2 [None req-8c895b79-a01c-48d8-a528-d310efcc830c admin admin] Deleting subnet 58f829ef-859d-415d-b810-791456a616fc {{(pid=102560) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Feb 08 18:24:16.352601 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8c895b79-a01c-48d8-a528-d310efcc830c admin admin] Publish callbacks [] for subnet (58f829ef-859d-415d-b810-791456a616fc), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:16.389711 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8c895b79-a01c-48d8-a528-d310efcc830c admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-64533851'] for subnet (58f829ef-859d-415d-b810-791456a616fc), precommit_delete_associations {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:16.472222 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8c895b79-a01c-48d8-a528-d310efcc830c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1801023'] for subnet (58f829ef-859d-415d-b810-791456a616fc), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:16.516986 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device fcd6795b-c979-4a72-b6dc-55c74ed312f1 no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:24:16.526256 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8c895b79-a01c-48d8-a528-d310efcc830c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1801156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-64531538', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-64597460'] for subnet (58f829ef-859d-415d-b810-791456a616fc), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:16.537530 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: fcd6795b-c979-4a72-b6dc-55c74ed312f1 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:24:16.538132 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device fcd6795b-c979-4a72-b6dc-55c74ed312f1 not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:24:16.550481 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c895b79-a01c-48d8-a528-d310efcc830c admin admin] Pushing event deleted for resources: {'Subnet': ['ID=58f829ef-859d-415d-b810-791456a616fc,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:24:16.556216 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-8c895b79-a01c-48d8-a528-d310efcc830c admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:16.560212 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-8c895b79-a01c-48d8-a528-d310efcc830c admin admin] 10.222.0.118 "DELETE /v2.0/subnets/58f829ef-859d-415d-b810-791456a616fc HTTP/1.1" status: 204 len: 168 time: 0.2522924 Feb 08 18:24:16.561547 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-79c12b8d-8f27-4aaf-b825-d7988c19d1dd None None] Network ad3e14dd-35bd-4c6d-8d94-5b851458e927 requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:24:16.561955 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45960) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:24:16.631444 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1860329'] for network (ad3e14dd-35bd-4c6d-8d94-5b851458e927), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:16.684484 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Deleting port 0e006909-da82-4ae1-b4b6-dd81c746ef8f {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:24:16.685087 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (0e006909-da82-4ae1-b4b6-dd81c746ef8f), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:16.743971 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] For port 0e006909-da82-4ae1-b4b6-dd81c746ef8f, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=0e006909-da82-4ae1-b4b6-dd81c746ef8f,segment=NetworkSegment(2daf4609-3228-47d5-8b2b-536e57ae3977),segment_id=2daf4609-3228-47d5-8b2b-536e57ae3977)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:24:16.744322 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (0e006909-da82-4ae1-b4b6-dd81c746ef8f), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:16.760077 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Calling delete_port for 0e006909-da82-4ae1-b4b6-dd81c746ef8f owned by network:dhcp {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:24:16.826975 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fb1bc9c7-58b6-4eaf-a0b9-0da42d501375 None None] DHCP port deletion for ad3e14dd-35bd-4c6d-8d94-5b851458e927 request from dv-cinder-773985-21-iscsi {{(pid=102561) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Feb 08 18:24:16.846064 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (0e006909-da82-4ae1-b4b6-dd81c746ef8f), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:16.871643 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Pushing event deleted for resources: {'Port': ['ID=0e006909-da82-4ae1-b4b6-dd81c746ef8f,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:24:16.876066 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] No DVR routers for this DVR port 0e006909-da82-4ae1-b4b6-dd81c746ef8f on host dv-cinder-773985-21-iscsi {{(pid=102560) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:24:16.879046 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-fb1bc9c7-58b6-4eaf-a0b9-0da42d501375 None None] Deleting port 0e006909-da82-4ae1-b4b6-dd81c746ef8f {{(pid=102561) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:24:16.879488 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-fb1bc9c7-58b6-4eaf-a0b9-0da42d501375 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (0e006909-da82-4ae1-b4b6-dd81c746ef8f), before_delete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:16.883908 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:16.884258 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:16.884744 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:16.884959 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:16.885259 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:16.885586 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:16.885911 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:16.886237 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:16.886560 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:16.886919 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:16.887242 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:16.887559 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:16.887877 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102560) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:16.944445 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-fb1bc9c7-58b6-4eaf-a0b9-0da42d501375 None None] For port 0e006909-da82-4ae1-b4b6-dd81c746ef8f, host dv-cinder-773985-21-iscsi, got binding levels [] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:24:16.945399 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-fb1bc9c7-58b6-4eaf-a0b9-0da42d501375 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (0e006909-da82-4ae1-b4b6-dd81c746ef8f), precommit_delete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:16.958313 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-fb1bc9c7-58b6-4eaf-a0b9-0da42d501375 None None] Calling delete_port for 0e006909-da82-4ae1-b4b6-dd81c746ef8f owned by network:dhcp {{(pid=102561) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:24:16.959159 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1721768', 'neutron.services.segments.db._delete_segments_for_network-8770558865089'] for network (ad3e14dd-35bd-4c6d-8d94-5b851458e927), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:16.961224 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.ipam_backend_mixin [None req-fb1bc9c7-58b6-4eaf-a0b9-0da42d501375 None None] Port 0e006909-da82-4ae1-b4b6-dd81c746ef8f was not found and therefore no delete operation was performed {{(pid=102561) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Feb 08 18:24:16.962466 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-fb1bc9c7-58b6-4eaf-a0b9-0da42d501375 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442'] for port (0e006909-da82-4ae1-b4b6-dd81c746ef8f), after_delete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:16.978651 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['ad3e14dd-35bd-4c6d-8d94-5b851458e927']}} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:24:16.987455 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb1bc9c7-58b6-4eaf-a0b9-0da42d501375 None None] Pushing event deleted for resources: {'Port': ['ID=0e006909-da82-4ae1-b4b6-dd81c746ef8f,revision_number=None']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:24:16.988469 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2daf4609-3228-47d5-8b2b-536e57ae3977') {'for_net_delete': True} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:24:16.989340 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2daf4609-3228-47d5-8b2b-536e57ae3977') {} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:24:16.991046 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fb1bc9c7-58b6-4eaf-a0b9-0da42d501375 None None] No DVR routers for this DVR port 0e006909-da82-4ae1-b4b6-dd81c746ef8f on host dv-cinder-773985-21-iscsi {{(pid=102561) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:24:17.003237 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8770558866122', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-64533840'] for segment (2daf4609-3228-47d5-8b2b-536e57ae3977), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:17.017088 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (2daf4609-3228-47d5-8b2b-536e57ae3977), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:17.023983 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Releasing vlan 1065 on physical network physnet1 to pool {{(pid=102560) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Feb 08 18:24:17.024230 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-64531704'] for segment (2daf4609-3228-47d5-8b2b-536e57ae3977), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: Traceback (most recent call last): Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: timer() Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: cb(*args, **kw) Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: return func(*args, **kwargs) Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: self._notify() Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: self.callback(batched_events) Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: event.method(event) Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: aggregate_uuid = self.p_client.list_aggregates( Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: return f(self, *a, **k) Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: return self._get(url).json() Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: return self._client.get(url, endpoint_filter=self._ks_filter, Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: return self.request(url, 'GET', **kwargs) Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: base_url = self.get_endpoint(auth, allow=allow, Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 08 18:24:17.026122 dv-cinder-773985-21-iscsi neutron-server[102560]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 08 18:24:17.082586 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1721777', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-560760'] for network (ad3e14dd-35bd-4c6d-8d94-5b851458e927), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:17.088283 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:17.091634 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] 10.222.0.118 "DELETE /v2.0/networks/ad3e14dd-35bd-4c6d-8d94-5b851458e927 HTTP/1.1" status: 204 len: 168 time: 0.5286818 Feb 08 18:24:17.094883 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45962) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:24:17.103039 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a7901e7-eac6-41f7-8685-27f3b3e75c86 admin admin] Pushing event deleted for resources: {'Network': ['ID=ad3e14dd-35bd-4c6d-8d94-5b851458e927,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:24:17.457586 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-559978'] for router_interface (dd95d872-66ab-4182-bf88-5307b4f94217), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:17.834579 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-9b4244a8-e441-403b-bb2e-ccfac109256d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:17.976104 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] Deleting port f2343e5e-db58-45cd-8f37-ed1e16875a67 {{(pid=102559) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:24:17.976415 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (f2343e5e-db58-45cd-8f37-ed1e16875a67), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:18.052919 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.db [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] For port f2343e5e-db58-45cd-8f37-ed1e16875a67, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=f2343e5e-db58-45cd-8f37-ed1e16875a67,segment=NetworkSegment(c2af1e5f-fa31-4573-977c-86e6f81f6ce5),segment_id=c2af1e5f-fa31-4573-977c-86e6f81f6ce5)] {{(pid=102559) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:24:18.053278 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (f2343e5e-db58-45cd-8f37-ed1e16875a67), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:18.066231 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.plugins.ml2.plugin [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] Calling delete_port for f2343e5e-db58-45cd-8f37-ed1e16875a67 owned by network:router_interface {{(pid=102559) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:24:18.128099 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:18.218170 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device b23f7769-8791-432a-ad36-c1022d3e09a4 no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:24:18.257131 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-63856471'] for port (f2343e5e-db58-45cd-8f37-ed1e16875a67), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:18.283717 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] Pushing event deleted for resources: {'Port': ['ID=f2343e5e-db58-45cd-8f37-ed1e16875a67,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:24:18.316550 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:18.316888 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:18.317233 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] Version for resource type LocalIPAssociation changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:18.317573 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:18.317916 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:18.318254 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:18.318569 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:18.318962 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:18.319300 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:18.319628 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:18.319952 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:18.320274 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:18.320791 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-773985-21-iscsi {{(pid=102559) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Feb 08 18:24:18.376289 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: b23f7769-8791-432a-ad36-c1022d3e09a4 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:24:18.376630 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device b23f7769-8791-432a-ad36-c1022d3e09a4 not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:24:18.377107 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 0e006909-da82-4ae1-b4b6-dd81c746ef8f no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:24:18.396989 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: 0e006909-da82-4ae1-b4b6-dd81c746ef8f {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:24:18.397245 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 0e006909-da82-4ae1-b4b6-dd81c746ef8f not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:24:18.469369 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-631690', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-560126'] for router_interface (dd95d872-66ab-4182-bf88-5307b4f94217), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:18.543129 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:18.685630 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] Router dd95d872-66ab-4182-bf88-5307b4f94217 has already been hosted by L3 agent 82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3 {{(pid=102559) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Feb 08 18:24:18.799625 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] Notify agent at l3_agent.dv-cinder-773985-21-iscsi the message routers_updated {{(pid=102559) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Feb 08 18:24:18.805265 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-d40b3789-5c7a-488a-9351-67be3e3bcf28 admin admin] 10.222.0.118 "PUT /v2.0/routers/dd95d872-66ab-4182-bf88-5307b4f94217/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7081254 Feb 08 18:24:18.807631 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45964) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:24:18.809146 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d03fefa5-b8c3-49f2-8b50-0f900817cb6c None None] Sync routers for ids ['dd95d872-66ab-4182-bf88-5307b4f94217'] in dv-cinder-773985-21-iscsi {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Feb 08 18:24:18.819779 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d03fefa5-b8c3-49f2-8b50-0f900817cb6c None None] Routers {'dd95d872-66ab-4182-bf88-5307b4f94217'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:24:18.820390 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-d03fefa5-b8c3-49f2-8b50-0f900817cb6c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:24:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['dd95d872-66ab-4182-bf88-5307b4f94217'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:24:18.914531 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-785301a0-f345-4aa1-beca-eeb102199618 admin admin] Publish callbacks [] for router (dd95d872-66ab-4182-bf88-5307b4f94217), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:18.925269 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-d03fefa5-b8c3-49f2-8b50-0f900817cb6c None None] Set router dd95d872-66ab-4182-bf88-5307b4f94217 gateway port host: dv-cinder-773985-21-iscsi {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:24:19.017993 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-785301a0-f345-4aa1-beca-eeb102199618 admin admin] Publish callbacks [] for router_gateway (dd95d872-66ab-4182-bf88-5307b4f94217), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:19.071555 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-785301a0-f345-4aa1-beca-eeb102199618 admin admin] Deleting port 00808ea1-d214-41c7-a14f-da57ed86d9c4 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:24:19.072171 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-785301a0-f345-4aa1-beca-eeb102199618 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (00808ea1-d214-41c7-a14f-da57ed86d9c4), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:19.101664 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-d03fefa5-b8c3-49f2-8b50-0f900817cb6c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd95d872-66ab-4182-bf88-5307b4f94217', 'name': 'tempest-TestShelveInstance-467833778-router', 'tenant_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'external_fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.189'}], 'enable_snat': True}, 'gw_port_id': '00808ea1-d214-41c7-a14f-da57ed86d9c4', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:20Z', 'updated_at': '2022-02-08T18:24:18Z', 'revision_number': 5, 'project_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'gw_port': {'id': '00808ea1-d214-41c7-a14f-da57ed86d9c4', 'name': '', 'network_id': '77055816-7c88-403d-8f8a-9be2c1faa10d', 'tenant_id': '', 'mac_address': 'fa:16:3e:91:27:46', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'dd95d872-66ab-4182-bf88-5307b4f94217', 'device_owner': 'network:router_gateway', 'standard_attr_id': 543, 'fixed_ips': [{'subnet_id': '18547c52-7b23-42cd-bb53-214663ed102b', 'ip_address': '172.27.1.189', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-773985-21-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int', 'bound_drivers': {'0': 'openvswitch'}}, 'port_security_enabled': False, 'tags': [], 'created_at': '2022-02-08T18:17:20Z', 'updated_at': '2022-02-08T18:17:25Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '18547c52-7b23-42cd-bb53-214663ed102b', 'cidr': '172.27.1.0/24', 'gateway_ip': '172.27.1.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-773985-21-iscsi'}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:24:19.127583 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d03fefa5-b8c3-49f2-8b50-0f900817cb6c None None] Checking router: dd95d872-66ab-4182-bf88-5307b4f94217 for host: dv-cinder-773985-21-iscsi {{(pid=102562) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Feb 08 18:24:19.137967 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d03fefa5-b8c3-49f2-8b50-0f900817cb6c None None] Routers {'dd95d872-66ab-4182-bf88-5307b4f94217'} bound to L3 agent in host dv-cinder-773985-21-iscsi {{(pid=102562) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:421}} Feb 08 18:24:19.138704 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-d03fefa5-b8c3-49f2-8b50-0f900817cb6c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-773985-21-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2022-02-08T18:04:18Z,description=,heartbeat_timestamp=2022-02-08T18:24:18Z,host='dv-cinder-773985-21-iscsi',id=82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3,load=0,resource_versions=,resources_synced=,started_at=2022-02-08T18:04:18Z,topic='l3_agent')) {'router_ids': ['dd95d872-66ab-4182-bf88-5307b4f94217'], 'active': True} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:24:19.152931 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [None req-785301a0-f345-4aa1-beca-eeb102199618 admin admin] For port 00808ea1-d214-41c7-a14f-da57ed86d9c4, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=00808ea1-d214-41c7-a14f-da57ed86d9c4,segment=NetworkSegment(b82851d8-2dbc-41d4-9627-76824b5fc9cb),segment_id=b82851d8-2dbc-41d4-9627-76824b5fc9cb)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:24:19.153303 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-785301a0-f345-4aa1-beca-eeb102199618 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (00808ea1-d214-41c7-a14f-da57ed86d9c4), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:19.166338 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-785301a0-f345-4aa1-beca-eeb102199618 admin admin] Calling delete_port for 00808ea1-d214-41c7-a14f-da57ed86d9c4 owned by network:router_gateway {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:24:19.228370 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_dvr_db [None req-d03fefa5-b8c3-49f2-8b50-0f900817cb6c None None] Set router dd95d872-66ab-4182-bf88-5307b4f94217 gateway port host: None {{(pid=102562) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Feb 08 18:24:19.281262 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.l3_hamode_db [None req-d03fefa5-b8c3-49f2-8b50-0f900817cb6c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'dd95d872-66ab-4182-bf88-5307b4f94217', 'name': 'tempest-TestShelveInstance-467833778-router', 'tenant_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:20Z', 'updated_at': '2022-02-08T18:24:19Z', 'revision_number': 6, 'project_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'gw_port_host': None}], 'dv-cinder-773985-21-iscsi', False) {} {{(pid=102562) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:24:19.307985 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d03fefa5-b8c3-49f2-8b50-0f900817cb6c None None] The sync data for ids ['dd95d872-66ab-4182-bf88-5307b4f94217'] in dv-cinder-773985-21-iscsi is: [{'id': 'dd95d872-66ab-4182-bf88-5307b4f94217', 'name': 'tempest-TestShelveInstance-467833778-router', 'tenant_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2022-02-08T18:17:20Z', 'updated_at': '2022-02-08T18:24:19Z', 'revision_number': 6, 'project_id': '0bc4208466064655a0a4f4a9ff97f5fe', 'gw_port_host': None}] {{(pid=102562) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Feb 08 18:24:19.334137 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-785301a0-f345-4aa1-beca-eeb102199618 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (00808ea1-d214-41c7-a14f-da57ed86d9c4), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:19.364404 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-785301a0-f345-4aa1-beca-eeb102199618 admin admin] Pushing event deleted for resources: {'Port': ['ID=00808ea1-d214-41c7-a14f-da57ed86d9c4,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:24:19.420525 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-785301a0-f345-4aa1-beca-eeb102199618 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-560668'] for router_gateway (dd95d872-66ab-4182-bf88-5307b4f94217), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:19.509225 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-785301a0-f345-4aa1-beca-eeb102199618 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-557467', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-6918'] for router (dd95d872-66ab-4182-bf88-5307b4f94217), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:19.511406 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-785301a0-f345-4aa1-beca-eeb102199618 admin admin] Publish callbacks [] for router_controller (dd95d872-66ab-4182-bf88-5307b4f94217), precommit_delete_associations {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:19.556260 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-785301a0-f345-4aa1-beca-eeb102199618 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-557452'] for router (dd95d872-66ab-4182-bf88-5307b4f94217), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:19.556706 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-785301a0-f345-4aa1-beca-eeb102199618 admin admin] Fanout notify agent at l3_agent the message router_deleted on router dd95d872-66ab-4182-bf88-5307b4f94217 {{(pid=102560) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Feb 08 18:24:19.561232 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-785301a0-f345-4aa1-beca-eeb102199618 admin admin] Publish callbacks [] for router (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:19.562402 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-785301a0-f345-4aa1-beca-eeb102199618 admin admin] 10.222.0.118 "DELETE /v2.0/routers/dd95d872-66ab-4182-bf88-5307b4f94217 HTTP/1.1" status: 204 len: 168 time: 0.7537937 Feb 08 18:24:19.564976 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45966) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:24:19.607692 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.db_base_plugin_v2 [None req-0d5da27f-5f26-4cb5-8fd5-5a54281d1585 admin admin] Deleting subnet a8821dcf-aec5-40f7-bf52-57ca331a164a {{(pid=102560) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1065}} Feb 08 18:24:19.610705 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0d5da27f-5f26-4cb5-8fd5-5a54281d1585 admin admin] Publish callbacks [] for subnet (a8821dcf-aec5-40f7-bf52-57ca331a164a), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:19.648926 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0d5da27f-5f26-4cb5-8fd5-5a54281d1585 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-64533851'] for subnet (a8821dcf-aec5-40f7-bf52-57ca331a164a), precommit_delete_associations {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:19.731052 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0d5da27f-5f26-4cb5-8fd5-5a54281d1585 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1801023'] for subnet (a8821dcf-aec5-40f7-bf52-57ca331a164a), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:19.783999 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0d5da27f-5f26-4cb5-8fd5-5a54281d1585 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1801156', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-214452', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-64531538', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-64597460'] for subnet (a8821dcf-aec5-40f7-bf52-57ca331a164a), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:19.809412 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d5da27f-5f26-4cb5-8fd5-5a54281d1585 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a8821dcf-aec5-40f7-bf52-57ca331a164a,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:24:19.813504 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-0d5da27f-5f26-4cb5-8fd5-5a54281d1585 admin admin] Publish callbacks [] for subnet (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:19.816987 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-0d5da27f-5f26-4cb5-8fd5-5a54281d1585 admin admin] 10.222.0.118 "DELETE /v2.0/subnets/a8821dcf-aec5-40f7-bf52-57ca331a164a HTTP/1.1" status: 204 len: 168 time: 0.2510757 Feb 08 18:24:19.819509 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-77cdd6d2-07bc-447c-bf9d-d43e717f727c None None] Network 104cc343-bac7-4e28-b431-8f5c486a990b requested from dv-cinder-773985-21-iscsi {{(pid=102561) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:191}} Feb 08 18:24:19.820365 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45968) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:24:19.887794 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f684da59-fc42-43d5-966a-bc828f844ec6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1860329'] for network (104cc343-bac7-4e28-b431-8f5c486a990b), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:19.943859 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-f684da59-fc42-43d5-966a-bc828f844ec6 admin admin] Deleting port 5fea208c-37b9-4fd9-8f82-1ff18d46f399 {{(pid=102560) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:24:19.944199 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f684da59-fc42-43d5-966a-bc828f844ec6 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (5fea208c-37b9-4fd9-8f82-1ff18d46f399), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:20.003696 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.db [None req-f684da59-fc42-43d5-966a-bc828f844ec6 admin admin] For port 5fea208c-37b9-4fd9-8f82-1ff18d46f399, host dv-cinder-773985-21-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-773985-21-iscsi',level=0,port_id=5fea208c-37b9-4fd9-8f82-1ff18d46f399,segment=NetworkSegment(c2af1e5f-fa31-4573-977c-86e6f81f6ce5),segment_id=c2af1e5f-fa31-4573-977c-86e6f81f6ce5)] {{(pid=102560) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:24:20.003962 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f684da59-fc42-43d5-966a-bc828f844ec6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (5fea208c-37b9-4fd9-8f82-1ff18d46f399), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:20.020002 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.plugin [None req-f684da59-fc42-43d5-966a-bc828f844ec6 admin admin] Calling delete_port for 5fea208c-37b9-4fd9-8f82-1ff18d46f399 owned by network:dhcp {{(pid=102560) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:24:20.087335 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-745b3c08-3cf3-48d3-8257-75c16d34096e None None] DHCP port deletion for 104cc343-bac7-4e28-b431-8f5c486a990b request from dv-cinder-773985-21-iscsi {{(pid=102561) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:249}} Feb 08 18:24:20.102651 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f684da59-fc42-43d5-966a-bc828f844ec6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-64531597'] for port (5fea208c-37b9-4fd9-8f82-1ff18d46f399), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:20.128336 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f684da59-fc42-43d5-966a-bc828f844ec6 admin admin] Pushing event deleted for resources: {'Port': ['ID=5fea208c-37b9-4fd9-8f82-1ff18d46f399,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:24:20.131607 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f684da59-fc42-43d5-966a-bc828f844ec6 admin admin] No DVR routers for this DVR port 5fea208c-37b9-4fd9-8f82-1ff18d46f399 on host dv-cinder-773985-21-iscsi {{(pid=102560) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:24:20.143803 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-745b3c08-3cf3-48d3-8257-75c16d34096e None None] Deleting port 5fea208c-37b9-4fd9-8f82-1ff18d46f399 {{(pid=102561) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1978}} Feb 08 18:24:20.144182 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-745b3c08-3cf3-48d3-8257-75c16d34096e None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8770559039636'] for port (5fea208c-37b9-4fd9-8f82-1ff18d46f399), before_delete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:20.210288 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f684da59-fc42-43d5-966a-bc828f844ec6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1721768', 'neutron.services.segments.db._delete_segments_for_network-8770558865089'] for network (104cc343-bac7-4e28-b431-8f5c486a990b), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:20.212673 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:20.224101 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.db [None req-745b3c08-3cf3-48d3-8257-75c16d34096e None None] For port 5fea208c-37b9-4fd9-8f82-1ff18d46f399, host dv-cinder-773985-21-iscsi, got binding levels [] {{(pid=102561) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Feb 08 18:24:20.224491 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-745b3c08-3cf3-48d3-8257-75c16d34096e None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-569553'] for port (5fea208c-37b9-4fd9-8f82-1ff18d46f399), precommit_delete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:20.235545 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-f684da59-fc42-43d5-966a-bc828f844ec6 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['104cc343-bac7-4e28-b431-8f5c486a990b']}} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:24:20.237237 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 00808ea1-d214-41c7-a14f-da57ed86d9c4 no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:24:20.245642 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-f684da59-fc42-43d5-966a-bc828f844ec6 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c2af1e5f-fa31-4573-977c-86e6f81f6ce5') {'for_net_delete': True} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:24:20.246016 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.services.segments.db [None req-f684da59-fc42-43d5-966a-bc828f844ec6 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c2af1e5f-fa31-4573-977c-86e6f81f6ce5') {} {{(pid=102560) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Feb 08 18:24:20.255860 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f684da59-fc42-43d5-966a-bc828f844ec6 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8770558866122', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-64533840'] for segment (c2af1e5f-fa31-4573-977c-86e6f81f6ce5), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:20.257504 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-745b3c08-3cf3-48d3-8257-75c16d34096e None None] Calling delete_port for 5fea208c-37b9-4fd9-8f82-1ff18d46f399 owned by network:dhcp {{(pid=102561) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2056}} Feb 08 18:24:20.259912 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: 00808ea1-d214-41c7-a14f-da57ed86d9c4 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:24:20.260436 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 00808ea1-d214-41c7-a14f-da57ed86d9c4 not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:24:20.260846 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 5fea208c-37b9-4fd9-8f82-1ff18d46f399 no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:24:20.263406 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.ipam_backend_mixin [None req-745b3c08-3cf3-48d3-8257-75c16d34096e None None] Port 5fea208c-37b9-4fd9-8f82-1ff18d46f399 was not found and therefore no delete operation was performed {{(pid=102561) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Feb 08 18:24:20.265660 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-745b3c08-3cf3-48d3-8257-75c16d34096e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1767990', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-76316', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8770559042039', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8770558538442'] for port (5fea208c-37b9-4fd9-8f82-1ff18d46f399), after_delete {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:20.269734 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f684da59-fc42-43d5-966a-bc828f844ec6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477'] for segment (c2af1e5f-fa31-4573-977c-86e6f81f6ce5), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:20.275845 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f684da59-fc42-43d5-966a-bc828f844ec6 admin admin] Releasing vlan 1086 on physical network physnet1 to pool {{(pid=102560) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Feb 08 18:24:20.276286 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f684da59-fc42-43d5-966a-bc828f844ec6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1801477', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-64531704'] for segment (c2af1e5f-fa31-4573-977c-86e6f81f6ce5), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: Traceback (most recent call last): Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: timer() Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: cb(*args, **kw) Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/common/utils.py", line 921, in wrapper Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: return func(*args, **kwargs) Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: self._notify() Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: self.callback(batched_events) Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: event.method(event) Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: aggregate_id = self._get_aggregate_id(event.segment_id) Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: aggregate_uuid = self.p_client.list_aggregates( Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: return f(self, *a, **k) Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: return self._get(url).json() Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: return self._client.get(url, endpoint_filter=self._ks_filter, Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: return self.request(url, 'GET', **kwargs) Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: base_url = self.get_endpoint(auth, allow=allow, Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: auth = self._auth_required(auth, 'determine endpoint URL') Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Feb 08 18:24:20.277921 dv-cinder-773985-21-iscsi neutron-server[102560]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Feb 08 18:24:20.289427 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: 5fea208c-37b9-4fd9-8f82-1ff18d46f399 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:24:20.289766 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device 5fea208c-37b9-4fd9-8f82-1ff18d46f399 not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:24:20.290178 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device f2343e5e-db58-45cd-8f37-ed1e16875a67 no longer exists at agent ovs-agent-dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Feb 08 18:24:20.310175 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-745b3c08-3cf3-48d3-8257-75c16d34096e None None] Pushing event deleted for resources: {'Port': ['ID=5fea208c-37b9-4fd9-8f82-1ff18d46f399,revision_number=None']} {{(pid=102561) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:24:20.333024 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.db.l3_dvrscheduler_db [None req-745b3c08-3cf3-48d3-8257-75c16d34096e None None] No DVR routers for this DVR port 5fea208c-37b9-4fd9-8f82-1ff18d46f399 on host dv-cinder-773985-21-iscsi {{(pid=102561) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Feb 08 18:24:20.334517 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.plugin [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] No Port match for: f2343e5e-db58-45cd-8f37-ed1e16875a67 {{(pid=102561) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2316}} Feb 08 18:24:20.334867 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron.plugins.ml2.rpc [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Device f2343e5e-db58-45cd-8f37-ed1e16875a67 not bound to the agent host dv-cinder-773985-21-iscsi {{(pid=102561) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Feb 08 18:24:20.343656 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f684da59-fc42-43d5-966a-bc828f844ec6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1721777', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-576054', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-631709', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-560760'] for network (104cc343-bac7-4e28-b431-8f5c486a990b), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:20.348780 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-f684da59-fc42-43d5-966a-bc828f844ec6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-631791'] for network (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:20.354985 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-f684da59-fc42-43d5-966a-bc828f844ec6 admin admin] 10.222.0.118 "DELETE /v2.0/networks/104cc343-bac7-4e28-b431-8f5c486a990b HTTP/1.1" status: 204 len: 168 time: 0.5309033 Feb 08 18:24:20.362002 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f684da59-fc42-43d5-966a-bc828f844ec6 admin admin] Pushing event deleted for resources: {'Network': ['ID=104cc343-bac7-4e28-b431-8f5c486a990b,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:24:20.476416 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45972) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:24:20.519109 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-06acea3c-9b85-416f-8580-904dc3b722e9 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=c504038b02a545d8a8b1873a4dfee655&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0414808 Feb 08 18:24:20.521755 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [-] (102560) accepted ('10.222.0.118', 45974) {{(pid=102560) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:24:20.572833 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-a1aa0d97-04f6-449a-aa57-179906dd6102 admin admin] Publish callbacks [] for security_group (d2fbba51-d721-41f8-8b10-cad418a2f1e9), before_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:20.595913 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-a1aa0d97-04f6-449a-aa57-179906dd6102 admin admin] Publish callbacks [] for security_group (d2fbba51-d721-41f8-8b10-cad418a2f1e9), precommit_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:20.658620 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-a1aa0d97-04f6-449a-aa57-179906dd6102 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (d2fbba51-d721-41f8-8b10-cad418a2f1e9), after_delete {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:20.663321 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron_lib.callbacks.manager [None req-a1aa0d97-04f6-449a-aa57-179906dd6102 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102560) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:20.665075 dv-cinder-773985-21-iscsi neutron-server[102560]: INFO neutron.wsgi [None req-a1aa0d97-04f6-449a-aa57-179906dd6102 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/d2fbba51-d721-41f8-8b10-cad418a2f1e9 HTTP/1.1" status: 204 len: 168 time: 0.1422520 Feb 08 18:24:20.674432 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a1aa0d97-04f6-449a-aa57-179906dd6102 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d2fbba51-d721-41f8-8b10-cad418a2f1e9,revision_number=None']} {{(pid=102560) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:24:21.009904 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45980) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:24:21.053307 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-c7a1f3b9-cc70-469e-82bc-ee1b4336cc86 admin admin] 10.222.0.118 "GET /v2.0/security-groups?tenant_id=0bc4208466064655a0a4f4a9ff97f5fe&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0422184 Feb 08 18:24:21.055863 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.wsgi [-] (102559) accepted ('10.222.0.118', 45982) {{(pid=102559) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Feb 08 18:24:21.106141 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-aef5644b-034a-4ad9-b7ac-55663c3a51b8 admin admin] Publish callbacks [] for security_group (9494e7a5-5595-46d6-a3e8-c6b850394409), before_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:21.127883 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-aef5644b-034a-4ad9-b7ac-55663c3a51b8 admin admin] Publish callbacks [] for security_group (9494e7a5-5595-46d6-a3e8-c6b850394409), precommit_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:21.180226 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-aef5644b-034a-4ad9-b7ac-55663c3a51b8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-586234'] for security_group (9494e7a5-5595-46d6-a3e8-c6b850394409), after_delete {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:21.182824 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron_lib.callbacks.manager [None req-aef5644b-034a-4ad9-b7ac-55663c3a51b8 admin admin] Publish callbacks [] for security_group (None), before_response {{(pid=102559) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:21.183991 dv-cinder-773985-21-iscsi neutron-server[102559]: INFO neutron.wsgi [None req-aef5644b-034a-4ad9-b7ac-55663c3a51b8 admin admin] 10.222.0.118 "DELETE /v2.0/security-groups/9494e7a5-5595-46d6-a3e8-c6b850394409 HTTP/1.1" status: 204 len: 168 time: 0.1272683 Feb 08 18:24:21.192141 dv-cinder-773985-21-iscsi neutron-server[102559]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aef5644b-034a-4ad9-b7ac-55663c3a51b8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9494e7a5-5595-46d6-a3e8-c6b850394409,revision_number=None']} {{(pid=102559) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Feb 08 18:24:21.675522 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:23.013008 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:24:45.395491 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-33a25d48-7445-445a-8e41-903bd98c0d9a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:47.840648 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-7c559bb5-21c0-4322-ad2a-d3e59795d678 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:48.137650 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:48.547957 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:50.173514 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:24:51.696119 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:25:00.014326 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:25:15.395304 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-9f4f6833-de10-4a2c-a847-958a06fe9487 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:25:17.837643 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-df5709d1-4fab-46d5-a2e1-2e842d253706 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:25:18.144946 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:25:18.559631 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:25:20.177964 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:25:21.686831 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:25:37.018680 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:25:45.396689 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-af68da56-f33b-4716-932c-3300924ee484 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:25:47.832288 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-4edaf797-e033-410b-a290-58002f7e430a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:25:48.144626 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:25:48.565218 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:25:50.183970 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:25:51.688158 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:26:14.019025 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:26:15.400870 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-d1724576-59d2-42b7-b513-36d218428692 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:26:17.836474 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-fd16d8c4-bd73-4e8a-9a3c-9c61b536860a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:26:18.145681 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:26:18.565018 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:26:20.187445 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:26:21.689763 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:26:45.403197 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-719a5a50-cf8f-40ed-be0f-aa465b272d94 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:26:47.842494 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-442c7e3e-eddb-4d40-bf4a-634104f39003 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:26:48.163008 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:26:48.567033 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:26:50.185399 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:26:51.024422 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:26:51.694701 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:27:15.404171 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-64e929c5-c40a-4b33-92f0-2ad902b03abd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:27:17.840582 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-5301c36c-6b80-4019-bd27-9a3395f16efc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:27:18.159707 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:27:18.576520 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:27:20.190999 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:27:21.700225 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:27:28.027549 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:27:43.362151 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [req-c840385f-cb50-4c76-98f9-0499105ad0ac req-9597d45a-6ac1-43c2-ba8b-865b975216f2 service neutron] (102560) timed out ('10.222.0.109', 51647) {{(pid=102560) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Feb 08 18:27:45.397471 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-cd182933-bbab-45fc-81fd-a36792abc2f3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:27:47.834966 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-f7dabc95-b977-4455-be0e-6bc6d9afb066 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:27:48.164039 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:27:48.580260 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:27:50.197869 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:27:51.701824 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:28:05.029592 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:28:15.408130 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-308770c7-fd42-4d3c-ac3e-9aeb83f5fcee None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:28:17.837604 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2c913f7f-362b-4ced-b9f8-5bb0c2407841 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:28:18.174680 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:28:18.579637 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:28:20.200901 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:28:21.703509 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:28:42.030405 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:28:45.409763 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-de5e138a-0990-4f95-a2ca-1ac8d38f6fc1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:28:47.846679 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-60ffb866-3970-4208-8a0b-21d6df188069 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:28:48.209292 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:28:48.587932 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:28:50.206433 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:28:51.706972 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:29:15.409649 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-3a90b974-3e97-442d-923a-50a22d3847cb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (006b5388-ac7d-4794-a124-14bb8e5d8fec), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:29:17.840133 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-e9d227b2-c359-4341-bf67-0b92213836ca None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (82adaca4-74f3-4d94-9f5f-c0e8bab5ecd3), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:29:18.197895 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-ac10ae23-272e-4317-9a40-123594e4fc66 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (045b2c3c-7fbb-4e13-a9d7-7a828ff7acc8), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:29:18.588200 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-b5c3f2a6-6e24-4137-9d8b-1ccb22a60ac1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (ba028b7f-8b97-469f-9871-f9ea7f6fce8d), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:29:19.032319 dv-cinder-773985-21-iscsi neutron-server[102562]: DEBUG neutron.db.agents_db [None req-85ea33b9-56a9-45b0-96e9-87acc0889c60 None None] Agent healthcheck: found 6 active agents {{(pid=102562) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Feb 08 18:29:20.207491 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-bba08245-9981-4994-9634-a3114451dcf3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (3ce6cbc5-1640-4b9e-88d1-b36c3b5fc7c6), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:29:21.705470 dv-cinder-773985-21-iscsi neutron-server[102561]: DEBUG neutron_lib.callbacks.manager [None req-2fd75f55-aa0d-4c76-9b17-8e91639a6679 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8770558865071', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-1723555'] for agent (8e282338-d49c-44f3-a0d1-6b594748b4ab), after_update {{(pid=102561) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:176}} Feb 08 18:29:35.906321 dv-cinder-773985-21-iscsi neutron-server[102560]: DEBUG neutron.wsgi [req-17894955-f99b-45d0-a197-89a328af7ab4 req-4f7ca03c-e6ff-4cdf-a15e-21e99b45fa86 service neutron] (102560) timed out ('10.222.0.118', 39346) {{(pid=102560) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}}